You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-27 - 14:19
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot2.osadl.org (updated Sat Jul 27, 2024 12:43:29)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2679189520,30rtkit-daemon0-21swapper/507:01:325
2394914994240,2cyclictest2710674-21kworker/u16:0+events_unbound09:41:015
23852562403,31sleep70-21swapper/706:57:337
239449523524,8sleep60-21swapper/607:00:136
239458823221,8sleep40-21swapper/407:01:314
2394918993026,3cyclictest2543120-21kworker/u16:4+flush-8:008:42:556
2394920992928,0cyclictest0-21swapper/709:57:547
2394914992927,2cyclictest2739889-21kworker/u16:1+events_unbound10:02:515
2394914992725,2cyclictest2486562-21kworker/u16:3+flush-8:007:47:295
2394914992724,2cyclictest3858775-21kworker/u16:0+flush-8:007:12:385
2394914992624,2cyclictest2593887-21kworker/u16:1+events_unbound09:17:425
2394918992422,2cyclictest3012136-21kworker/u16:2+events_unbound12:27:576
2394914992422,2cyclictest2944793-21kworker/u16:2+events_unbound11:57:415
2394914992422,2cyclictest2886679-21kworker/u16:3+flush-8:012:07:285
2394912992421,2cyclictest2543120-21kworker/u16:4+events_unbound08:27:424
2394920992322,0cyclictest0-21swapper/709:41:367
2394914992321,2cyclictest2886679-21kworker/u16:3+flush-8:011:22:585
2394912992321,2cyclictest2673516-21kworker/u16:2+flush-8:009:32:594
2394918992218,3cyclictest2543120-21kworker/u16:4+flush-8:008:52:296
2394912992219,2cyclictest2575383-21kworker/u16:0+flush-8:008:42:294
2394912992217,4cyclictest2720691-21latency_hist09:47:284
2394920992120,0cyclictest0-21swapper/707:41:017
2394920992119,1cyclictest0-21swapper/707:02:307
2394914992119,2cyclictest2856868-21kworker/u16:2+events_unbound11:02:545
2394914992119,2cyclictest2673516-21kworker/u16:2+events_unbound09:32:415
2394914992119,2cyclictest2575383-21kworker/u16:0+events_unbound08:37:425
2394914992119,2cyclictest2437543-21kworker/u16:0+events_unbound07:32:535
2394914992119,2cyclictest2404650-21kworker/u16:2+events_unbound08:18:025
2394914992119,2cyclictest2404650-21kworker/u16:2+events_unbound08:18:025
2394914992118,3cyclictest2631928-21kworker/u16:2+events_unbound09:07:545
2394912992118,2cyclictest2404650-21kworker/u16:2+flush-8:008:22:244
2394912992118,2cyclictest2404650-21kworker/u16:2+flush-8:008:22:244
2394920992019,0cyclictest0-21swapper/711:07:407
239492099200,18cyclictest0-21swapper/710:52:547
2394918992017,2cyclictest2631928-21kworker/u16:2+flush-8:009:07:506
2394914992018,2cyclictest2404650-21kworker/u16:2+flush-8:007:47:575
2394912992018,1cyclictest0-21swapper/412:28:574
2394920991918,0cyclictest0-21swapper/712:12:527
2394920991918,0cyclictest0-21swapper/707:27:297
2394920991917,1cyclictest0-21swapper/711:17:467
2394914991917,2cyclictest2779568-21kworker/u16:1+events_unbound10:45:395
2394914991917,2cyclictest2673516-21kworker/u16:2+flush-8:010:12:575
2394914991917,2cyclictest2546309-21kworker/u16:5+events_unbound08:22:535
2394914991917,2cyclictest2486562-21kworker/u16:3+events_unbound08:12:575
2394912991917,2cyclictest2739889-21kworker/u16:1+flush-8:010:02:574
239492099184,6cyclictest0-21swapper/709:16:307
2394920991817,0cyclictest0-21swapper/708:32:537
2394920991817,0cyclictest0-21swapper/707:37:297
2394920991816,1cyclictest0-21swapper/710:03:027
2394918991815,2cyclictest2856893-21kworker/u16:4+flush-8:011:12:456
2394918991815,2cyclictest2673516-21kworker/u16:2+events_unbound09:37:466
2394918991815,2cyclictest2466756-21kworker/u16:1+flush-8:007:57:296
2394914991816,2cyclictest2739889-21kworker/u16:1+events_unbound10:07:405
2394914991816,2cyclictest2739889-21kworker/u16:1+events_unbound09:57:565
2394914991816,2cyclictest2710674-21kworker/u16:0+events_unbound09:47:505
2394914991816,2cyclictest2631928-21kworker/u16:2+flush-8:009:12:595
2394914991816,2cyclictest2593887-21kworker/u16:1+events_unbound08:57:525
2394912991816,2cyclictest3858775-21kworker/u16:0+events_unbound07:07:444
2394912991816,2cyclictest2631928-21kworker/u16:2+flush-8:009:12:444
2394912991816,2cyclictest2543120-21kworker/u16:4+events_unbound09:07:444
2394912991815,2cyclictest2437543-21kworker/u16:0+flush-8:007:37:534
239492099174,6cyclictest0-21swapper/711:42:177
239492099174,5cyclictest0-21swapper/711:12:377
2394918991715,2cyclictest3012136-21kworker/u16:2+flush-8:012:17:566
239491499179,8cyclictest0-21swapper/512:17:335
2394914991715,2cyclictest3032483-21kworker/u16:4+events_unbound12:26:025
2394914991715,2cyclictest3032483-21kworker/u16:4+events_unbound12:26:025
2394914991715,2cyclictest2934950-21kworker/u16:1+flush-8:011:43:385
2394914991715,2cyclictest2641672-21kworker/u16:3+events_unbound09:03:575
2394914991715,2cyclictest2404650-21kworker/u16:2+events_unbound07:39:045
2394914991715,2cyclictest2394431-21kworker/u16:1+flush-8:007:04:535
2394912991716,1cyclictest0-21swapper/408:03:374
2394912991715,2cyclictest2673516-21kworker/u16:2+events_unbound10:27:404
2394912991713,3cyclictest2437543-21kworker/u16:0+flush-8:007:42:474
239492099167,8cyclictest0-21swapper/712:04:397
239492099163,6cyclictest0-21swapper/709:51:527
239492099163,5cyclictest0-21swapper/710:51:247
2394920991615,0cyclictest0-21swapper/712:17:597
2394920991615,0cyclictest0-21swapper/711:53:377
2394920991614,1cyclictest0-21swapper/712:22:437
2394920991614,1cyclictest0-21swapper/712:22:437
2394920991614,1cyclictest0-21swapper/710:27:507
2394918991613,2cyclictest2856893-21kworker/u16:4+flush-8:011:32:506
2394918991612,3cyclictest2673516-21kworker/u16:2+flush-8:010:12:546
2394914991614,2cyclictest3032483-21kworker/u16:4+flush-8:012:27:445
2394914991614,2cyclictest2983947-21kworker/u16:0+flush-8:012:17:285
2394914991614,2cyclictest2983947-21kworker/u16:0+events_unbound12:12:155
2394914991614,2cyclictest2856893-21kworker/u16:4+events_unbound11:12:375
2394914991614,2cyclictest2856893-21kworker/u16:4+events_unbound10:57:595
2394914991614,2cyclictest2543120-21kworker/u16:4+events_unbound08:51:315
2394914991614,2cyclictest2486562-21kworker/u16:3+events_unbound08:11:255
2394914991614,2cyclictest2466756-21kworker/u16:1+events_unbound07:56:595
2394914991613,2cyclictest2886679-21kworker/u16:3+events_unbound11:47:495
2394912991614,2cyclictest3858775-21kworker/u16:0+flush-8:007:02:584
2394912991614,2cyclictest2934950-21kworker/u16:1+events_unbound12:02:524
2394912991614,2cyclictest2641672-21kworker/u16:3+events_unbound09:27:504
2394912991614,2cyclictest2486562-21kworker/u16:3+flush-8:007:57:544
2394912991614,2cyclictest2404650-21kworker/u16:2+events_unbound07:17:544
2394912991612,4cyclictest0-21swapper/407:33:454
2394912991612,3cyclictest2543120-21kworker/u16:4+flush-8:008:57:554
239492099153,5cyclictest0-21swapper/707:08:327
2394920991514,0cyclictest0-21swapper/710:12:517
2394920991514,0cyclictest0-21swapper/708:29:027
2394920991513,1cyclictest0-21swapper/712:02:287
2394920991513,1cyclictest0-21swapper/711:44:017
2394920991513,1cyclictest0-21swapper/709:42:537
2394920991513,1cyclictest0-21swapper/707:57:587
239492099150,14cyclictest0-21swapper/708:21:317
239492099150,14cyclictest0-21swapper/708:21:317
2394918991513,2cyclictest3858775-21kworker/u16:0+events_unbound07:02:576
2394918991513,2cyclictest2779568-21kworker/u16:1+events_unbound10:47:466
2394918991511,3cyclictest2934950-21kworker/u16:1+flush-8:012:02:496
239491899150,15cyclictest0-21swapper/609:22:556
2394914991513,2cyclictest2934950-21kworker/u16:1+events_unbound11:55:345
2394914991513,2cyclictest2856893-21kworker/u16:4+flush-8:011:32:525
2394914991513,2cyclictest2543120-21kworker/u16:4+events_unbound08:42:495
2394914991513,2cyclictest2543120-21kworker/u16:4+events_unbound08:32:475
2394914991513,2cyclictest2486562-21kworker/u16:3+events_unbound08:04:015
2394914991513,2cyclictest2437543-21kworker/u16:0+events_unbound07:26:225
239491499150,1cyclictest0-21swapper/507:07:565
2394912991513,2cyclictest2906348-21kworker/u16:0+flush-8:011:32:434
2394912991513,2cyclictest2673516-21kworker/u16:2+flush-8:009:47:544
2394912991513,2cyclictest2496469-21kworker/u16:4+flush-8:007:52:584
2394912991512,2cyclictest3012136-21kworker/u16:2+flush-8:012:22:594
2394912991512,2cyclictest3012136-21kworker/u16:2+flush-8:012:22:594
2394912991512,2cyclictest2769256-21kworker/u16:0+events_unbound10:47:514
239492099146,7cyclictest0-21swapper/707:25:217
239492099145,8cyclictest0-21swapper/708:09:467
239492099141,5cyclictest0-21swapper/711:24:437
2394920991413,0cyclictest0-21swapper/711:02:377
2394920991413,0cyclictest0-21swapper/710:17:307
2394920991413,0cyclictest0-21swapper/710:17:307
2394920991413,0cyclictest0-21swapper/710:10:017
2394920991413,0cyclictest0-21swapper/707:17:517
2394920991411,2cyclictest0-21swapper/709:04:247
239492099140,12cyclictest0-21swapper/710:46:097
239492099140,12cyclictest0-21swapper/708:25:047
2394918991413,1cyclictest0-21swapper/609:47:406
2394918991411,2cyclictest1135-21snmpd10:53:276
2394918991410,3cyclictest2543120-21kworker/u16:4+flush-8:008:53:006
2394914991412,2cyclictest2856893-21kworker/u16:4+events_unbound11:10:455
2394914991412,2cyclictest2779568-21kworker/u16:1+events_unbound10:38:155
2394914991412,2cyclictest2779568-21kworker/u16:1+events_unbound10:35:375
2394914991412,2cyclictest2769256-21kworker/u16:0+flush-8:010:47:445
2394914991412,2cyclictest2769256-21kworker/u16:0+events_unbound10:52:295
2394914991412,2cyclictest2641672-21kworker/u16:3+events_unbound09:30:555
2394914991412,2cyclictest2641672-21kworker/u16:3+events_unbound09:22:515
2394914991412,2cyclictest2543120-21kworker/u16:4+flush-8:008:52:595
2394914991412,2cyclictest2486562-21kworker/u16:3+events_unbound07:59:005
239491299146,8cyclictest0-21swapper/412:10:544
239491299145,9cyclictest0-21swapper/407:50:214
2394912991413,1cyclictest0-21swapper/408:12:534
2394912991412,2cyclictest2934950-21kworker/u16:1+flush-8:011:47:544
2394912991412,2cyclictest2543120-21kworker/u16:4+flush-8:008:33:004
2394912991411,2cyclictest2983947-21kworker/u16:0+flush-8:012:12:544
2394912991411,2cyclictest2913286-21kthreadcore11:22:494
239491299140,6cyclictest0-21swapper/410:24:114
239491299140,6cyclictest0-21swapper/410:24:114
239492099134,8cyclictest0-21swapper/707:17:157
2394920991312,0cyclictest0-21swapper/708:57:487
2394920991312,0cyclictest0-21swapper/708:48:007
2394920991311,1cyclictest0-21swapper/708:03:007
2394920991310,2cyclictest0-21swapper/707:47:537
2394920991310,2cyclictest0-21swapper/707:43:127
239492099130,1cyclictest0-21swapper/711:27:517
239491899138,4cyclictest2575476-21cat08:32:476
239491899136,7cyclictest0-21swapper/611:38:146
239491899134,8cyclictest0-21swapper/609:43:556
2394918991312,1cyclictest0-21swapper/608:28:416
2394918991311,2cyclictest2906348-21kworker/u16:0+events_unbound11:22:416
2394918991311,2cyclictest2739889-21kworker/u16:1+events_unbound10:02:536
2394918991310,2cyclictest2886679-21kworker/u16:3+flush-8:011:18:006
2394914991311,2cyclictest2886679-21kworker/u16:3+events_unbound11:38:095
2394914991311,2cyclictest2739889-21kworker/u16:1+events_unbound09:55:135
2394914991311,2cyclictest2673516-21kworker/u16:2+events_unbound10:29:415
2394914991311,2cyclictest2673516-21kworker/u16:2+events_unbound10:24:465
2394914991311,2cyclictest2673516-21kworker/u16:2+events_unbound10:24:465
2394914991311,2cyclictest2543120-21kworker/u16:4+events_unbound08:32:085
2394914991311,2cyclictest2437995-21kworker/u16:4+events_unbound07:32:025
2394914991311,2cyclictest2437543-21kworker/u16:0+events_unbound07:20:215
2394912991311,2cyclictest2856893-21kworker/u16:4+events_unbound10:57:574
2394912991311,2cyclictest2593887-21kworker/u16:1+events_unbound08:43:014
2394912991310,2cyclictest2739889-21kworker/u16:1+flush-8:010:07:594
239492099129,2cyclictest0-21swapper/710:32:577
2394920991211,0cyclictest0-21swapper/708:55:517
2394920991211,0cyclictest0-21swapper/708:37:447
2394920991210,1cyclictest0-21swapper/710:22:517
2394920991210,1cyclictest0-21swapper/710:22:517
239492099120,11cyclictest0-21swapper/708:42:387
239492099120,10cyclictest0-21swapper/710:40:337
239492099120,10cyclictest0-21swapper/709:27:517
2394918991211,1cyclictest0-21swapper/608:17:586
2394918991211,1cyclictest0-21swapper/608:17:586
2394918991210,2cyclictest2906348-21kworker/u16:0+flush-8:011:32:286
2394918991210,2cyclictest2543120-21kworker/u16:4+events_unbound09:02:476
2394918991210,2cyclictest2437543-21kworker/u16:0+flush-8:007:37:496
239491899120,1cyclictest0-21swapper/608:09:366
239491899120,12cyclictest0-21swapper/610:26:466
239491899120,12cyclictest0-21swapper/610:26:466
239491899120,11cyclictest0-21swapper/611:57:346
2394914991210,2cyclictest2856893-21kworker/u16:4+events_unbound11:28:505
2394914991210,2cyclictest2856868-21kworker/u16:2+events_unbound11:19:195
2394914991210,2cyclictest2779568-21kworker/u16:1+events_unbound10:22:045
2394914991210,2cyclictest2779568-21kworker/u16:1+events_unbound10:22:045
2394914991210,2cyclictest2710810-21kworker/u16:4+events_unbound09:45:195
239491299129,2cyclictest2641672-21kworker/u16:3+flush-8:009:17:554
239491299128,3cyclictest2419499-21cat07:12:414
2394912991210,2cyclictest2944793-21kworker/u16:2+flush-8:011:42:434
2394912991210,2cyclictest2934950-21kworker/u16:1+events_unbound11:57:454
2394912991210,2cyclictest2886679-21kworker/u16:3+flush-8:011:52:594
2394912991210,2cyclictest2886679-21kworker/u16:3+flush-8:011:38:014
2394912991210,2cyclictest2886679-21kworker/u16:3+events_unbound11:27:554
2394912991210,2cyclictest2641672-21kworker/u16:3+flush-8:009:03:034
2394912991210,2cyclictest2404650-21kworker/u16:2+flush-8:007:27:534
2394912991210,1cyclictest0-21swapper/410:53:544
239491299120,1cyclictest0-21swapper/409:23:314
239491299120,12cyclictest0-21swapper/408:48:404
239491299120,12cyclictest0-21swapper/407:25:454
2394920991110,0cyclictest0-21swapper/712:31:597
2394920991110,0cyclictest0-21swapper/708:12:587
239491899119,2cyclictest2886679-21kworker/u16:3+flush-8:011:52:516
239491899119,2cyclictest2673516-21kworker/u16:2+flush-8:010:32:536
239491899119,2cyclictest2641672-21kworker/u16:3+events_unbound09:27:466
239491899119,2cyclictest2404650-21kworker/u16:2+flush-8:008:22:446
239491899119,2cyclictest2404650-21kworker/u16:2+flush-8:008:02:476
239491899119,2cyclictest2404650-21kworker/u16:2+flush-8:007:12:566
239491899119,1cyclictest0-21swapper/609:32:586
239491899118,2cyclictest2543120-21kworker/u16:4+flush-8:008:38:006
239491899117,3cyclictest2458531-21cat07:32:436
239491899114,7cyclictest0-21swapper/608:13:436
2394918991110,1cyclictest0-21swapper/612:27:136
2394918991110,1cyclictest0-21swapper/612:27:136
2394918991110,1cyclictest0-21swapper/611:04:556
2394918991110,1cyclictest0-21swapper/609:13:376
2394918991110,1cyclictest0-21swapper/607:24:506
2394918991110,1cyclictest0-21swapper/607:12:136
239491899110,3cyclictest2512062-21grep07:57:486
239491899110,11cyclictest0-21swapper/609:57:276
239491899110,11cyclictest0-21swapper/607:51:576
239491299119,2cyclictest2673516-21kworker/u16:2+flush-8:009:37:494
239491299118,2cyclictest1135-21snmpd12:21:214
239491299118,2cyclictest1135-21snmpd11:21:464
239491299118,2cyclictest1135-21snmpd09:58:354
239491299116,4cyclictest2819564-21ps10:37:454
2394912991110,1cyclictest0-21swapper/410:18:474
2394912991110,1cyclictest0-21swapper/410:18:474
2394912991110,1cyclictest0-21swapper/408:57:014
2394912991110,1cyclictest0-21swapper/408:24:044
239491299110,11cyclictest0-21swapper/411:13:054
239492099109,0cyclictest0-21swapper/711:33:087
239492099109,0cyclictest0-21swapper/709:52:537
239492099109,0cyclictest0-21swapper/709:32:497
239492099100,8cyclictest0-21swapper/709:22:427
239492099100,2cyclictest0-21swapper/711:47:477
239491899109,1cyclictest0-21swapper/612:12:246
239491899109,1cyclictest0-21swapper/611:43:046
239491899108,2cyclictest86-21ksoftirqd/610:27:406
239491899108,2cyclictest2779568-21kworker/u16:1+flush-8:011:07:396
239491899108,2cyclictest2739889-21kworker/u16:1+events_unbound10:07:596
239491899108,2cyclictest2427179-21kworker/u16:3+events_unbound07:17:446
239491899107,2cyclictest1135-21snmpd11:49:446
239491899106,3cyclictest2626092-21kthreadcore08:57:476
239491899106,3cyclictest2484722-21kthreadcore07:42:486
239491899100,9cyclictest2866002-21ntpq10:57:546
239491899100,5cyclictest0-21swapper/607:30:426
239491299108,2cyclictest2673516-21kworker/u16:2+events_unbound10:47:014
239491299106,3cyclictest2809614-21cat10:32:424
239491299102,7cyclictest0-21swapper/408:11:404
23949209998,0cyclictest0-21swapper/712:07:537
23949209998,0cyclictest0-21swapper/709:07:387
23949209990,7cyclictest0-21swapper/709:17:427
23949189996,2cyclictest2818557-21/usr/sbin/munin10:37:446
23949189996,1cyclictest0-21swapper/609:57:386
23949189995,3cyclictest2780350-21cat10:17:456
23949189995,3cyclictest2780350-21cat10:17:456
23949189990,8cyclictest2828319-21/usr/sbin/munin10:42:426
23949129997,2cyclictest2779568-21kworker/u16:1+events_unbound11:07:494
23949129996,2cyclictest1135-21snmpd11:02:494
23949129996,2cyclictest1135-21snmpd09:55:234
23949129996,2cyclictest0-21swapper/410:12:454
23949209981,6cyclictest0-21swapper/707:52:507
23949209980,7cyclictest0-21swapper/710:57:477
23949189986,2cyclictest2641672-21kworker/u16:3+flush-8:009:17:586
23949189983,4cyclictest3004845-21sed12:12:436
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional