You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-04-22 - 08:46
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot2.osadl.org (updated Tue Apr 22, 2025 00:43:35)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
178270825442,8sleep40-21swapper/403:37:344
178270925343,7sleep50-21swapper/503:37:355
17733152449,30sleep70-21swapper/703:32:567
178263623928,8sleep60-21swapper/603:36:326
1783037993531,3cyclictest2345973-21updatedb09:02:475
1783037993229,2cyclictest1792902-21kworker/u16:4+events_unbound04:12:545
1783042993130,0cyclictest0-21swapper/707:58:067
1783041993129,2cyclictest2025678-21kworker/u16:4+flush-8:005:50:036
1783041993129,2cyclictest1974092-21kworker/u16:2+events_unbound07:22:266
1783041993028,2cyclictest2239457-21kworker/u16:1+flush-8:007:58:096
1783037993028,2cyclictest2143411-21kworker/u16:0+flush-8:007:02:515
1783033993026,3cyclictest1974092-21kworker/u16:2+flush-8:006:58:024
23322682290,0chrt0-21swapper/408:48:134
1783042992928,0cyclictest0-21swapper/708:28:067
1783042992928,0cyclictest0-21swapper/708:28:067
1783042992928,0cyclictest0-21swapper/704:58:077
1783041992927,2cyclictest2047336-21kworker/u16:5+flush-8:006:07:536
1783041992927,2cyclictest1792902-21kworker/u16:4+flush-8:003:45:586
1783041992927,2cyclictest1792902-21kworker/u16:4+flush-8:003:45:586
1783041992926,2cyclictest2335706-21kworker/u16:4+flush-8:009:03:016
1783041992926,2cyclictest1974092-21kworker/u16:2+flush-8:006:45:516
1783041992926,2cyclictest1974092-21kworker/u16:2+flush-8:006:42:476
1783041992926,2cyclictest1844100-21kworker/u16:2+flush-8:004:13:276
1783041992926,2cyclictest1792902-21kworker/u16:4+events_unbound03:59:406
1783041992826,2cyclictest2293012-21kworker/u16:0+events_unbound08:30:506
1783041992826,2cyclictest2293012-21kworker/u16:0+events_unbound08:30:506
1783041992826,2cyclictest2197040-21kworker/u16:3+flush-8:008:07:256
1783041992826,2cyclictest2196211-21kworker/u16:1+events_unbound07:40:266
1783041992826,2cyclictest1974092-21kworker/u16:2+flush-8:007:29:026
1783041992826,2cyclictest1974092-21kworker/u16:2+flush-8:006:21:276
1783037992725,2cyclictest2197040-21kworker/u16:3+flush-8:007:37:515
1783037992725,2cyclictest2131358-21kworker/u16:4+flush-8:008:23:185
1783037992725,2cyclictest1994057-21kworker/u16:0+events_unbound05:38:225
1783041992624,2cyclictest2293012-21kworker/u16:0+events_unbound09:00:016
1783041992624,2cyclictest2143411-21kworker/u16:0+flush-8:007:01:026
1783041992624,2cyclictest1857855-21kworker/u16:5+events_unbound04:46:036
1783041992623,2cyclictest2131358-21kworker/u16:4+flush-8:008:19:026
1783037992624,2cyclictest1882231-21kworker/u16:1+flush-8:005:03:185
1783041992523,2cyclictest2143411-21kworker/u16:0+events_unbound07:12:516
1783041992523,2cyclictest1974092-21kworker/u16:2+flush-8:007:43:176
178304299240,23cyclictest2078510-21latency_hist06:12:517
1783041992422,2cyclictest1850595-21kworker/u16:3+events_unbound05:00:276
1783041992422,2cyclictest1850595-21kworker/u16:3+events_unbound04:49:586
1783041992421,2cyclictest1932246-21kworker/u16:0+events_unbound04:53:156
1783037992422,2cyclictest2131358-21kworker/u16:4+flush-8:007:23:075
178304299230,22cyclictest2068254-21latency_hist06:07:517
1783041992321,2cyclictest2131358-21kworker/u16:4+events_unbound08:39:026
1783041992321,2cyclictest2025020-21kworker/u16:3+flush-8:006:25:026
1783041992321,2cyclictest1882231-21kworker/u16:1+flush-8:005:20:316
1783041992321,2cyclictest1882231-21kworker/u16:1+flush-8:005:20:316
1783041992320,2cyclictest2131358-21kworker/u16:4+events_unbound08:35:276
1783041992320,2cyclictest1860441-21kworker/u16:0+events_unbound04:27:596
1783037992321,2cyclictest1037237-21kworker/u16:7+events_unbound03:38:165
1783037992319,3cyclictest2111355-21kworker/u16:5+events_unbound06:48:045
1783042992221,0cyclictest0-21swapper/708:42:097
1783042992221,0cyclictest0-21swapper/708:10:227
1783042992221,0cyclictest0-21swapper/708:10:227
1783041992220,2cyclictest2239457-21kworker/u16:1+events_unbound07:55:516
1783041992220,2cyclictest2047336-21kworker/u16:5+events_unbound06:01:276
1783041992219,2cyclictest1850595-21kworker/u16:3+events_unbound04:38:266
1783041992219,2cyclictest1037237-21kworker/u16:7+events_unbound03:39:036
1783037992219,3cyclictest1850595-21kworker/u16:3+events_unbound04:08:185
1783037992219,2cyclictest1857855-21kworker/u16:5+flush-8:004:43:125
1783042992120,0cyclictest0-21swapper/706:23:587
1783042992119,1cyclictest0-21swapper/704:23:227
1783042992118,2cyclictest2164398-21/usr/sbin/munin07:07:517
178304299210,19cyclictest2335316-21exim408:52:527
1783041992119,2cyclictest1994057-21kworker/u16:0+events_unbound05:40:276
1783041992119,2cyclictest1974104-21kworker/u16:4+flush-8:005:28:076
1783041992119,2cyclictest1850595-21kworker/u16:3+flush-8:004:27:276
1783041992119,2cyclictest1827789-21kworker/u16:1+events_unbound04:05:286
1783041992118,2cyclictest2025678-21kworker/u16:4+events_unbound05:55:596
1783037992119,2cyclictest2047336-21kworker/u16:5+flush-8:006:07:465
1783042992019,0cyclictest0-21swapper/708:44:347
1783042992019,0cyclictest0-21swapper/708:35:297
1783042992019,0cyclictest0-21swapper/706:52:067
1783042992019,0cyclictest0-21swapper/703:44:227
1783042992019,0cyclictest0-21swapper/703:44:227
1783042992018,1cyclictest2111720-21systemd-run06:37:527
178304299200,18cyclictest2239647-21latency_hist07:57:517
178304299200,18cyclictest2175762-21latency_hist07:17:527
1783042991918,0cyclictest0-21swapper/705:29:307
1783042991916,2cyclictest2015650-21munin-run05:37:527
178304299190,17cyclictest2217993-21latency_hist07:42:517
1783041991917,2cyclictest2334265-21kworker/u16:1+flush-8:008:49:356
1783041991917,2cyclictest2197040-21kworker/u16:3+flush-8:007:49:306
1783041991917,2cyclictest1974092-21kworker/u16:2+flush-8:007:14:006
1783041991917,2cyclictest1882231-21kworker/u16:1+flush-8:004:33:186
1783041991917,2cyclictest1882231-21kworker/u16:1+events_unbound05:26:286
1783041991916,2cyclictest2111355-21kworker/u16:5+events_unbound06:53:156
1783041991916,2cyclictest2111355-21kworker/u16:5+events_unbound06:53:156
1783041991916,2cyclictest2047336-21kworker/u16:5+events_unbound06:02:556
1783041991916,2cyclictest1782456-21kworker/u16:0+events_unbound03:47:556
1783037991917,2cyclictest2143411-21kworker/u16:0+events_unbound07:22:475
1783037991917,2cyclictest2047336-21kworker/u16:5+flush-8:006:02:515
1783037991917,2cyclictest2025020-21kworker/u16:3+flush-8:006:18:305
1783037991917,2cyclictest1857855-21kworker/u16:5+events_unbound05:08:105
178304299180,17cyclictest2036296-21latency_hist05:47:527
1783041991816,2cyclictest2335374-21kworker/u16:2+flush-8:008:54:016
1783041991816,2cyclictest2111355-21kworker/u16:5+flush-8:007:04:016
1783041991816,2cyclictest2079242-21kworker/u16:0+events_unbound06:31:316
1783041991816,2cyclictest2025020-21kworker/u16:3+events_unbound06:14:276
1783042991716,0cyclictest0-21swapper/707:24:057
1783042991716,0cyclictest0-21swapper/706:46:187
1783042991716,0cyclictest0-21swapper/704:21:287
178304299170,1cyclictest0-21swapper/704:43:177
178304299170,16cyclictest1313-21snmpd04:41:207
1783041991715,2cyclictest2281606-21kworker/u16:3+flush-8:008:46:306
1783041991715,2cyclictest1974092-21kworker/u16:2+events_unbound07:27:236
1783041991714,3cyclictest1850595-21kworker/u16:3+flush-8:004:20:066
1783041991714,2cyclictest2025020-21kworker/u16:3+events_unbound06:34:026
1783037991715,2cyclictest1850595-21kworker/u16:3+flush-8:004:38:235
1783042991616,0cyclictest0-21swapper/704:28:047
1783042991615,0cyclictest0-21swapper/705:59:227
1783042991615,0cyclictest0-21swapper/703:50:377
178304299160,15cyclictest2281939-21latency_hist08:22:517
178304299160,15cyclictest1973348-21latency_hist05:12:517
1783041991614,2cyclictest2025678-21kworker/u16:4+events_unbound05:43:276
1783041991614,1cyclictest0-21swapper/606:48:056
1783041991613,2cyclictest2197040-21kworker/u16:3+events_unbound07:33:526
1783037991614,2cyclictest2131358-21kworker/u16:4+flush-8:008:48:075
1783037991614,2cyclictest1857855-21kworker/u16:5+events_unbound04:28:125
178303399160,1cyclictest0-21swapper/409:03:164
178303399160,1cyclictest0-21swapper/408:55:054
178303399160,1cyclictest0-21swapper/408:46:534
178303399160,1cyclictest0-21swapper/408:39:434
178303399160,1cyclictest0-21swapper/408:30:304
178303399160,1cyclictest0-21swapper/408:30:304
178303399160,1cyclictest0-21swapper/408:23:204
178303399160,1cyclictest0-21swapper/408:22:194
178303399160,1cyclictest0-21swapper/408:14:074
178303399160,1cyclictest0-21swapper/408:07:594
178303399160,1cyclictest0-21swapper/408:07:594
178303399160,1cyclictest0-21swapper/408:06:574
178303399160,1cyclictest0-21swapper/407:59:474
178303399160,1cyclictest0-21swapper/407:49:334
178303399160,1cyclictest0-21swapper/407:43:244
178303399160,1cyclictest0-21swapper/407:41:214
178303399160,1cyclictest0-21swapper/407:34:114
178303399160,1cyclictest0-21swapper/407:28:034
178303399160,1cyclictest0-21swapper/407:24:584
178303399160,1cyclictest0-21swapper/407:16:474
178303399160,1cyclictest0-21swapper/407:09:374
178303399160,1cyclictest0-21swapper/406:54:154
178303399160,1cyclictest0-21swapper/406:54:154
178303399160,1cyclictest0-21swapper/406:52:124
178303399160,1cyclictest0-21swapper/406:44:014
178303399160,1cyclictest0-21swapper/406:38:544
178303399160,1cyclictest0-21swapper/406:36:514
178303399160,1cyclictest0-21swapper/406:28:394
178303399160,1cyclictest0-21swapper/406:27:384
178303399160,1cyclictest0-21swapper/406:19:264
178303399160,1cyclictest0-21swapper/406:14:194
178303399160,1cyclictest0-21swapper/406:11:154
178303399160,1cyclictest0-21swapper/405:57:564
178303399160,1cyclictest0-21swapper/405:54:524
178303399160,1cyclictest0-21swapper/405:49:454
178303399160,1cyclictest0-21swapper/405:46:404
178303399160,1cyclictest0-21swapper/405:38:294
178303399160,1cyclictest0-21swapper/405:30:174
178303399160,1cyclictest0-21swapper/405:23:074
178303399160,1cyclictest0-21swapper/405:15:574
178303399160,1cyclictest0-21swapper/405:05:434
178303399160,1cyclictest0-21swapper/404:59:344
178303399160,1cyclictest0-21swapper/404:49:204
178303399160,1cyclictest0-21swapper/404:44:134
178303399160,1cyclictest0-21swapper/404:41:084
178303399160,1cyclictest0-21swapper/404:32:574
178303399160,1cyclictest0-21swapper/404:27:504
178303399160,1cyclictest0-21swapper/404:18:374
178303399160,1cyclictest0-21swapper/404:16:344
178303399160,1cyclictest0-21swapper/404:09:244
178303399160,1cyclictest0-21swapper/404:01:124
178303399160,1cyclictest0-21swapper/403:53:014
178303399160,1cyclictest0-21swapper/403:51:594
178303399160,1cyclictest0-21swapper/403:45:514
178303399160,1cyclictest0-21swapper/403:45:514
1783042991515,0cyclictest0-21swapper/705:16:307
1783042991514,0cyclictest0-21swapper/706:41:537
1783042991514,0cyclictest0-21swapper/704:14:137
1783041991513,2cyclictest1857855-21kworker/u16:5+events_unbound05:09:586
1783041991513,2cyclictest1850595-21kworker/u16:3+flush-8:005:16:366
1783041991513,2cyclictest1792902-21kworker/u16:4+events_unbound03:54:106
1783041991513,1cyclictest1857855-21kworker/u16:5+events_unbound05:07:516
1783037991513,2cyclictest2121724-21kworker/u16:1+events_unbound06:43:215
1783037991513,2cyclictest1782456-21kworker/u16:0+events_unbound03:48:185
1783037991512,2cyclictest1850595-21kworker/u16:3+flush-8:004:32:545
178303399150,1cyclictest0-21swapper/405:22:064
178303399150,1cyclictest0-21swapper/405:22:064
178303399150,1cyclictest0-21swapper/405:08:474
178304299147,6cyclictest27763-21gvfs-afc-volume05:18:137
178304299147,6cyclictest27763-21gvfs-afc-volume05:18:137
178304299147,6cyclictest27177-21gmain07:43:177
1783042991413,0cyclictest0-21swapper/707:33:097
1783042991413,0cyclictest0-21swapper/706:18:017
1783042991412,1cyclictest1859114-21latency_hist04:12:527
1783042991412,1cyclictest0-21swapper/703:38:177
178304299140,13cyclictest1313-21snmpd04:01:377
1783041991412,2cyclictest2261663-21kworker/u16:1+events_unbound08:26:066
1783037991412,2cyclictest1792902-21kworker/u16:4+flush-8:003:43:105
1783037991412,2cyclictest1792902-21kworker/u16:4+flush-8:003:43:105
1783033991411,2cyclictest2269593-21kworker/u16:5+flush-8:008:33:214
178303399140,1cyclictest0-21swapper/408:58:094
178303399140,1cyclictest0-21swapper/407:18:504
178303399140,1cyclictest0-21swapper/407:03:284
178303399140,1cyclictest0-21swapper/403:38:414
178304299138,4cyclictest27763-21gvfs-afc-volume08:48:057
1783042991313,0cyclictest0-21swapper/708:17:287
1783042991313,0cyclictest0-21swapper/704:05:427
1783042991312,0cyclictest0-21swapper/709:03:127
1783042991312,0cyclictest0-21swapper/707:30:297
1783042991312,0cyclictest0-21swapper/705:40:417
1783042991312,0cyclictest0-21swapper/705:27:267
178304299130,4cyclictest2250864-21tr08:03:047
1783041991312,1cyclictest0-21swapper/608:08:206
1783041991312,1cyclictest0-21swapper/608:08:206
1783041991311,2cyclictest1850595-21kworker/u16:3+events_unbound04:10:156
1783037991311,2cyclictest2197040-21kworker/u16:3+flush-8:007:58:185
1783037991311,2cyclictest2197040-21kworker/u16:3+events_unbound07:38:195
178303399130,1cyclictest0-21swapper/406:05:064
178303399130,1cyclictest0-21swapper/404:57:314
178304299126,5cyclictest27904-21gmain05:03:147
1783042991212,0cyclictest0-21swapper/706:16:177
1783042991211,0cyclictest0-21swapper/707:22:497
1783042991211,0cyclictest0-21swapper/706:57:537
1783042991211,0cyclictest0-21swapper/706:55:337
1783042991211,0cyclictest0-21swapper/706:55:337
1783042991211,0cyclictest0-21swapper/705:57:177
178304299120,11cyclictest1313-21snmpd04:51:057
1783041991210,2cyclictest2249655-21kworker/u16:2+events_unbound08:15:576
1783041991210,2cyclictest1994057-21kworker/u16:0+flush-8:005:35:226
1783037991211,1cyclictest0-21swapper/507:28:185
1783037991210,2cyclictest2025020-21kworker/u16:3+flush-8:005:48:515
178303799120,1cyclictest0-21swapper/506:37:325
178303799120,1cyclictest0-21swapper/505:13:025
178303799120,1cyclictest0-21swapper/503:56:065
178303799120,12cyclictest0-21swapper/508:27:535
178303799120,12cyclictest0-21swapper/508:27:535
178303799120,12cyclictest0-21swapper/504:03:215
178303799120,11cyclictest0-21swapper/508:34:305
178303399128,3cyclictest0-21swapper/405:33:134
178303399120,1cyclictest0-21swapper/404:03:154
178304299119,1cyclictest2046602-21awk05:52:517
178304299111,1cyclictest0-21swapper/706:28:067
1783042991111,0cyclictest0-21swapper/707:10:477
1783042991111,0cyclictest0-21swapper/704:37:127
178304299110,4cyclictest2238380-21sshd-session07:50:267
178304299110,1cyclictest0-21swapper/708:23:097
178304299110,10cyclictest1313-21snmpd08:59:457
178304299110,10cyclictest1313-21snmpd04:55:027
178304299110,10cyclictest1313-21snmpd03:53:037
178303799119,2cyclictest2249655-21kworker/u16:2+events_unbound08:02:535
178303799119,2cyclictest2197040-21kworker/u16:3+flush-8:007:53:175
178303799119,2cyclictest2131358-21kworker/u16:4+flush-8:008:08:075
178303799119,2cyclictest2131358-21kworker/u16:4+flush-8:008:08:075
178303799119,2cyclictest2131358-21kworker/u16:4+flush-8:007:08:245
178303799117,3cyclictest1860441-21kworker/u16:0+events_unbound04:23:175
178303799117,3cyclictest1829599-21cat03:58:105
1783037991110,1cyclictest0-21swapper/508:14:395
1783037991110,1cyclictest0-21swapper/505:55:175
178303799110,1cyclictest0-21swapper/506:32:295
178303799110,11cyclictest0-21swapper/508:22:035
178303799110,11cyclictest0-21swapper/507:03:045
178303799110,11cyclictest0-21swapper/505:45:495
178303799110,11cyclictest0-21swapper/504:20:045
1783033991110,1cyclictest0-21swapper/404:30:564
178303799109,1cyclictest0-21swapper/509:02:535
178303799109,1cyclictest0-21swapper/507:17:255
178303799109,1cyclictest0-21swapper/506:09:475
178303799109,1cyclictest0-21swapper/505:28:385
178303799109,1cyclictest0-21swapper/505:21:145
178303799109,1cyclictest0-21swapper/505:21:145
178303799100,10cyclictest0-21swapper/508:41:085
178303799100,10cyclictest0-21swapper/505:01:325
17830379998,1cyclictest0-21swapper/506:17:215
17830379998,1cyclictest0-21swapper/504:57:265
17830379995,3cyclictest2217661-21kworker/u16:0+flush-8:007:48:175
17830339998,1cyclictest0-21swapper/407:54:374
17830379987,1cyclictest0-21swapper/508:54:325
17830379987,1cyclictest0-21swapper/505:32:545
17830379987,1cyclictest0-21swapper/504:50:015
17830379986,2cyclictest1974092-21kworker/u16:2+flush-8:006:22:585
17830379984,3cyclictest2219529-21cat07:43:085
17830379975,1cyclictest0-21swapper/505:23:105
17830379973,3cyclictest2322084-21grep08:43:135
17830379973,3cyclictest2112500-21cpuspeed06:37:595
17830379950,4cyclictest2143401-21chrt06:53:085
17830379950,4cyclictest2143401-21chrt06:53:085
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional