You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-02-23 - 13:53
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackeslot2.osadl.org (updated Sun Feb 23, 2025 00:43:59)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
22281821640,2sleep30-21swapper/322:00:223
40483721130,2sleep20-21swapper/200:00:002
614712960,1sleep10-21swapper/120:00:251
25010912618,3phc2sys0-21swapper/323:42:353
4187947992513,3cyclictest235592-21kthreadcore22:10:241
4187946992516,5cyclictest4163795-21kworker/0:1+events19:20:140
25010912518,2phc2sys0-21swapper/323:54:133
4187947992414,3cyclictest448272-21/usr/sbin/munin00:30:191
4187947992411,3cyclictest0-21swapper/122:45:001
4187946992417,6cyclictest179660-21runrttasks21:32:190
4187946992416,4cyclictest458626-21kthreadcore00:35:230
4187946992416,4cyclictest192566-21kthreadcore21:40:230
25010912418,3phc2sys0-21swapper/322:14:463
25010912418,2phc2sys0-21swapper/323:55:583
25010912418,2phc2sys0-21swapper/323:45:123
25010912418,2phc2sys0-21swapper/323:15:263
25010912418,2phc2sys0-21swapper/323:13:213
25010912418,2phc2sys0-21swapper/322:32:143
25010912418,2phc2sys0-21swapper/322:20:363
25010912418,2phc2sys0-21swapper/321:42:003
25010912418,2phc2sys0-21swapper/300:13:343
25010912418,2phc2sys0-21swapper/300:03:473
25010912417,2phc2sys0-21swapper/321:59:513
25010912417,2phc2sys0-21swapper/321:49:333
25010912417,2phc2sys0-21swapper/319:45:093
25010912417,2phc2sys0-21swapper/300:38:063
418794799239,4cyclictest0-21swapper/121:55:011
4187947992320,2cyclictest177613-21latency21:30:221
4187947992312,3cyclictest0-21swapper/122:40:011
4187947992312,2cyclictest0-21swapper/121:10:001
4187947992311,3cyclictest142754-21cstates21:10:211
4187946992316,6cyclictest356814-21/usr/sbin/munin23:30:170
4187946992312,5cyclictest366246-21grep23:35:180
25010912318,3phc2sys0-21swapper/323:37:503
25010912318,3phc2sys0-21swapper/323:06:163
25010912318,3phc2sys0-21swapper/323:06:153
25010912318,3phc2sys0-21swapper/322:37:493
25010912318,3phc2sys0-21swapper/322:16:093
25010912318,3phc2sys0-21swapper/322:05:233
25010912318,3phc2sys0-21swapper/321:54:463
25010912318,3phc2sys0-21swapper/321:33:543
25010912318,3phc2sys0-21swapper/321:15:053
25010912318,3phc2sys0-21swapper/300:33:493
25010912318,3phc2sys0-21swapper/300:21:223
25010912318,3phc2sys0-21swapper/300:15:363
25010912318,3phc2sys0-21swapper/300:09:163
25010912318,3phc2sys0-21swapper/300:09:153
25010912317,2phc2sys0-21swapper/322:40:403
25010912317,2phc2sys0-21swapper/321:10:423
25010912317,2phc2sys0-21swapper/321:09:333
25010912317,2phc2sys0-21swapper/321:02:163
25010912317,2phc2sys0-21swapper/320:46:293
25010912317,2phc2sys0-21swapper/320:36:433
25010912317,2phc2sys0-21swapper/320:04:303
25010912317,2phc2sys0-21swapper/319:55:513
25010912317,2phc2sys0-21swapper/319:53:003
25010912317,2phc2sys0-21swapper/319:43:343
25010912317,2phc2sys0-21swapper/319:31:403
25010912317,2phc2sys0-21swapper/319:20:343
25010912317,2phc2sys0-21swapper/300:28:083
5586522218,2sleep20-21swapper/219:55:292
4187947992219,2cyclictest0-21swapper/119:15:031
4187947992219,2cyclictest0-21swapper/119:15:021
4187947992213,3cyclictest226673-21processes22:00:271
4187946992212,6cyclictest221130-21cron22:00:000
4187946992212,5cyclictest0-21swapper/023:00:240
418794699221,16cyclictest0-21swapper/022:27:380
38364922218,2sleep20-21swapper/223:45:022
36386922218,2sleep30-21swapper/323:32:413
35249622218,2sleep30-21swapper/323:24:353
32252722218,2sleep20-21swapper/223:05:262
32252722218,2sleep20-21swapper/223:05:262
30249522218,2sleep30-21swapper/322:52:423
29209522218,2sleep20-21swapper/222:45:382
26261222218,2sleep20-21swapper/222:27:192
25010912217,3phc2sys0-21swapper/322:58:173
25010912217,3phc2sys0-21swapper/320:56:013
25010912217,3phc2sys0-21swapper/320:43:523
25010912217,3phc2sys0-21swapper/320:22:003
25010912217,3phc2sys0-21swapper/319:37:433
25010912217,3phc2sys0-21swapper/319:26:093
25010912217,3phc2sys0-21swapper/319:15:273
25010912217,3phc2sys0-21swapper/319:14:083
25010912217,3phc2sys0-21swapper/319:14:073
24509222218,2sleep20-21swapper/222:15:242
18793322218,2sleep20-21swapper/221:36:122
18125422218,2sleep20-21swapper/221:34:452
46294522117,2sleep20-21swapper/200:35:442
45391622117,2sleep20-21swapper/200:30:322
43320722117,2sleep20-21swapper/200:16:362
42552022117,2sleep20-21swapper/200:13:322
418947922117,2sleep20-21swapper/219:10:262
418947922117,2sleep20-21swapper/219:10:252
4187947992118,2cyclictest8799-21cron21:29:591
4187947992118,2cyclictest374565-21/usr/sbin/munin23:40:001
4187947992118,2cyclictest304063-21munin-run22:54:591
4187947992118,2cyclictest1695-21dbus-daemon21:40:001
4187947992118,2cyclictest1-21systemd21:05:011
4187947992112,4cyclictest0-21swapper/100:40:021
418794699218,8cyclictest82800-21kthreadcore20:20:220
4187946992115,5cyclictest340254-21phc2sys23:15:270
4187946992113,1cyclictest178850irq/121-eno123:50:190
4187946992112,7cyclictest0-21swapper/022:15:170
4187946992111,5cyclictest0-21swapper/022:50:010
4187946992110,6cyclictest0-21swapper/022:45:010
4187946992110,6cyclictest0-21swapper/000:35:000
41104722117,2sleep20-21swapper/200:00:412
39402922117,2sleep20-21swapper/223:52:112
38291322118,2sleep20-21swapper/223:44:142
37164722117,2sleep20-21swapper/223:35:522
35038222117,2sleep20-21swapper/223:21:212
341122117,2sleep20-21swapper/219:15:222
32004822117,2sleep20-21swapper/223:02:092
31015422118,2sleep20-21swapper/222:55:402
30125522117,2sleep20-21swapper/222:50:482
28862422118,2sleep20-21swapper/222:40:462
27989422117,2sleep20-21swapper/222:36:082
27237722117,2sleep20-21swapper/222:33:252
26010022117,2sleep20-21swapper/222:23:592
25010912117,2phc2sys0-21swapper/323:25:103
25010912117,2phc2sys0-21swapper/323:01:543
25010912117,2phc2sys0-21swapper/322:46:213
25010912117,2phc2sys0-21swapper/322:25:133
25010912117,2phc2sys0-21swapper/321:35:553
25010912117,2phc2sys0-21swapper/320:50:323
2024922118,2sleep20-21swapper/219:28:242
20010122118,2sleep20-21swapper/221:45:302
19498322117,2sleep20-21swapper/221:40:262
16989822118,2sleep30-21swapper/321:26:113
16754622118,2sleep30-21swapper/321:23:083
16735422117,2sleep20-21swapper/221:22:512
11111022117,2sleep20-21swapper/220:42:272
9892922017,2sleep30-21swapper/320:31:463
9295222017,2sleep20-21swapper/220:27:192
8689622017,2sleep20-21swapper/220:21:592
7534722017,2sleep20-21swapper/220:15:092
6929422017,2sleep30-21swapper/320:10:103
6260622017,2sleep20-21swapper/220:00:392
5042822017,2sleep20-21swapper/219:52:462
4431822017,2sleep20-21swapper/219:46:442
4187948992017,1cyclictest0-21swapper/221:55:012
4187947992017,2cyclictest251991-21sh22:20:011
418794699209,7cyclictest14993-21cut19:25:170
418794699209,7cyclictest106763-21irqrtprio20:40:220
418794699209,6cyclictest0-21swapper/023:30:000
418794699201,7cyclictest274814-21awk22:35:230
4187946992017,2cyclictest46229-21kthreadcore19:50:220
4187946992017,2cyclictest397504-21irqrtprio23:55:220
4187946992017,2cyclictest184807-21kthreadcore21:35:250
4187946992017,2cyclictest145167-21kthreadcore21:10:260
4187946992016,3cyclictest137417-21kthreadcore21:05:210
4187946992014,5cyclictest255304-21kthreadcore22:20:260
4187946992013,5cyclictest159755-21latency_hist21:20:020
4187946992011,4cyclictest419398-21kthreadcore00:10:220
4187946992010,6cyclictest204190-21fschecks_time21:50:150
3834922017,2sleep20-21swapper/219:42:482
35407022017,2sleep20-21swapper/223:26:302
33528722017,2sleep20-21swapper/223:15:122
3226922017,2sleep20-21swapper/219:37:422
25010912017,2phc2sys0-21swapper/320:26:193
25010912017,2phc2sys0-21swapper/320:08:073
24236922017,2sleep20-21swapper/222:14:292
14312422017,2sleep20-21swapper/221:10:242
14152522017,2sleep20-21swapper/221:06:352
13521522017,2sleep20-21swapper/221:01:232
12923522017,2sleep20-21swapper/220:57:172
12312322017,2sleep20-21swapper/220:51:132
11720322017,2sleep20-21swapper/220:47:552
4187947991916,2cyclictest221132-21cron22:00:001
4187947991916,2cyclictest14354-21cut19:25:011
418794799190,2cyclictest141804-21diskmemload00:27:281
418794699195,5cyclictest0-21swapper/021:20:250
4187946991916,2cyclictest447959-21wc00:30:010
4187946991916,2cyclictest429849-21kthreadcore00:15:270
4187946991916,2cyclictest345707-21kthreadcore23:20:240
4187946991916,2cyclictest296626-21cut22:50:170
4187946991916,2cyclictest239731-21head22:10:300
4187946991910,5cyclictest436271-21cpuspeed_turbos00:20:210
4187946991910,4cyclictest0-21swapper/022:05:010
25010911917,1phc2sys0-21swapper/320:17:093
418794799187,6cyclictest0-21swapper/100:20:311
418794799187,2cyclictest178850irq/121-eno121:20:261
4187947991815,2cyclictest396139-21cut23:55:031
4187947991815,2cyclictest20588-21cut19:30:011
4187947991815,2cyclictest1695-21dbus-daemon23:15:291
4187947991815,2cyclictest0-21swapper/119:50:001
4187947991812,2cyclictest178850irq/121-eno123:10:021
4187947991812,2cyclictest178850irq/121-eno123:10:011
4187947991810,3cyclictest0-21swapper/121:50:001
418794699189,5cyclictest33137-21grep19:40:180
418794699189,5cyclictest100466-21irqcore20:35:240
418794699188,6cyclictest0-21swapper/019:15:160
418794699187,6cyclictest0-21swapper/023:40:220
418794699186,7cyclictest88834-21cut20:25:220
4187946991815,2cyclictest63463-21tail20:05:180
4187946991815,2cyclictest4078226-21kworker/u16:3-events_power_efficient19:35:010
4187946991815,2cyclictest31843-21timerandwakeup19:35:280
4187946991815,2cyclictest305981-21kthreadcore22:55:290
4187946991815,2cyclictest0-21swapper/019:15:030
4187946991815,2cyclictest0-21swapper/019:15:020
4187946991814,3cyclictest114435-21kthreadcore20:45:250
4187946991810,4cyclictest0-21swapper/021:27:140
418794699180,16cyclictest265696-21/usr/sbin/munin22:30:160
4187948991714,1cyclictest0-21swapper/221:55:332
4187948991714,1cyclictest0-21swapper/200:20:342
418794799179,4cyclictest1312-21hwrng00:10:041
418794799178,4cyclictest0-21swapper/120:45:171
418794799177,2cyclictest32596-21latency_hist19:40:011
418794799174,4cyclictest295012-21idleruntime-cro22:49:591
418794799171,7cyclictest770595-21systemd-journal21:20:011
4187947991714,2cyclictest406001-21cut00:00:201
4187947991714,2cyclictest33776-21irqcore19:40:231
4187947991714,2cyclictest1726-21systemd-logind23:30:011
4187947991714,2cyclictest1726-21systemd-logind21:00:001
4187947991714,2cyclictest1726-21systemd-logind20:10:011
4187947991713,3cyclictest268472-21kthreadcore22:30:191
418794699179,4cyclictest0-21swapper/020:10:190
418794699177,5cyclictest0-21swapper/022:07:130
418794699175,8cyclictest51308-21expr19:55:190
418794699172,3cyclictest212073-21kworker/u16:1+nfsiod23:46:110
4187946991714,2cyclictest58368-21irqrtprio20:00:220
4187946991714,2cyclictest413903-21apt-key00:05:010
4187946991714,2cyclictest1-21systemd21:02:320
4187946991710,4cyclictest326678-21grep23:10:190
4187948991613,1cyclictest0-21swapper/222:10:002
418794799167,3cyclictest81120-21plymouth20:20:001
418794799164,4cyclictest356962-21aten2.4-expect23:30:141
418794799163,5cyclictest405186-21cat00:00:031
4187947991613,2cyclictest314434-21sort23:00:221
4187947991613,2cyclictest264427-21latency_hist22:30:001
4187947991613,2cyclictest123684-21munin-plugin-st20:55:021
4187947991612,3cyclictest57022-21gmain20:00:011
4187947991612,3cyclictest376242-21kthreadcore23:40:201
4187947991612,3cyclictest23574-21kthreadcore19:30:301
4187947991611,3cyclictest0-21swapper/100:20:011
418794699169,4cyclictest325837-21gpgv23:10:010
418794699169,4cyclictest325837-21gpgv23:10:000
418794699169,4cyclictest0-21swapper/000:07:520
418794699169,4cyclictest0-21swapper/000:07:510
418794699168,4cyclictest241rcuc/019:45:220
418794699164,11cyclictest3926324-21kworker/u16:2+rpciod21:47:240
4187946991614,1cyclictest124729-21tr20:55:220
4187946991613,2cyclictest1696-1atopacctd20:50:220
418794699160,4cyclictest99219-21awk20:35:000
4187948991512,1cyclictest0-21swapper/223:10:232
4187948991512,1cyclictest0-21swapper/220:40:012
418794799157,1cyclictest178850irq/121-eno123:48:481
418794799155,3cyclictest0-21swapper/123:22:271
418794799153,3cyclictest191151-21aten2.4-expect21:40:191
418794799152,5cyclictest0-21swapper/123:12:531
4187947991512,2cyclictest7557-21mailstats19:15:271
4187947991512,2cyclictest0-21swapper/122:20:261
4187947991511,3cyclictest94817-21kernelversion20:30:251
4187947991511,3cyclictest109013-21kthreadcore20:40:251
418794699156,5cyclictest75388-21apt-get20:15:150
418794899141,3cyclictest0-21swapper/221:20:012
4187948991411,1cyclictest0-21swapper/223:31:062
4187948991411,1cyclictest0-21swapper/222:00:272
4187948991411,1cyclictest0-21swapper/220:05:242
4187948991411,1cyclictest0-21swapper/219:20:232
4187948991410,2cyclictest0-21swapper/200:27:432
418794799148,5cyclictest178850irq/121-eno100:06:151
418794799148,5cyclictest178850irq/121-eno100:06:141
418794799146,2cyclictest178850irq/121-eno120:10:181
418794799145,2cyclictest87316-21latency_hist20:25:021
418794799145,2cyclictest178850irq/121-eno120:25:161
418794799145,1cyclictest178850irq/121-eno119:50:171
418794799142,4cyclictest0-21swapper/122:06:081
418794799141,3cyclictest304560-21apt-get22:55:161
4187947991411,2cyclictest9244-21rtkit-daemon20:38:321
4187948991311,1cyclictest0-21swapper/220:10:192
4187948991311,1cyclictest0-21swapper/200:10:012
4187948991311,1cyclictest0-21swapper/200:10:012
4187948991310,1cyclictest0-21swapper/221:29:512
4187948991310,1cyclictest0-21swapper/220:30:202
4187948991210,1cyclictest0-21swapper/219:30:332
4187946991210,1cyclictest0-21swapper/019:10:020
418794799119,1cyclictest4188125-21latency_hist19:10:031
41879489990,4cyclictest0-21swapper/219:10:022
250109180,4phc2sys0-21swapper/319:05:183
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional