You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-11-22 - 08:53
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackcslot0.osadl.org (updated Fri Nov 22, 2024 00:43:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2400221440,4sleep71319399cyclictest22:24:1313
2400221440,4sleep71319399cyclictest22:24:1313
125222118103,11sleep60-21swapper/619:13:0112
12700211493,15sleep20-21swapper/219:14:498
12458211393,13sleep110-21swapper/1119:12:173
3179521100,1sleep110-21swapper/1121:54:033
2194321090,2sleep666-21ksoftirqd/623:56:1212
12636210992,10sleep100-21swapper/1019:14:412
12433210994,11sleep70-21swapper/719:11:5713
12638210692,10sleep120-21swapper/1219:14:434
12408210391,8sleep40-21swapper/419:11:3810
12407210391,8sleep30-21swapper/319:11:379
1880321000,1sleep30-21swapper/323:33:579
275922990,1sleep120-21swapper/1222:30:274
275922990,1sleep120-21swapper/1222:30:274
242402990,2sleep666-21ksoftirqd/623:01:5412
136032960,0sleep150-21swapper/1522:38:477
1258029570,19sleep80-21swapper/819:13:5114
115622950,1sleep30-21swapper/322:33:149
115622950,1sleep30-21swapper/322:33:149
303422930,2sleep030335-21sshd21:32:290
215112930,1sleep80-21swapper/821:36:2114
18872930,4sleep31318699cyclictest21:17:499
238382920,5sleep71319399cyclictest23:18:1413
253932910,1sleep100-21swapper/1023:07:352
1254829175,4sleep150-21swapper/1519:13:267
50882900,1sleep00-21swapper/023:04:130
224372890,0sleep110-21swapper/1120:42:233
186242890,2sleep3998-21dbus-daemon21:40:499
135082890,0sleep90-21swapper/922:55:1615
1243128972,13sleep50-21swapper/519:11:5511
54312880,5sleep91319599cyclictest22:21:0215
54312880,5sleep91319599cyclictest22:21:0215
37052880,4sleep558-21ksoftirqd/500:25:3611
1260828875,9sleep10-21swapper/119:14:161
135322870,2sleep813533-21sshd21:56:0914
223722860,1sleep110-21swapper/1123:56:173
224952850,1sleep666-21ksoftirqd/600:06:5412
1169828573,6sleep90-21swapper/919:11:2715
1168628472,8sleep140-21swapper/1419:11:166
99662830,0sleep141291ktimersoftd/1400:21:126
157412830,1sleep990-21ksoftirqd/900:05:3715
1163928375,4sleep130-21swapper/1319:10:595
1164328172,4sleep00-21swapper/019:11:020
206932800,0sleep20-21swapper/222:23:368
206932800,0sleep20-21swapper/222:23:368
179632800,0sleep90-21swapper/921:30:2915
269462780,0sleep140-21swapper/1423:13:326
3792770,0sleep111051ktimersoftd/1123:52:483
143962760,0sleep00-21swapper/023:05:330
313702740,0sleep20-21swapper/222:30:498
313702740,0sleep20-21swapper/222:30:498
320782680,0sleep00-21swapper/022:15:160
320782680,0sleep00-21swapper/022:15:160
98992650,7sleep151320599cyclictest00:32:117
223402610,1sleep90-21swapper/923:34:3515
1319299490,1cyclictest0-21swapper/600:38:2112
1319299490,1cyclictest0-21swapper/600:31:0112
13200994810,31cyclictest32011-21sshd00:14:465
1319299480,1cyclictest0-21swapper/621:36:2112
1320099479,35cyclictest11502-21sshd22:55:025
1319299470,1cyclictest0-21swapper/623:16:5712
1319299460,1cyclictest0-21swapper/623:53:4512
1319299460,1cyclictest0-21swapper/623:14:5712
1319299460,1cyclictest0-21swapper/623:09:0112
1319299460,1cyclictest0-21swapper/622:58:0912
1319299460,1cyclictest0-21swapper/622:25:1312
1319299460,1cyclictest0-21swapper/622:25:1312
1319299460,1cyclictest0-21swapper/621:21:0912
1319299460,1cyclictest0-21swapper/619:35:3312
1319299460,1cyclictest0-21swapper/619:35:3312
1319299460,1cyclictest0-21swapper/600:21:4112
1319299451,41cyclictest998-21dbus-daemon00:13:3112
1319299450,42cyclictest0-21swapper/623:30:2312
1319299450,2cyclictest0-21swapper/619:31:1312
1319299450,2cyclictest0-21swapper/619:31:1312
1319299450,1cyclictest0-21swapper/623:48:5712
1319299450,1cyclictest0-21swapper/622:30:1712
1319299450,1cyclictest0-21swapper/622:30:1712
1319299450,1cyclictest0-21swapper/621:53:3312
1319299450,1cyclictest0-21swapper/621:05:4112
1319299450,1cyclictest0-21swapper/600:03:3312
1319299442,40cyclictest1014-21systemd-logind21:55:4112
1319299441,40cyclictest998-21dbus-daemon23:25:5312
1319299440,2cyclictest0-21swapper/622:50:4912
1319299440,1cyclictest0-21swapper/623:37:4512
1319299440,1cyclictest0-21swapper/623:21:0912
1319299440,1cyclictest0-21swapper/622:47:4512
1319299440,1cyclictest0-21swapper/622:25:2912
1319299440,1cyclictest0-21swapper/622:25:2912
1319299440,1cyclictest0-21swapper/622:06:2512
1319299440,1cyclictest0-21swapper/622:01:2112
1319299440,1cyclictest0-21swapper/621:40:4512
1319299440,1cyclictest0-21swapper/621:27:0512
1319299440,1cyclictest0-21swapper/620:46:1312
1319299440,1cyclictest0-21swapper/600:44:5712
1319299440,1cyclictest0-21swapper/600:26:0512
1320099436,2cyclictest23149-21sshd22:29:455
1320099436,2cyclictest23149-21sshd22:29:455
1319299430,2cyclictest0-21swapper/622:35:3712
1319299430,1cyclictest0-21swapper/623:42:0512
1319299430,1cyclictest0-21swapper/622:43:0512
1319299430,1cyclictest0-21swapper/622:14:1312
1319299430,1cyclictest0-21swapper/622:14:1312
1319299430,1cyclictest0-21swapper/621:31:2112
1319299430,1cyclictest0-21swapper/620:51:0512
1319299430,1cyclictest0-21swapper/620:10:1712
1319299430,1cyclictest0-21swapper/619:50:4912
1319299430,1cyclictest0-21swapper/619:50:4912
1319299430,1cyclictest0-21swapper/619:45:2912
1319299430,1cyclictest0-21swapper/619:45:2912
1319299430,1cyclictest0-21swapper/619:41:3312
1319299430,1cyclictest0-21swapper/619:41:3312
13186994310,27cyclictest67831sshd22:37:339
1319299421,38cyclictest15691-21expr21:45:2712
1319299420,39cyclictest11244-21sshd00:16:1712
1319299420,1cyclictest0-21swapper/622:16:1312
1319299420,1cyclictest0-21swapper/622:16:1312
1319299420,1cyclictest0-21swapper/621:16:4512
1319299420,1cyclictest0-21swapper/620:16:3712
1319299420,1cyclictest0-21swapper/619:55:2912
13183994223,17cyclictest0-21swapper/023:52:040
1318399421,28cyclictest0-21swapper/021:10:290
13183994210,30cyclictest0-21swapper/000:20:130
80432410,1sleep70-21swapper/723:37:1413
1320099417,2cyclictest2019-21sshd22:55:315
13200994113,25cyclictest17172-21expr21:40:345
13200994110,28cyclictest11488-21sshd23:05:185
1320099410,38cyclictest0-21swapper/1322:34:455
1320099410,38cyclictest0-21swapper/1322:34:455
1319299410,38cyclictest16833-21chrt19:18:5312
1319299410,1cyclictest0-21swapper/621:11:1312
1319299410,1cyclictest0-21swapper/620:37:0512
1319299410,1cyclictest0-21swapper/620:30:5712
1319299410,1cyclictest0-21swapper/620:25:3712
1319299410,1cyclictest0-21swapper/620:06:0912
1319299410,1cyclictest0-21swapper/620:00:2112
1319299410,1cyclictest0-21swapper/619:26:0512
13183994118,21cyclictest0-21swapper/000:38:540
13183994117,22cyclictest0-21swapper/022:35:350
13183994114,25cyclictest0-21swapper/022:25:520
13183994114,25cyclictest0-21swapper/022:25:520
13183994114,21cyclictest0-21swapper/022:11:540
13183994114,21cyclictest0-21swapper/022:11:540
13183994110,29cyclictest5041-21nfsd21:20:060
1320099406,3cyclictest1998-21sshd23:30:555
13200994010,27cyclictest10578-21uname00:21:195
1320099400,9cyclictest8285-21sshd00:26:245
1320099400,38cyclictest0-21swapper/1323:43:375
1320099400,1cyclictest0-21swapper/1323:29:255
1319299400,1cyclictest0-21swapper/620:20:2112
1319299400,1cyclictest0-21swapper/619:20:3312
13183994022,16cyclictest0-21swapper/023:27:550
13183994015,12cyclictest32489-21run-parts21:22:300
13183994014,23cyclictest21883-21sshd22:50:550
13183994011,27cyclictest0-21swapper/023:31:360
1320099394,3cyclictest998-21dbus-daemon00:00:485
1320099393,3cyclictest9458-21sshd21:50:155
13200993910,26cyclictest16861-21run-parts21:20:185
1320099390,8cyclictest0-21swapper/1322:40:165
1320099390,37cyclictest0-21swapper/1321:59:435
1319299391,36cyclictest25823-21snmpd21:00:5712
1319299390,1cyclictest0-21swapper/620:56:1712
1319299390,1cyclictest0-21swapper/620:40:5312
1318699398,28cyclictest6320-21rm23:53:519
13186993912,25cyclictest0-21swapper/322:50:249
13186993910,27cyclictest0-21swapper/321:59:339
1318399399,28cyclictest0-21swapper/023:57:040
1318399399,28cyclictest0-21swapper/023:18:000
13183993922,15cyclictest0-21swapper/000:11:200
13183993922,14cyclictest0-21swapper/023:35:350
13183993920,17cyclictest0-21swapper/023:21:450
13183993920,17cyclictest0-21swapper/023:13:530
13183993917,20cyclictest0-21swapper/022:58:020
13183993916,22cyclictest0-21swapper/000:32:260
13183993916,21cyclictest0-21swapper/021:45:230
13183993914,23cyclictest17851-21apt-get21:25:270
1318399391,29cyclictest0-21swapper/022:41:480
1320099386,4cyclictest1014-21systemd-logind23:48:255
1320099386,3cyclictest17449-21cpuspeed21:30:295
1320099385,3cyclictest1014-21systemd-logind21:51:125
1320099383,3cyclictest8293-21sshd23:37:165
13200993813,23cyclictest0-21swapper/1321:37:545
1320099380,9cyclictest26992-21sshd22:19:435
1320099380,9cyclictest26992-21sshd22:19:435
1318699389,21cyclictest10766-21sshd00:05:139
1318699386,30cyclictest0-21swapper/300:33:399
13186993812,24cyclictest0-21swapper/321:25:249
1318399388,25cyclictest0-21swapper/022:03:000
13183993828,8cyclictest32067-21sshd00:03:100
13183993820,16cyclictest8596-21sshd00:26:280
13183993817,19cyclictest0-21swapper/022:20:230
13183993817,19cyclictest0-21swapper/022:20:230
13183993816,20cyclictest0-21swapper/022:46:520
13183993816,20cyclictest0-21swapper/021:53:280
13183993815,21cyclictest0-21swapper/022:31:200
13183993815,21cyclictest0-21swapper/022:31:200
13183993813,23cyclictest0-21swapper/022:07:250
13183993813,21cyclictest0-21swapper/021:56:240
13183993812,24cyclictest0-21swapper/021:35:380
13183993810,26cyclictest0-21swapper/023:48:480
1320099377,2cyclictest12488-21sshd23:10:545
1320099376,3cyclictest998-21dbus-daemon21:15:485
1320099374,3cyclictest998-21dbus-daemon22:03:565
1320099374,3cyclictest814-17auditd22:49:035
13200993711,24cyclictest20859-21sshd23:01:225
13200993711,23cyclictest0-21swapper/1322:05:225
13198993716,2cyclictest0-21swapper/1121:00:253
1318699379,26cyclictest0-21swapper/323:05:299
1318699379,26cyclictest0-21swapper/321:33:549
1318699378,27cyclictest0-21swapper/322:56:289
13186993716,19cyclictest5041-21nfsd00:10:289
13186993712,22cyclictest3038-2110-uname21:38:379
13186993711,24cyclictest0-21swapper/323:04:329
13186993711,24cyclictest0-21swapper/300:37:289
13183993717,18cyclictest0-21swapper/019:15:390
13183993717,18cyclictest0-21swapper/000:05:190
13183993716,19cyclictest0-21swapper/020:30:500
13183993716,19cyclictest0-21swapper/019:47:050
13183993716,19cyclictest0-21swapper/019:47:050
13183993714,21cyclictest0-21swapper/023:41:140
13183993714,21cyclictest0-21swapper/000:20:590
13183993712,23cyclictest0-21swapper/021:40:280
1320099364,3cyclictest1014-21systemd-logind23:15:215
1320099362,5cyclictest503950nfsd22:37:445
13200993610,24cyclictest30933-21sh00:08:325
13200993610,24cyclictest28646-21sshd23:57:195
1318699365,29cyclictest0-21swapper/323:18:009
1318699362,32cyclictest0-21swapper/322:46:389
13186993617,16cyclictest13059-2110-uname00:21:429
13186993615,18cyclictest998-21dbus-daemon22:03:169
13186993614,19cyclictest0-21swapper/321:47:029
13186993613,22cyclictest0-21swapper/323:59:419
13186993613,21cyclictest0-21swapper/323:29:369
13186993612,21cyclictest998-21dbus-daemon21:23:549
13186993612,21cyclictest0-21swapper/323:11:189
13186993611,23cyclictest0-21swapper/322:16:139
13186993611,23cyclictest0-21swapper/322:16:139
13186993611,22cyclictest28736-21sshd23:24:259
13186993610,24cyclictest0-21swapper/322:26:109
13186993610,24cyclictest0-21swapper/322:26:109
13183993619,15cyclictest0-21swapper/019:26:150
13183993618,16cyclictest0-21swapper/019:22:510
13183993617,17cyclictest0-21swapper/020:26:030
13183993616,18cyclictest0-21swapper/020:55:370
13183993616,18cyclictest0-21swapper/020:19:250
13183993615,19cyclictest0-21swapper/020:35:320
13183993615,19cyclictest0-21swapper/020:01:020
13183993615,19cyclictest0-21swapper/000:40:290
13183993614,20cyclictest0-21swapper/019:41:190
13183993614,20cyclictest0-21swapper/019:41:190
13183993614,20cyclictest0-21swapper/019:35:290
13183993614,20cyclictest0-21swapper/019:35:290
13183993613,21cyclictest0-21swapper/019:31:580
13183993613,21cyclictest0-21swapper/019:31:580
13183993612,22cyclictest0-21swapper/020:08:140
258412350,1sleep50-21swapper/523:40:2411
1320099356,3cyclictest11258-21sshd22:21:585
1320099356,3cyclictest11258-21sshd22:21:585
1320099356,2cyclictest12637-21sshd23:21:265
1320099355,2cyclictest1055-21in:imuxsock22:14:015
1320099355,2cyclictest1055-21in:imuxsock22:14:015
1320099354,3cyclictest998-21dbus-daemon00:30:465
1320099353,3cyclictest998-21dbus-daemon00:35:445
1318699359,18cyclictest0-21swapper/300:16:489
1318699357,26cyclictest0-21swapper/322:20:199
1318699357,26cyclictest0-21swapper/322:20:199
1318699357,26cyclictest0-21swapper/321:53:469
1318699355,28cyclictest0-21swapper/322:13:439
1318699355,28cyclictest0-21swapper/322:13:439
13186993515,18cyclictest0-21swapper/323:46:299
13186993515,17cyclictest509-21systemd-journal23:41:329
13186993514,19cyclictest18118-21sshd00:06:049
13186993513,20cyclictest29069-21chrt19:33:009
13186993513,20cyclictest29069-21chrt19:33:009
13186993513,20cyclictest0-21swapper/322:40:499
13186993513,19cyclictest7380-21cp23:37:069
13186993512,21cyclictest0-21swapper/319:36:079
13186993512,21cyclictest0-21swapper/319:36:079
13183993518,14cyclictest0-21swapper/020:40:350
13183993517,16cyclictest0-21swapper/021:10:130
13183993517,16cyclictest0-21swapper/020:45:340
13183993516,17cyclictest0-21swapper/019:55:330
13183993515,18cyclictest0-21swapper/020:21:150
13183993514,19cyclictest0-21swapper/021:00:300
13183993514,19cyclictest0-21swapper/020:12:250
13183993514,19cyclictest0-21swapper/019:50:470
13183993514,19cyclictest0-21swapper/019:50:470
1320099344,3cyclictest93350irq/41-eth0-TxR19:15:295
1320099343,3cyclictest0-21swapper/1300:15:225
13186993418,14cyclictest28843-21sshd00:40:269
13186993416,16cyclictest0-21swapper/319:17:559
13186993414,17cyclictest0-21swapper/320:05:389
13186993413,19cyclictest0-21swapper/320:42:309
13186993413,18cyclictest2537-21latency_hist20:20:159
13186993411,21cyclictest0-21swapper/300:25:589
13186993411,20cyclictest11591-21sshd22:06:029
13183993415,17cyclictest0-21swapper/020:50:170
321772330,2sleep80-21swapper/800:03:1214
206452330,1sleep140-21swapper/1421:57:196
13205993327,4cyclictest998-21dbus-daemon23:47:307
1320099335,3cyclictest5041-21nfsd00:43:415
1320099334,3cyclictest31762-21sshd21:27:225
1320099333,3cyclictest1033-21gdbus23:50:535
13186993314,17cyclictest0-21swapper/319:55:359
13186993314,15cyclictest0-21swapper/321:11:139
13186993313,18cyclictest0-21swapper/320:55:159
13186993313,18cyclictest0-21swapper/320:25:339
13186993313,17cyclictest0-21swapper/319:45:169
13186993313,17cyclictest0-21swapper/319:45:169
13186993312,18cyclictest0-21swapper/320:15:159
13186993311,20cyclictest0-21swapper/320:45:199
325742320,6sleep121319999cyclictest23:35:584
13205993226,4cyclictest0-21swapper/1522:57:147
1318699329,21cyclictest0-21swapper/320:30:329
13186993214,16cyclictest0-21swapper/320:00:469
13186993213,17cyclictest0-21swapper/320:35:209
13186993213,17cyclictest0-21swapper/319:20:269
13186993213,16cyclictest5040-21nfsd19:50:379
13186993213,16cyclictest5040-21nfsd19:50:379
13186993212,18cyclictest5041-21nfsd21:05:209
13186993212,18cyclictest0-21swapper/321:00:529
13186993212,18cyclictest0-21swapper/319:25:209
13186993212,17cyclictest0-21swapper/320:55:299
13186993211,18cyclictest0-21swapper/319:40:329
13186993211,18cyclictest0-21swapper/319:40:329
226992310,1sleep80-21swapper/822:13:4814
226992310,1sleep80-21swapper/822:13:4814
157942310,1sleep10961rcuc/1023:27:392
152592310,28sleep100-21swapper/1000:11:162
1320099315,3cyclictest17696-21switchtime20:36:335
1320099313,2cyclictest0-21swapper/1321:15:155
13186993113,16cyclictest0-21swapper/320:24:229
126522310,1sleep50-21swapper/500:37:3811
83022300,1sleep20-21swapper/222:16:228
83022300,1sleep20-21swapper/222:16:228
60642300,1sleep20-21swapper/221:55:158
278412300,2sleep100-21swapper/1021:21:422
237952300,26sleep110-21swapper/1122:56:393
134872300,1sleep70-21swapper/700:10:5513
68202290,7sleep101319699cyclictest00:36:392
51152290,1sleep70-21swapper/722:31:5913
51152290,1sleep70-21swapper/722:31:5913
232202290,1sleep80-21swapper/800:34:2914
198582290,2sleep140-21swapper/1422:07:306
179792291,24sleep110-21swapper/1123:22:203
1320099297,2cyclictest17475-21unixbench_singl19:56:355
1320099296,2cyclictest5164-21mailstats20:21:055
1320099296,2cyclictest2006-21runrttasks19:34:425
1320099296,2cyclictest2006-21runrttasks19:34:425
1320099294,3cyclictest6636-21cpuspeed_turbos19:45:315
1320099294,3cyclictest6636-21cpuspeed_turbos19:45:315
104662290,25sleep410526-21sshd22:11:3610
104662290,25sleep410526-21sshd22:11:3610
48882280,24sleep40-21swapper/421:28:1710
311292280,1sleep50-21swapper/521:37:5511
284322280,1sleep140-21swapper/1421:26:506
280122280,2sleep1128014-21run-parts21:58:363
180072280,0sleep110-21swapper/1121:40:413
13205992823,3cyclictest0-21swapper/1523:55:527
13205992823,3cyclictest0-21swapper/1523:29:157
13205992822,4cyclictest866-17auditd22:20:067
13205992822,4cyclictest866-17auditd22:20:067
13205992811,11cyclictest0-21swapper/1520:36:077
118922280,23sleep20-21swapper/223:37:588
78492270,0sleep100-21swapper/1022:05:322
298072270,1sleep90-21swapper/900:19:3115
240472270,1sleep40-21swapper/421:57:5810
151552270,1sleep140-21swapper/1423:43:476
138262270,23sleep20-21swapper/200:37:528
13205992722,3cyclictest5155-21sshd23:04:147
13205992721,4cyclictest509-21systemd-journal00:27:047
13205992721,4cyclictest5039-21nfsd23:18:107
13205992721,4cyclictest22558-21sshd00:06:557
13205992721,4cyclictest11783-21sshd22:00:577
1320099275,2cyclictest27912-21df_inode20:10:285
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional