You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-27 - 14:23
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack1slot1.osadl.org (updated Sat Jul 27, 2024 12:45:04)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
32052217157,46sleep10-21swapper/107:07:551
33382207168,25sleep00-21swapper/007:09:380
32582203163,26sleep20-21swapper/207:08:362
31042201161,26sleep30-21swapper/307:06:353
62502630,0sleep20-21swapper/207:15:002
291062630,1sleep028495-21diskmemload09:55:190
101352230,0sleep10-21swapper/107:20:151
122592180,0sleep30-21swapper/307:25:153
3469991312,1cyclictest28-21ksoftirqd/209:50:112
346999120,10cyclictest0-21swapper/212:38:292
347799119,1cyclictest30933-21ssh09:11:443
3469991110,1cyclictest28-21ksoftirqd/209:00:142
160252110,0sleep328495-21diskmemload11:10:043
346999109,1cyclictest28-21ksoftirqd/211:00:552
346999108,1cyclictest30287-21/usr/sbin/munin08:05:222
346999108,1cyclictest28-21ksoftirqd/210:17:112
346999105,4cyclictest5806-21kworker/2:211:09:002
346999100,6cyclictest219202sleep211:17:092
327052100,0sleep00-21swapper/011:33:130
34779997,1cyclictest35-21ksoftirqd/308:30:013
34779990,5cyclictest0-21swapper/309:51:453
34779990,4cyclictest5807-21munin-node09:23:123
34699998,1cyclictest28-21ksoftirqd/211:24:162
34699998,1cyclictest28-21ksoftirqd/210:55:192
34699998,1cyclictest28-21ksoftirqd/210:39:062
34699998,1cyclictest28-21ksoftirqd/210:30:242
34699998,1cyclictest28-21ksoftirqd/209:56:512
34699998,1cyclictest28-21ksoftirqd/209:40:122
34699998,1cyclictest28-21ksoftirqd/207:45:002
34699997,1cyclictest757-21runrttasks10:09:222
34699997,1cyclictest28-21ksoftirqd/212:20:142
34699995,3cyclictest28-21ksoftirqd/211:51:102
34699990,8cyclictest534-21nscd11:27:122
34699990,7cyclictest27372-21apt-get10:40:102
34699990,4cyclictest28495-21diskmemload12:30:142
34699990,4cyclictest14512-21ntp_states10:20:192
34619990,4cyclictest0-21swapper/112:25:121
34559992,1cyclictest488-21sh12:20:090
34559990,7cyclictest240962sleep012:05:280
10417290,0sleep10-21swapper/111:47:041
34779987,0cyclictest35-21ksoftirqd/311:05:143
34779986,0cyclictest28495-21diskmemload11:22:503
34779982,0cyclictest28495-21diskmemload11:59:163
34779980,7cyclictest4954-21apt-get08:20:093
34779980,5cyclictest23211-21taskset12:05:183
34779980,5cyclictest19745-21snmpd10:50:053
34699988,0cyclictest28-21ksoftirqd/212:25:132
34699988,0cyclictest28-21ksoftirqd/212:10:242
34699988,0cyclictest28-21ksoftirqd/211:49:572
34699988,0cyclictest28-21ksoftirqd/209:35:172
34699988,0cyclictest28-21ksoftirqd/209:05:122
34699987,1cyclictest28-21ksoftirqd/212:16:562
34699987,1cyclictest28-21ksoftirqd/212:00:232
34699987,1cyclictest28-21ksoftirqd/211:55:182
34699987,1cyclictest28-21ksoftirqd/211:44:582
34699987,1cyclictest28-21ksoftirqd/211:11:172
34699987,1cyclictest28-21ksoftirqd/210:52:262
34699987,1cyclictest28-21ksoftirqd/210:45:112
34699987,1cyclictest28-21ksoftirqd/210:00:112
34699987,1cyclictest28-21ksoftirqd/209:49:152
34699987,1cyclictest28-21ksoftirqd/209:15:222
34699987,1cyclictest28-21ksoftirqd/207:25:012
34699986,1cyclictest61250irq/122-eno107:30:302
34699986,1cyclictest28-21ksoftirqd/211:35:112
34699983,3cyclictest28495-21diskmemload09:25:122
34699981,1cyclictest0-21swapper/208:55:312
34699981,1cyclictest0-21swapper/208:36:002
34699980,6cyclictest22278-21apt-get12:05:112
34699980,2cyclictest0-21swapper/209:23:042
34699980,1cyclictest0-21swapper/211:31:482
34699980,1cyclictest0-21swapper/210:13:142
34619981,1cyclictest0-21swapper/109:56:191
34619980,4cyclictest0-21swapper/109:22:031
34559988,0cyclictest9-21ksoftirqd/012:10:160
34559988,0cyclictest9-21ksoftirqd/011:10:180
34559986,1cyclictest9-21ksoftirqd/012:30:150
34559986,1cyclictest9-21ksoftirqd/011:05:160
34559986,1cyclictest19745-21snmpd09:14:410
34559986,1cyclictest19745-21snmpd09:07:560
34559986,1cyclictest19745-21snmpd07:35:200
34559986,1cyclictest19745-21snmpd07:13:140
34559981,6cyclictest534-21nscd11:20:520
34559981,6cyclictest26555-21ssh10:38:190
34559981,6cyclictest19029-21ssh12:00:150
34559981,6cyclictest1266-1kworker/u9:010:50:140
34559980,4cyclictest0-21swapper/010:25:130
13873280,0sleep00-21swapper/008:35:240
34779977,0cyclictest35-21ksoftirqd/311:25:153
34779977,0cyclictest35-21ksoftirqd/310:05:183
34779976,1cyclictest35-21ksoftirqd/312:25:163
34779976,1cyclictest35-21ksoftirqd/310:50:013
34779976,1cyclictest35-21ksoftirqd/310:35:133
34779976,1cyclictest1422-21ntpd11:50:483
34779975,2cyclictest19745-21snmpd12:18:413
34779975,1cyclictest7548-21ssh10:56:173
34779975,1cyclictest32517-21sh11:32:353
34779975,1cyclictest19745-21snmpd12:36:413
34779975,1cyclictest19745-21snmpd10:41:343
34779975,1cyclictest19745-21snmpd10:20:193
34779975,1cyclictest19745-21snmpd08:18:093
34779975,1cyclictest19745-21snmpd08:06:113
34779975,1cyclictest19745-21snmpd07:32:103
34779975,1cyclictest19745-21snmpd07:20:253
34779975,1cyclictest1689-21ssh12:20:173
34779974,1cyclictest28495-21diskmemload09:37:323
34779974,0cyclictest28495-21diskmemload09:25:093
34779973,2cyclictest530-21systemd-logind11:15:153
34779970,7cyclictest35-21ksoftirqd/310:15:543
34779970,5cyclictest0-21swapper/312:11:353
34779970,4cyclictest0-21swapper/312:30:123
34779970,3cyclictest0-21swapper/309:31:583
34779970,2cyclictest0-21swapper/311:01:583
34779970,2cyclictest0-21swapper/309:05:123
34699977,0cyclictest28-21ksoftirqd/209:30:532
34699976,1cyclictest28-21ksoftirqd/210:25:112
34699976,1cyclictest28-21ksoftirqd/208:45:192
34699976,1cyclictest28-21ksoftirqd/208:00:122
34699976,0cyclictest0-21swapper/208:30:112
34699975,1cyclictest28-21ksoftirqd/209:11:172
34699975,1cyclictest28-21ksoftirqd/208:10:142
34699970,1cyclictest0-21swapper/207:35:412
34619971,6cyclictest0-21swapper/107:26:471
34619971,4cyclictest0-21swapper/111:00:111
34619971,4cyclictest0-21swapper/109:46:381
34619971,1cyclictest0-21swapper/110:18:561
34619970,6cyclictest0-21swapper/111:05:181
34619970,4cyclictest0-21swapper/111:38:591
34559976,1cyclictest9-21ksoftirqd/009:20:150
34559976,1cyclictest9-21ksoftirqd/007:30:010
34559976,1cyclictest9-21ksoftirqd/007:15:000
34559975,1cyclictest9-21ksoftirqd/012:35:180
34559975,1cyclictest9-21ksoftirqd/010:40:110
34559975,1cyclictest8217-21ssh09:25:240
34559975,1cyclictest20470-21cat11:15:160
34559975,1cyclictest19745-21snmpd08:20:580
34559975,1cyclictest19745-21snmpd07:50:480
34559974,3cyclictest1422-21ntpd08:18:360
34559973,2cyclictest259-21systemd-journal12:30:000
34559972,4cyclictest2293-21apt-get10:05:020
34559971,5cyclictest4696-21ssh11:40:120
34559971,4cyclictest28495-21diskmemload11:25:420
34559970,6cyclictest5569-21ssh10:55:150
34559970,6cyclictest30319-21ssh12:15:180
34559970,6cyclictest28495-21diskmemload10:30:100
34559970,6cyclictest24931-21ssh09:50:120
34559970,6cyclictest19886-21ssh09:42:430
34559970,6cyclictest13831-21ssh09:35:110
34559970,6cyclictest12729-21ssh09:32:190
34559970,6cyclictest12011-21expr11:50:150
34559970,6cyclictest10755-21cut08:30:190
34559970,6cyclictest0-21swapper/010:10:130
34559970,3cyclictest3170-21ssh11:36:120
34559970,2cyclictest0-21swapper/009:45:120
34559970,1cyclictest9535-21ssh11:00:130
34559970,1cyclictest2889-21ssh09:19:380
34559970,1cyclictest1859-21sh10:03:370
34559970,1cyclictest13275-21ssh10:20:040
34559970,1cyclictest0-21swapper/008:05:100
34559970,1cyclictest0-21swapper/007:40:090
30119275,0sleep121-21ksoftirqd/111:30:121
25429270,0sleep10-21swapper/112:09:511
25365270,1sleep325477-21grep09:00:233
34779966,0cyclictest35-21ksoftirqd/309:55:143
34779966,0cyclictest0-21swapper/310:12:533
34779965,1cyclictest2817-21ssh09:19:243
34779965,1cyclictest19745-21snmpd08:50:283
34779965,1cyclictest19745-21snmpd08:37:163
34779965,1cyclictest19745-21snmpd08:32:193
34779965,1cyclictest19745-21snmpd08:14:273
34779965,1cyclictest17753-21cat10:25:193
34779964,1cyclictest19745-21snmpd08:47:103
34779964,1cyclictest19745-21snmpd07:42:503
34779964,0cyclictest28495-21diskmemload11:45:563
34779962,3cyclictest18289-21grep07:40:013
34779962,2cyclictest28495-21diskmemload09:43:073
34779961,2cyclictest6482-21ntp_states07:15:013
34779961,2cyclictest0-21swapper/310:04:143
34779960,4cyclictest0-21swapper/310:30:193
34779960,3cyclictest0-21swapper/312:00:133
34779960,3cyclictest0-21swapper/309:45:133
34779960,2cyclictest0-21swapper/311:35:093
34699966,0cyclictest61250irq/122-eno108:15:172
34699966,0cyclictest61250irq/122-eno107:25:222
34699966,0cyclictest28-21ksoftirqd/207:46:332
34699965,1cyclictest28-21ksoftirqd/208:25:242
34699964,1cyclictest61250irq/122-eno108:40:262
34699964,1cyclictest28-21ksoftirqd/208:50:112
34699964,1cyclictest28-21ksoftirqd/207:50:192
34699964,1cyclictest0-21swapper/208:20:102
34699962,3cyclictest0-21swapper/207:55:092
34619966,0cyclictest0-21swapper/110:28:511
34619961,3cyclictest0-21swapper/108:25:171
34619960,6cyclictest0-21swapper/112:21:521
34619960,6cyclictest0-21swapper/112:02:451
34619960,6cyclictest0-21swapper/110:46:371
34619960,6cyclictest0-21swapper/109:18:011
34619960,6cyclictest0-21swapper/108:34:331
34619960,6cyclictest0-21swapper/108:16:391
34619960,5cyclictest0-21swapper/112:33:441
34619960,5cyclictest0-21swapper/110:00:161
34619960,5cyclictest0-21swapper/108:45:191
34619960,5cyclictest0-21swapper/108:08:051
34619960,4cyclictest0-21swapper/110:10:501
34619960,4cyclictest0-21swapper/109:27:421
34619960,3cyclictest0-21swapper/112:19:221
34619960,3cyclictest0-21swapper/112:13:111
34619960,3cyclictest0-21swapper/111:58:521
34619960,3cyclictest0-21swapper/111:20:151
34619960,3cyclictest0-21swapper/110:33:191
34619960,1cyclictest0-21swapper/110:42:401
34619960,0cyclictest0-21swapper/111:51:491
34559965,1cyclictest8119-21ssh11:45:080
34559960,6cyclictest0-21swapper/011:55:420
34559960,6cyclictest0-21swapper/008:40:290
34559960,6cyclictest0-21swapper/008:25:030
34559960,6cyclictest0-21swapper/007:59:590
34559960,6cyclictest0-21swapper/007:32:380
34559960,5cyclictest8663-1kworker/u9:010:15:110
34559960,3cyclictest0-21swapper/010:45:210
34559960,0cyclictest0-21swapper/008:45:180
34559960,0cyclictest0-21swapper/007:46:430
34779955,0cyclictest0-21swapper/308:59:263
34779954,0cyclictest35-21ksoftirqd/307:45:153
34779953,1cyclictest6017-21awk11:40:213
34779951,1cyclictest0-21swapper/308:00:253
34779950,3cyclictest27450-21taskset07:57:083
34779950,0cyclictest0-21swapper/307:50:143
34699954,1cyclictest28-21ksoftirqd/207:10:132
34619955,0cyclictest0-21swapper/111:15:131
34619955,0cyclictest0-21swapper/108:35:261
34619955,0cyclictest0-21swapper/108:00:311
34619953,1cyclictest0-21swapper/111:25:031
34619951,4cyclictest0-21swapper/108:55:381
34619950,5cyclictest0-21swapper/108:40:181
34619950,5cyclictest0-21swapper/108:20:391
34619950,5cyclictest0-21swapper/107:59:361
34619950,4cyclictest0-21swapper/111:10:291
34619950,4cyclictest0-21swapper/109:50:171
34619950,3cyclictest0-21swapper/112:35:441
34619950,3cyclictest0-21swapper/110:50:341
34619950,3cyclictest0-21swapper/110:36:371
34619950,3cyclictest0-21swapper/110:22:471
34619950,3cyclictest0-21swapper/110:05:231
34619950,3cyclictest0-21swapper/107:30:101
34619950,2cyclictest0-21swapper/111:40:121
34619950,2cyclictest0-21swapper/109:41:411
34619950,2cyclictest0-21swapper/109:35:261
34619950,0cyclictest0-21swapper/109:10:051
34559950,5cyclictest0-21swapper/009:03:260
34559950,5cyclictest0-21swapper/008:00:150
34559950,4cyclictest9073-21/usr/sbin/munin07:20:090
34559950,4cyclictest21647-21/usr/sbin/munin08:55:130
34559950,1cyclictest32637-21/usr/sbin/munin08:10:150
34559950,1cyclictest0-21swapper/008:50:100
16410250,0sleep30-21swapper/308:41:203
34779943,1cyclictest35-21ksoftirqd/307:10:153
34619942,1cyclictest103192sleep109:30:091
34619940,4cyclictest0-21swapper/108:52:111
34619940,4cyclictest0-21swapper/108:14:511
34619940,4cyclictest0-21swapper/107:42:351
34619940,3cyclictest0-21swapper/109:00:141
34619940,2cyclictest0-21swapper/110:55:101
34619940,2cyclictest0-21swapper/107:50:131
34619940,2cyclictest0-21swapper/107:45:141
34619940,1cyclictest0-21swapper/107:35:111
34619930,3cyclictest0-21swapper/107:15:011
34619930,1cyclictest0-21swapper/109:05:131
34619930,1cyclictest0-21swapper/107:10:231
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional