You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-04-02 - 03:57
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack2slot0.osadl.org (updated Wed Apr 02, 2025 00:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2353021080,0sleep223495-21sshd00:27:122
204872990,0sleep220486-21id00:20:192
274772950,1sleep227468-21sshd21:30:522
46392900,1sleep3646-21dbus-daemon00:25:163
29672700,0sleep3391rcuc/322:26:493
227482670,0sleep00-21swapper/000:30:180
45482560,0sleep30-21swapper/300:31:413
293102540,1sleep3391rcuc/321:34:103
167342540,1sleep216686-21sshd22:09:452
222692530,0sleep00-21swapper/021:12:040
126862530,0sleep30-21swapper/322:49:203
296562520,0sleep00-21swapper/021:18:530
262032520,0sleep20-21swapper/223:33:492
210782520,1sleep1646-21dbus-daemon22:47:011
201192520,0sleep30-21swapper/300:37:103
304592510,1sleep10-21swapper/100:14:531
253572510,0sleep20-21swapper/200:14:222
10352510,1sleep11013-21sshd21:46:451
163212500,0sleep31-21systemd00:20:003
281702490,0sleep10-21swapper/122:13:531
216132490,0sleep00-21swapper/023:05:350
195352490,0sleep30-21swapper/322:59:133
190812480,1sleep019069-21sshd22:10:000
180272480,0sleep30-21swapper/323:11:273
97962470,0sleep2311rcuc/221:50:352
63442470,2sleep01892499cyclictest21:56:260
243732470,0sleep00-21swapper/023:27:300
55212460,0sleep00-21swapper/000:25:210
6752420,2sleep21892699cyclictest22:29:442
275232360,0sleep30-21swapper/323:58:253
112652350,0sleep30-21swapper/322:42:593
146872310,1sleep0684-21polkitd23:54:090
185582297,7sleep30-21swapper/319:06:483
186152287,7sleep10-21swapper/119:07:291
1880222210,7sleep00-21swapper/019:09:530
186112209,6sleep20-21swapper/219:07:262
156852200,1sleep115683-21sshd23:32:471
23542180,1sleep32352-21bash21:25:293
182582180,0sleep10-21swapper/100:00:311
327052170,1sleep332706-21bash23:34:263
270592170,1sleep20-21swapper/222:56:482
316582160,1sleep30-21swapper/321:40:233
286462160,1sleep028643-21lspci23:34:030
57482150,0sleep1231rcuc/123:19:351
52332150,0sleep00-21swapper/023:44:000
279042150,0sleep327903-21sshd21:24:503
99392140,0sleep00-21swapper/021:44:320
325912140,0sleep10-21swapper/121:43:371
318372140,0sleep3391rcuc/323:28:143
295802140,0sleep3401ktimersoftd/322:35:233
239302140,0sleep30-21swapper/300:01:053
211212140,0sleep00-21swapper/021:33:230
178382140,1sleep118081-1kworker/1:2H21:36:051
127492140,0sleep10-21swapper/100:32:311
18926991311,1cyclictest1-21systemd22:31:192
18925991311,1cyclictest646-21dbus-daemon22:08:251
188572130,0sleep00-21swapper/000:20:140
132812130,0sleep20-21swapper/221:35:372
1892799120,1cyclictest23193-21diskstats21:15:123
1892799120,11cyclictest646-21dbus-daemon00:06:333
1892699120,11cyclictest4832-21sshd21:13:292
1892699120,11cyclictest19512-21lspci22:49:592
18925991210,1cyclictest6121-21sshd23:07:151
1892599120,11cyclictest0-21swapper/100:28:551
18924991211,0cyclictest0-21swapper/021:48:230
1892499120,1cyclictest1080-21bash22:14:230
18927991110,0cyclictest0-21swapper/323:47:333
18927991110,0cyclictest0-21swapper/323:42:233
1892799110,10cyclictest0-21swapper/323:53:533
1892799110,10cyclictest0-21swapper/300:11:433
1892799110,0cyclictest0-21swapper/323:24:323
1892699119,1cyclictest5314-21sshd23:07:092
1892699119,1cyclictest2808-21sshd23:37:392
1892699119,1cyclictest26308-21systemd-cgroups23:49:092
1892699110,10cyclictest25138-21sshd00:34:002
1892699110,10cyclictest0-21swapper/223:19:492
1892699110,10cyclictest0-21swapper/222:52:492
1892699110,10cyclictest0-21swapper/200:18:292
1892699110,0cyclictest0-21swapper/222:23:592
1892699110,0cyclictest0-21swapper/200:39:102
1892599119,1cyclictest1011-21sshd23:37:451
18925991110,0cyclictest0-21swapper/123:49:151
18925991110,0cyclictest0-21swapper/123:13:351
18925991110,0cyclictest0-21swapper/122:01:461
1892599110,1cyclictest5121-21lspci23:44:001
1892599110,10cyclictest646-21dbus-daemon22:55:391
1892599110,10cyclictest0-21swapper/121:50:451
1892599110,0cyclictest0-21swapper/123:26:151
1892499113,4cyclictest27465-21grep23:00:000
18924991110,0cyclictest0-21swapper/000:36:540
1892499110,10cyclictest0-21swapper/023:55:040
1892499110,10cyclictest0-21swapper/022:16:030
1892799109,0cyclictest0-21swapper/323:05:323
1892799109,0cyclictest0-21swapper/322:20:423
1892799109,0cyclictest0-21swapper/322:06:123
1892799109,0cyclictest0-21swapper/321:55:423
1892799109,0cyclictest0-21swapper/320:10:123
1892799109,0cyclictest0-21swapper/319:31:223
1892799108,1cyclictest18241-21sshd23:36:033
1892699108,1cyclictest646-21dbus-daemon22:41:292
1892699100,0cyclictest0-21swapper/221:41:192
1892699100,0cyclictest0-21swapper/221:26:292
1892599109,0cyclictest0-21swapper/123:55:351
1892599109,0cyclictest0-21swapper/122:44:251
1892599109,0cyclictest0-21swapper/122:35:551
1892599109,0cyclictest0-21swapper/121:14:051
1892599109,0cyclictest0-21swapper/100:23:451
1892599109,0cyclictest0-21swapper/100:07:061
1892599100,0cyclictest0-21swapper/122:50:061
1892599100,0cyclictest0-21swapper/121:24:541
1892499109,0cyclictest0-21swapper/022:29:340
1892499109,0cyclictest0-21swapper/000:01:140
1892499102,4cyclictest27555-21munin-run19:30:000
1892499100,0cyclictest0-21swapper/023:00:130
1892499100,0cyclictest0-21swapper/021:24:130
1892499100,0cyclictest0-21swapper/021:09:330
189279998,0cyclictest0-21swapper/321:39:123
189279998,0cyclictest0-21swapper/321:13:023
189279998,0cyclictest0-21swapper/320:42:223
189279998,0cyclictest0-21swapper/320:08:223
189269998,0cyclictest0-21swapper/223:00:502
189269998,0cyclictest0-21swapper/222:01:392
189269997,1cyclictest619-17sedispatch23:12:192
189259998,0cyclictest21117-21sshd22:28:351
189259998,0cyclictest0-21swapper/123:00:551
189259998,0cyclictest0-21swapper/122:21:151
189249998,0cyclictest0-21swapper/023:11:440
189249997,2cyclictest18017-21kworker/0:123:35:320
189249997,1cyclictest0-21swapper/023:18:040
189249996,2cyclictest13812-21kworker/0:123:21:360
189249996,2cyclictest12812-21kworker/0:022:53:080
189249990,8cyclictest14872-21sshd22:34:050
189279987,0cyclictest0-21swapper/322:01:123
189279987,0cyclictest0-21swapper/320:30:023
189279987,0cyclictest0-21swapper/300:22:033
189279986,1cyclictest29108-21lspci23:15:333
189279985,2cyclictest649-21avahi-daemon23:04:203
189279985,2cyclictest649-21avahi-daemon22:52:353
189279985,2cyclictest649-21avahi-daemon22:19:133
189269987,0cyclictest0-21swapper/222:38:392
189269987,0cyclictest0-21swapper/221:18:192
189269987,0cyclictest0-21swapper/220:44:592
189269987,0cyclictest0-21swapper/219:19:592
189269986,1cyclictest29764-21lspci21:46:242
189269984,3cyclictest646-21dbus-daemon21:58:552
189269984,1cyclictest18273-21sshd00:00:312
189269980,5cyclictest30065-21sshd23:52:312
189259987,0cyclictest1093-21nfsd21:30:541
189259987,0cyclictest0-21swapper/121:08:341
189259986,1cyclictest21460-21lspci00:17:101
189259986,1cyclictest15457-21lspci23:23:311
189259986,1cyclictest12242-21lspci00:36:121
189249987,0cyclictest0-21swapper/020:45:240
189249986,2cyclictest7759-21kworker/0:300:10:040
189249986,2cyclictest29261-21kworker/0:122:20:280
189249986,2cyclictest1756-21kworker/0:222:00:560
189249986,2cyclictest11146-21kworker/0:423:45:360
189249986,2cyclictest11146-21kworker/0:400:16:120
189249986,2cyclictest10775-21kworker/0:221:36:220
189249986,1cyclictest12220-21lspci22:36:490
189249985,3cyclictest19653-21kworker/0:021:25:220
189249985,2cyclictest7759-21kworker/0:300:05:040
189249984,3cyclictest29776-21kworker/0:321:54:220
189279976,0cyclictest0-21swapper/322:11:133
189279975,1cyclictest10959-21lspci22:30:353
189279974,2cyclictest649-21avahi-daemon21:50:383
189279973,3cyclictest681-21gdbus21:45:223
189269976,0cyclictest0-21swapper/220:50:392
189269975,1cyclictest649-21avahi-daemon21:22:202
189269975,1cyclictest2035-21sshd00:05:302
189269975,1cyclictest16269-21lspci23:20:262
189269974,2cyclictest700-21gdbus23:25:522
189269974,1cyclictest30310-21sshd23:55:322
189269974,1cyclictest20798-21sshd22:10:092
189269973,1cyclictest0-21swapper/222:16:142
189269972,3cyclictest503-21sshd23:40:242
189269972,2cyclictest3819-21sshd21:09:382
189259975,1cyclictest648-21systemd-logind22:31:201
189259975,1cyclictest620-13audispd21:25:061
189259975,1cyclictest28091-21lspci23:52:201
189259975,1cyclictest27114-21lspci21:58:241
189259975,1cyclictest18001-21sshd22:15:561
189259974,2cyclictest29790-21sshd21:18:541
189249975,2cyclictest5289-21kworker/0:422:40:080
189249975,2cyclictest22278-21kworker/0:122:46:160
189279965,0cyclictest0-21swapper/320:55:233
189279963,2cyclictest17299-21snmpd20:15:063
189279960,5cyclictest0-21swapper/321:08:023
189279960,0cyclictest0-21swapper/320:46:523
189269964,1cyclictest17299-21snmpd20:29:452
189269960,5cyclictest0-21swapper/220:01:192
189269960,0cyclictest0-21swapper/220:10:292
189269960,0cyclictest0-21swapper/219:10:292
189259964,1cyclictest6054-21mii-tool19:55:141
189259964,1cyclictest6054-21mii-tool19:55:141
189259963,2cyclictest17299-21snmpd20:11:271
189259963,2cyclictest17299-21snmpd19:52:201
189259963,2cyclictest17299-21snmpd19:49:501
189259960,5cyclictest0-21swapper/120:41:041
189249965,0cyclictest0-21swapper/020:00:230
189249964,1cyclictest17299-21snmpd20:41:520
189249963,2cyclictest646-21dbus-daemon20:40:000
189249963,2cyclictest17299-21snmpd19:23:190
189279954,0cyclictest0-21swapper/320:22:323
189279953,1cyclictest646-21dbus-daemon19:25:003
189279953,1cyclictest646-21dbus-daemon19:10:003
189279953,1cyclictest4056-21cat19:50:213
189279953,1cyclictest24177-21cat19:20:143
189279953,1cyclictest17299-21snmpd19:49:293
189279952,2cyclictest32702-21ntpq19:40:173
189279952,2cyclictest30935-21cat19:35:203
189279952,2cyclictest21025-21munin-node19:15:003
189279952,2cyclictest19332-21fw_packets20:35:133
189279951,2cyclictest30771-21sshd21:02:213
189279950,1cyclictest265092grep20:50:273
189279950,0cyclictest0-21swapper/320:27:323
189279950,0cyclictest0-21swapper/319:56:423
189279950,0cyclictest0-21swapper/319:56:423
189269953,1cyclictest17299-21snmpd20:20:422
189269953,1cyclictest17299-21snmpd20:18:272
189269953,1cyclictest17299-21snmpd20:05:362
189269953,1cyclictest17299-21snmpd19:55:082
189269953,1cyclictest17299-21snmpd19:55:082
189269953,1cyclictest17299-21snmpd19:41:022
189269953,1cyclictest17299-21snmpd19:36:052
189269953,1cyclictest17299-21snmpd19:30:492
189269953,1cyclictest17299-21snmpd19:27:402
189269953,1cyclictest17299-21snmpd19:22:042
189269953,1cyclictest1053-21lldpd19:45:062
189269952,2cyclictest17299-21snmpd20:56:582
189269952,2cyclictest17299-21snmpd20:45:102
189269950,4cyclictest19041-21/usr/sbin/munin20:35:152
189269950,1cyclictest29187-21/usr/sbin/munin21:00:162
189269950,1cyclictest0-21swapper/219:50:192
189269950,0cyclictest0-21swapper/220:31:402
189259954,0cyclictest0-21swapper/120:27:141
189259953,1cyclictest700-21gdbus19:20:011
189259953,1cyclictest29677-21cat21:00:151
189259953,1cyclictest27643-21cat20:55:141
189259953,1cyclictest26349-21timerwakeupswit20:50:261
189259953,1cyclictest20831-21sadc20:40:001
189259953,1cyclictest17299-21snmpd20:05:201
189259953,1cyclictest17299-21snmpd19:30:161
189259953,1cyclictest17299-21snmpd19:26:521
189259953,1cyclictest17299-21snmpd19:12:431
189259953,1cyclictest14836-21cat20:20:141
189259953,1cyclictest12803-21cat20:15:151
189259953,1cyclictest0-21swapper/120:30:081
189259952,2cyclictest9578-21cat20:05:001
189259952,2cyclictest646-21dbus-daemon19:15:001
189259952,2cyclictest24317-21wc20:45:211
189249955,0cyclictest31590-21kworker/0:020:10:100
189249955,0cyclictest31590-21kworker/0:019:55:000
189249955,0cyclictest31590-21kworker/0:019:40:180
189249955,0cyclictest28932-21kworker/0:021:00:120
189249955,0cyclictest14333-21kworker/0:220:32:220
189249954,0cyclictest0-21swapper/019:45:530
189249953,1cyclictest17299-21snmpd20:55:010
189249953,1cyclictest17299-21snmpd20:52:430
189249953,1cyclictest17299-21snmpd20:27:090
189249953,1cyclictest17299-21snmpd20:19:180
189249953,1cyclictest17299-21snmpd20:06:410
189249953,1cyclictest17299-21snmpd19:56:390
189249953,1cyclictest17299-21snmpd19:56:380
189249953,1cyclictest17299-21snmpd19:38:030
189249953,1cyclictest17299-21snmpd19:30:340
189249953,1cyclictest17299-21snmpd19:15:250
189249953,1cyclictest17299-21snmpd19:10:100
189249952,1cyclictest0-21swapper/020:24:560
189279942,1cyclictest7744-21tr20:00:133
189259942,1cyclictest32087-21expr19:40:131
189259942,1cyclictest30255-21if_eno119:35:141
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional