You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-16 - 08:13
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackaslot8.osadl.org (updated Mon Jul 15, 2024 12:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
38362312277,22sleep20-21swapper/207:09:472
36612275241,22sleep10-21swapper/107:07:361
36302267234,20sleep30-21swapper/307:07:143
37022255222,21sleep00-21swapper/007:08:080
110562600,1sleep2271rcuc/210:27:432
122422550,0sleep00-21swapper/007:20:290
211402530,0sleep20-21swapper/212:35:002
215162520,0sleep10-21swapper/111:07:421
169692200,0sleep30-21swapper/310:03:183
195062160,0sleep10-21swapper/109:33:511
396399129,2cyclictest12-21ksoftirqd/009:10:000
396999105,3cyclictest19982-21systemd-journal10:33:532
39749994,3cyclictest19982-21systemd-journal08:21:463
39699992,4cyclictest14926-21perf07:30:012
39659994,3cyclictest19982-21systemd-journal09:58:011
39659994,3cyclictest19982-21systemd-journal09:20:011
39639994,3cyclictest19982-21systemd-journal12:15:160
39639994,3cyclictest19982-21systemd-journal07:10:190
39749983,3cyclictest19982-21systemd-journal11:15:533
39749983,3cyclictest19982-21systemd-journal10:45:593
39749983,3cyclictest19982-21systemd-journal08:37:193
39699983,3cyclictest7661-21lldpd08:22:552
39699983,3cyclictest19982-21systemd-journal07:11:572
39699982,3cyclictest26158-21dump-pmu-power07:55:002
39699980,7cyclictest15593-21ssh11:02:102
39659984,3cyclictest508-21dbus-daemon07:14:541
39659983,3cyclictest4872-21apt-get08:20:001
39659983,3cyclictest19982-21systemd-journal09:50:061
39659983,3cyclictest19982-21systemd-journal08:29:591
39639984,3cyclictest19982-21systemd-journal10:46:450
39639980,7cyclictest29985-21ssh09:44:280
39639980,7cyclictest0-21swapper/009:25:280
18947280,0sleep10-21swapper/112:32:361
39749974,2cyclictest29741-11brltty12:16:563
39749974,2cyclictest11736-21in:imuxsock10:58:063
39749974,2cyclictest11736-21in:imuxsock09:59:163
39749973,3cyclictest7656-21snmpd11:34:143
39749973,3cyclictest7656-21snmpd07:51:073
39749973,3cyclictest7656-21snmpd07:44:173
39749973,3cyclictest508-21dbus-daemon08:03:423
39749973,3cyclictest19982-21systemd-journal12:10:013
39749973,3cyclictest19982-21systemd-journal11:40:143
39749973,3cyclictest19982-21systemd-journal10:31:123
39749973,3cyclictest19982-21systemd-journal10:10:023
39749973,3cyclictest19982-21systemd-journal07:12:283
39749973,3cyclictest17198-21hddtemp_smartct08:45:153
39749973,3cyclictest17198-21hddtemp_smartct08:45:153
39749973,1cyclictest0-21swapper/311:25:063
39749973,1cyclictest0-21swapper/310:38:103
39749972,3cyclictest19982-21systemd-journal12:03:113
39749972,3cyclictest19982-21systemd-journal09:50:013
39749972,3cyclictest19982-21systemd-journal09:15:283
39749970,1cyclictest0-21swapper/310:15:053
39699975,1cyclictest15550-21dump-pmu-power09:29:592
39699974,2cyclictest19710-21cut12:05:202
39699974,2cyclictest11736-21in:imuxsock09:47:112
39699973,3cyclictest7656-21snmpd12:20:072
39699973,3cyclictest508-21dbus-daemon10:00:322
39699973,3cyclictest19982-21systemd-journal11:45:562
39699973,3cyclictest19982-21systemd-journal07:57:452
39699973,3cyclictest0-21swapper/212:35:192
39699973,3cyclictest0-21swapper/212:25:232
39699973,3cyclictest0-21swapper/211:51:062
39699973,3cyclictest0-21swapper/208:06:202
39699973,2cyclictest19982-21systemd-journal10:15:012
39699973,1cyclictest0-21swapper/209:17:452
39699972,3cyclictest19982-21systemd-journal08:30:492
39699971,5cyclictest15290-21grep11:30:262
39699971,4cyclictest19982-21systemd-journal08:42:052
39699971,3cyclictest26971-21rm11:12:332
39659974,2cyclictest31096-21sshd11:15:581
39659974,2cyclictest24177-21sort10:10:141
39659974,2cyclictest19982-21systemd-journal08:04:351
39659973,3cyclictest7656-21snmpd11:42:361
39659973,3cyclictest19982-21systemd-journal12:35:431
39659973,3cyclictest19982-21systemd-journal12:25:001
39659973,3cyclictest19982-21systemd-journal10:23:281
39659973,3cyclictest1-21systemd07:47:511
39659970,6cyclictest0-21swapper/111:15:001
39659970,3cyclictest19982-21systemd-journal09:19:541
39639975,2cyclictest12-21ksoftirqd/008:40:010
39639973,3cyclictest7656-21snmpd07:40:190
39639973,3cyclictest6263-21sshd10:23:460
39639973,3cyclictest508-21dbus-daemon10:43:040
39639973,3cyclictest508-21dbus-daemon10:40:010
39639973,3cyclictest508-21dbus-daemon07:20:000
39639973,3cyclictest502-21systemd-logind09:53:260
39639973,3cyclictest29741-11brltty09:33:490
39639973,3cyclictest19116-21gdbus09:40:000
39639972,3cyclictest19982-21systemd-journal10:59:450
39639970,4cyclictest26157-21munin-run07:55:010
27167270,0sleep00-21swapper/012:11:080
16371270,6sleep016380-21ssh10:33:220
39749966,0cyclictest0-21swapper/309:00:223
39749963,3cyclictest11736-21in:imuxsock08:16:393
39749963,2cyclictest6518-21ssh11:23:363
39749963,2cyclictest26757-21awk09:05:253
39749963,2cyclictest26210-21cat09:40:123
39749963,2cyclictest25689-21sh11:10:553
39749963,2cyclictest22443-21uniq07:45:173
39749963,2cyclictest11736-21in:imuxsock12:23:363
39749963,2cyclictest11736-21in:imuxsock11:36:033
39749963,2cyclictest11736-21in:imuxsock08:11:383
39749963,2cyclictest11736-21in:imuxsock07:40:013
39749963,2cyclictest11112-21fschecks_count09:25:173
39749963,2cyclictest10573-21sh12:25:213
39749962,3cyclictest9380-21which07:15:283
39749962,3cyclictest8560-21expr08:25:213
39749962,3cyclictest7656-21snmpd12:10:403
39749962,3cyclictest7656-21snmpd11:52:573
39749962,3cyclictest7656-21snmpd09:31:373
39749962,3cyclictest7656-21snmpd08:07:173
39749962,3cyclictest7656-21snmpd07:58:323
39749962,3cyclictest7656-21snmpd07:30:053
39749962,3cyclictest6351-21forks09:20:133
39749962,3cyclictest5345-21users09:50:333
39749962,3cyclictest3525-21tr10:20:283
39749962,3cyclictest28343-21expr09:10:173
39749962,3cyclictest24991-21mailstats10:10:263
39749962,3cyclictest23405-21expr10:40:133
39749962,3cyclictest21692-21cat09:35:253
39749962,3cyclictest21577-21expr08:55:123
39749962,3cyclictest21537-21cat12:35:123
39749962,3cyclictest19982-21systemd-journal11:55:453
39749962,3cyclictest18888-21cat11:05:193
39749962,3cyclictest15755-21df_inode12:30:113
39749962,3cyclictest15047-21cat08:40:173
39749962,3cyclictest14458-21awk07:25:283
39749962,3cyclictest13908-21awk11:00:303
39749962,3cyclictest10596-21cat08:30:223
39749962,1cyclictest0-21swapper/310:51:113
39749961,3cyclictest10392-21apt-get07:20:003
39749960,6cyclictest0-21swapper/308:50:163
39749960,2cyclictest7931-21cstates10:25:123
39749960,0cyclictest0-21swapper/311:46:013
39699966,0cyclictest0-21swapper/209:50:222
39699963,2cyclictest8515-21expr07:15:162
39699963,2cyclictest8042-21taskset09:21:002
39699963,2cyclictest668-21runrttasks11:20:112
39699963,2cyclictest508-21dbus-daemon07:49:062
39699963,2cyclictest29899-21rm09:10:372
39699963,2cyclictest28435-21sh09:41:412
39699963,2cyclictest20062-21ssh11:05:412
39699963,2cyclictest18074-21expr10:35:152
39699963,2cyclictest17357-21latency08:45:202
39699963,2cyclictest17357-21latency08:45:192
39699963,2cyclictest11736-21in:imuxsock10:59:182
39699963,1cyclictest0-21swapper/212:17:202
39699962,3cyclictest7656-21snmpd11:40:112
39699962,3cyclictest7656-21snmpd10:20:182
39699962,3cyclictest7656-21snmpd09:35:192
39699962,3cyclictest7656-21snmpd09:07:492
39699962,3cyclictest7656-21snmpd08:35:122
39699962,3cyclictest7656-21snmpd08:26:262
39699962,3cyclictest508-21dbus-daemon09:58:022
39699962,3cyclictest508-21dbus-daemon08:20:012
39699962,3cyclictest30743-21tr10:15:312
39699962,3cyclictest29532-21smartctl11:15:162
39699962,3cyclictest28122-21apt-get10:45:152
39699962,3cyclictest24267-21cat09:00:182
39699962,3cyclictest23013-21seq08:56:272
39699962,3cyclictest19982-21systemd-journal11:29:452
39699962,3cyclictest1623-21cat10:50:162
39699962,3cyclictest1-21systemd07:22:502
39699962,3cyclictest0-21swapper/210:06:052
39699962,2cyclictest19982-21systemd-journal07:35:242
39699962,1cyclictest0-21swapper/211:55:462
39699961,4cyclictest0-21swapper/212:10:132
39699961,3cyclictest19982-21systemd-journal10:40:102
39699961,3cyclictest19982-21systemd-journal07:41:352
39699960,6cyclictest0-21swapper/207:30:342
39699960,0cyclictest0-21swapper/212:01:502
39699960,0cyclictest0-21swapper/211:35:352
39659963,2cyclictest9549-21sed11:25:281
39659963,2cyclictest7656-21snmpd11:21:231
39659963,2cyclictest508-21dbus-daemon10:25:331
39659963,2cyclictest508-21dbus-daemon08:37:041
39659963,2cyclictest29676-21expr11:45:131
39659963,2cyclictest25413-21chrt09:03:241
39659963,2cyclictest19982-21systemd-journal08:10:001
39659963,2cyclictest11736-21in:imuxsock09:07:321
39659962,3cyclictest7661-21lldpd09:25:001
39659962,3cyclictest7661-21lldpd07:19:351
39659962,3cyclictest7656-21snmpd12:15:091
39659962,3cyclictest7656-21snmpd11:56:151
39659962,3cyclictest7656-21snmpd11:39:051
39659962,3cyclictest7656-21snmpd09:42:001
39659962,3cyclictest7656-21snmpd08:57:541
39659962,3cyclictest7656-21snmpd08:54:571
39659962,3cyclictest7656-21snmpd08:31:351
39659962,3cyclictest7656-21snmpd08:20:051
39659962,3cyclictest7656-21snmpd08:11:411
39659962,3cyclictest7656-21snmpd07:36:131
39659962,3cyclictest7656-21snmpd07:31:281
39659962,3cyclictest508-21dbus-daemon07:25:001
39659962,3cyclictest31512-21cat09:45:211
39659962,3cyclictest24677-21fw_packets07:50:141
39659962,3cyclictest20744-21dpkg09:35:161
39659962,3cyclictest20262-21grep07:40:181
39659962,3cyclictest19982-21systemd-journal12:26:461
39659962,3cyclictest19982-21systemd-journal08:49:111
39659962,3cyclictest19982-21systemd-journal08:49:101
39659962,3cyclictest18996-21cpuspeed12:05:131
39659962,3cyclictest14445-21cat11:30:171
39659962,3cyclictest13770-21expr10:00:141
39659962,3cyclictest13573-21cat10:30:221
39659962,3cyclictest0-21swapper/111:51:021
39659962,3cyclictest0-21swapper/110:51:081
39659962,1cyclictest0-21swapper/112:13:091
39659962,1cyclictest0-21swapper/111:01:181
39659962,1cyclictest0-21swapper/110:16:061
39659961,3cyclictest19982-21systemd-journal10:55:511
39659960,6cyclictest0-21swapper/110:05:351
39659960,5cyclictest28093-21/usr/sbin/munin10:45:161
39659960,5cyclictest12927-21/usr/sbin/munin07:25:131
39659960,2cyclictest22-21ksoftirqd/112:00:141
39659960,0cyclictest0-21swapper/110:35:471
39639964,1cyclictest9414-21smart_sda11:25:280
39639964,1cyclictest668-21runrttasks10:00:130
39639964,1cyclictest19322-21df12:05:140
39639963,2cyclictest7656-21snmpd07:48:440
39639963,2cyclictest31065-21expr09:45:150
39639963,2cyclictest25543-21sh10:10:360
39639963,2cyclictest17403-21sh12:30:470
39639963,2cyclictest10060-21sh11:56:410
39639963,1cyclictest0-21swapper/010:15:520
39639962,3cyclictest7656-21snmpd12:25:530
39639962,3cyclictest7656-21snmpd11:30:330
39639962,3cyclictest7656-21snmpd11:13:110
39639962,3cyclictest7656-21snmpd09:15:150
39639962,3cyclictest7656-21snmpd08:50:150
39639962,3cyclictest7656-21snmpd08:47:450
39639962,3cyclictest7656-21snmpd08:47:450
39639962,3cyclictest7656-21snmpd07:38:100
39639962,3cyclictest7656-21snmpd07:32:220
39639962,3cyclictest508-21dbus-daemon12:20:020
39639962,3cyclictest3133-21cat11:50:170
39639962,3cyclictest28750-21cat08:00:120
39639962,3cyclictest28345-21grep09:10:160
39639962,3cyclictest2612-21cat11:20:120
39639962,3cyclictest24577-21grep11:40:140
39639962,3cyclictest22370-21grep08:55:220
39639962,3cyclictest14763-21sh08:40:130
39639962,3cyclictest1407-21cut08:10:230
39639962,3cyclictest13612-21cat07:25:160
39639962,3cyclictest1-21systemd12:35:260
39639962,3cyclictest0-21swapper/011:48:430
39639962,3cyclictest0-21swapper/010:27:010
39639962,1cyclictest0-21swapper/011:09:240
39639962,1cyclictest0-21swapper/011:00:090
39639962,1cyclictest0-21swapper/010:54:160
39639961,3cyclictest25566-21munin-run09:05:000
39639961,3cyclictest19982-21systemd-journal08:35:000
39639961,3cyclictest19982-21systemd-journal08:19:330
39639960,6cyclictest0-21swapper/011:15:100
39639960,5cyclictest19008-21/usr/sbin/munin11:35:290
39639960,0cyclictest0-21swapper/012:00:230
39639960,0cyclictest0-21swapper/010:05:100
39699952,2cyclictest18873-21cpu08:50:122
39699952,2cyclictest15798-21ssh09:30:022
39699951,3cyclictest938-21expr08:10:142
39699951,3cyclictest29225-21cut08:00:152
39659952,2cyclictest23279-21ssh10:40:121
39659952,2cyclictest20378-1kworker/u9:109:10:061
39659952,2cyclictest14512-21expr08:40:121
39659951,3cyclictest7656-21snmpd07:55:151
39639952,2cyclictest7751-21cat08:25:130
39639952,2cyclictest7656-21snmpd09:55:050
39639952,2cyclictest5148-21dpkg08:20:000
39639952,2cyclictest31095-21seq08:05:140
39639952,2cyclictest27084-21cat07:55:180
39639951,3cyclictest7656-21snmpd09:20:110
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional