You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-11-23 - 17:03
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackaslot8.osadl.org (updated Sat Nov 23, 2024 12:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
150222295266,18sleep20-21swapper/207:06:252
150382281215,22sleep10-21swapper/107:06:361
151722279216,50sleep30-21swapper/307:08:223
151442271237,22sleep00-21swapper/007:08:000
20392650,0sleep00-21swapper/010:30:170
301852640,0sleep20-21swapper/211:40:142
292742630,0sleep00-21swapper/011:15:540
170802620,0sleep20-21swapper/212:35:162
118452590,0sleep10-21swapper/110:38:511
108452560,0sleep30-21swapper/311:02:433
206582550,0sleep00-21swapper/009:50:250
136142540,0sleep10-21swapper/112:11:411
58862190,0sleep10-21swapper/110:33:341
49032190,0sleep20-21swapper/207:55:142
163262190,0sleep20-21swapper/209:46:462
307332150,0sleep10-21swapper/112:01:391
301062140,0sleep20-21swapper/212:01:082
294252140,0sleep30-21swapper/312:22:043
15417991411,2cyclictest34-21ksoftirqd/307:15:013
143502130,0sleep10-21swapper/110:13:241
15417991210,1cyclictest34-21ksoftirqd/311:00:013
15417991210,1cyclictest34-21ksoftirqd/307:40:013
142202120,0chrt0-21swapper/012:12:120
1541799118,2cyclictest34-21ksoftirqd/307:15:013
247782100,0sleep10-21swapper/109:54:541
1541799109,1cyclictest34-21ksoftirqd/310:50:013
1541799108,2cyclictest34-21ksoftirqd/309:55:013
1541799108,1cyclictest34-21ksoftirqd/308:10:013
1541799107,2cyclictest34-21ksoftirqd/310:40:023
1540599109,1cyclictest12-21ksoftirqd/008:00:010
144912100,3sleep012-21ksoftirqd/010:13:350
154179998,1cyclictest34-21ksoftirqd/312:35:003
154179998,1cyclictest34-21ksoftirqd/310:05:013
154179998,1cyclictest34-21ksoftirqd/309:40:013
154179997,2cyclictest34-21ksoftirqd/312:20:013
154179997,2cyclictest34-21ksoftirqd/307:50:003
154179996,2cyclictest34-21ksoftirqd/311:45:003
154179994,1cyclictest34-21ksoftirqd/311:46:213
154099997,1cyclictest22-21ksoftirqd/110:20:011
154099996,2cyclictest30654-21snmpd10:03:311
154059997,1cyclictest12-21ksoftirqd/008:40:010
154059996,2cyclictest12-21ksoftirqd/010:50:000
154059994,3cyclictest19982-21systemd-journal08:07:430
154059993,3cyclictest19982-21systemd-journal11:01:050
655280,0sleep30-21swapper/311:19:533
154179987,1cyclictest34-21ksoftirqd/311:55:003
154179987,1cyclictest34-21ksoftirqd/309:34:593
154179987,1cyclictest34-21ksoftirqd/308:40:003
154179985,2cyclictest34-21ksoftirqd/312:40:013
154179985,2cyclictest34-21ksoftirqd/310:35:013
154179985,2cyclictest34-21ksoftirqd/310:05:143
154179983,3cyclictest19982-21systemd-journal10:37:063
154179983,3cyclictest19982-21systemd-journal07:25:363
154179980,1cyclictest5335-21diskmemload09:59:353
154179980,1cyclictest16964-21ssh12:14:333
154139987,1cyclictest28-21ksoftirqd/210:05:012
154139983,3cyclictest19982-21systemd-journal12:30:592
154139982,3cyclictest15474-21munin-run08:20:012
154139981,4cyclictest21578-21dump-pmu-power10:20:002
154139980,1cyclictest18629-21ssh11:32:452
154099985,2cyclictest508-21dbus-daemon12:15:581
154099984,3cyclictest19982-21systemd-journal10:57:241
154099983,3cyclictest19982-21systemd-journal07:33:071
154099982,3cyclictest13050-21cron11:04:591
154099981,4cyclictest11250-21sh09:15:001
154059986,1cyclictest24581-21ssh11:12:500
154059986,1cyclictest12-21ksoftirqd/010:40:010
154059985,2cyclictest12-21ksoftirqd/011:00:010
154059984,3cyclictest19982-21systemd-journal08:32:240
154059983,3cyclictest19982-21systemd-journal09:40:480
154059983,3cyclictest19982-21systemd-journal08:24:010
154059982,3cyclictest27974-21ls10:25:010
7338270,0sleep10-21swapper/111:46:101
26381270,0sleep00-21swapper/011:59:300
24833270,0sleep20-21swapper/211:13:062
15602270,0sleep20-21swapper/211:51:432
154179976,1cyclictest34-21ksoftirqd/310:30:003
154179976,1cyclictest34-21ksoftirqd/309:15:003
154179976,1cyclictest34-21ksoftirqd/309:00:013
154179976,1cyclictest34-21ksoftirqd/308:30:013
154179975,2cyclictest34-21ksoftirqd/311:10:003
154179975,2cyclictest34-21ksoftirqd/310:25:003
154179975,1cyclictest34-21ksoftirqd/312:00:013
154179975,1cyclictest34-21ksoftirqd/311:40:003
154179974,2cyclictest34-21ksoftirqd/308:00:013
154179973,3cyclictest508-21dbus-daemon09:17:003
154179973,3cyclictest30654-21snmpd09:02:563
154179973,3cyclictest30654-21snmpd08:19:343
154179973,3cyclictest21992-21ntpq07:20:193
154179973,3cyclictest17036-21ntpq10:15:203
154179973,3cyclictest0-21swapper/311:26:203
154179973,1cyclictest141rcu_preempt09:40:123
154179972,3cyclictest19982-21systemd-journal09:26:343
154139976,1cyclictest28-21ksoftirqd/207:55:012
154139973,3cyclictest508-21dbus-daemon09:26:352
154139973,3cyclictest30654-21snmpd10:10:192
154139973,3cyclictest30654-21snmpd08:22:522
154139973,3cyclictest25864-21diskstats07:30:142
154139973,3cyclictest22802-21diskstats08:35:132
154139973,3cyclictest2198-21fw_packets10:30:182
154139973,3cyclictest0-21swapper/210:21:082
154139973,1cyclictest0-21swapper/210:50:042
154139971,5cyclictest9383-21sshd11:26:252
154099974,2cyclictest809-21dump-pmu-power11:20:001
154099974,2cyclictest508-21dbus-daemon09:49:331
154099974,2cyclictest20232sleep107:50:101
154099973,3cyclictest508-21dbus-daemon10:00:001
154099973,3cyclictest29360-21cracklib-runtim07:36:201
154099973,3cyclictest21537-21sed08:30:221
154099973,3cyclictest19982-21systemd-journal12:26:121
154099973,3cyclictest19982-21systemd-journal08:58:131
154099973,3cyclictest0-21swapper/111:54:041
154099973,1cyclictest0-21swapper/110:54:121
154099972,4cyclictest22-21ksoftirqd/110:05:161
154099972,3cyclictest19982-21systemd-journal08:28:361
154099972,3cyclictest19982-21systemd-journal07:25:101
154099971,4cyclictest19982-21systemd-journal12:07:381
154099970,6cyclictest1885-21/usr/sbin/munin09:35:121
154099970,3cyclictest11632-21/usr/sbin/munin09:15:181
154059974,2cyclictest508-21dbus-daemon12:28:540
154059974,2cyclictest508-21dbus-daemon12:22:140
154059974,2cyclictest19982-21systemd-journal11:26:060
154059973,3cyclictest8973-21grep10:35:210
154059973,3cyclictest5502-21sshd12:06:170
154059973,3cyclictest27958-21cron09:30:000
154059973,3cyclictest26153-21cat07:30:170
154059973,3cyclictest19982-21systemd-journal08:11:250
154059973,3cyclictest19982-21systemd-journal07:50:010
154059973,3cyclictest15049-21users08:15:230
154059973,3cyclictest0-21swapper/011:22:320
154059973,1cyclictest0-21swapper/010:29:070
154059972,3cyclictest19982-21systemd-journal07:20:160
154059971,2cyclictest19982-21systemd-journal08:48:370
19679260,0sleep30-21swapper/309:21:043
154179966,0cyclictest0-21swapper/309:46:223
154179965,1cyclictest34-21ksoftirqd/308:00:013
154179964,1cyclictest1585-21hddtemp_smartct12:25:143
154179963,2cyclictest668-21runrttasks09:09:523
154179963,2cyclictest668-21runrttasks08:13:393
154179963,2cyclictest26371-21wc10:50:173
154179963,2cyclictest25678-21ls08:40:173
154179963,2cyclictest13956-21ssh11:30:073
154179963,2cyclictest11736-21in:imuxsock11:20:033
154179962,3cyclictest508-21dbus-daemon11:10:013
154179962,3cyclictest30654-21snmpd08:52:263
154179962,3cyclictest30654-21snmpd07:40:393
154179962,3cyclictest20995-21memory08:30:173
154179962,3cyclictest1-21systemd07:32:423
154179962,3cyclictest10493-21expr10:10:173
154179962,1cyclictest141rcu_preempt07:50:093
154179962,0cyclictest34-21ksoftirqd/312:00:213
154179960,4cyclictest19982-21systemd-journal08:45:173
154179960,1cyclictest141rcu_preempt12:07:383
154179960,0cyclictest0-21swapper/308:20:133
154139963,3cyclictest28-21ksoftirqd/211:00:122
154139963,2cyclictest508-21dbus-daemon09:06:342
154139963,2cyclictest4220-21sort10:05:002
154139963,2cyclictest31165-21rt-features07:40:182
154139963,2cyclictest29608-21sendmail_mailst10:25:202
154139963,2cyclictest25666-21apt-get12:20:122
154139963,2cyclictest22230-21sh11:35:142
154139963,2cyclictest16209-21expr07:10:142
154139963,2cyclictest13745-21cstates10:40:132
154139963,2cyclictest1318-21cat11:20:122
154139963,2cyclictest10783-21cut12:10:142
154139963,2cyclictest0-21swapper/210:35:022
154139963,2cyclictest0-21swapper/207:40:002
154139962,3cyclictest994-21tr07:45:212
154139962,3cyclictest9312-21cat08:05:122
154139962,3cyclictest30654-21snmpd09:22:112
154139962,3cyclictest30654-21snmpd08:52:022
154139962,3cyclictest30654-21snmpd08:14:042
154139962,3cyclictest30654-21snmpd07:22:122
154139962,3cyclictest29426-21ntpq09:30:242
154139962,3cyclictest25721-21which08:40:182
154139962,3cyclictest18339-21expr08:25:112
154139962,3cyclictest1-21systemd10:58:232
154139962,3cyclictest11640-21basename09:15:102
154139962,3cyclictest0-21swapper/211:45:062
154139962,2cyclictest19982-21systemd-journal09:00:392
154139962,1cyclictest0-21swapper/212:26:062
154139962,1cyclictest0-21swapper/212:05:082
154139962,1cyclictest0-21swapper/211:56:222
154139962,1cyclictest0-21swapper/211:15:452
154139962,1cyclictest0-21swapper/209:50:312
154139962,1cyclictest0-21swapper/209:41:042
154139962,1cyclictest0-21swapper/209:38:302
154139961,2cyclictest19982-21systemd-journal09:59:592
154139960,6cyclictest0-21swapper/211:05:332
154139960,5cyclictest18798-21apt-key10:45:022
154139960,3cyclictest17974-21/usr/sbin/munin12:15:142
154099964,2cyclictest22-21ksoftirqd/111:13:241
154099963,2cyclictest508-21dbus-daemon10:45:021
154099963,2cyclictest30869-21ssh09:31:201
154099963,2cyclictest30654-21snmpd11:55:491
154099963,2cyclictest30654-21snmpd08:00:041
154099963,2cyclictest29741-11brltty08:36:571
154099963,2cyclictest26319-21taskset08:41:151
154099963,2cyclictest22-21ksoftirqd/108:20:001
154099963,2cyclictest21306-21expr07:20:131
154099962,4cyclictest22-21ksoftirqd/108:50:431
154099962,3cyclictest7661-21lldpd08:09:431
154099962,3cyclictest30654-21snmpd12:30:091
154099962,3cyclictest30654-21snmpd11:20:161
154099962,3cyclictest30654-21snmpd10:20:081
154099962,3cyclictest30654-21snmpd08:48:351
154099962,3cyclictest30654-21snmpd08:13:421
154099962,3cyclictest30654-21snmpd07:55:091
154099962,3cyclictest30654-21snmpd07:45:271
154099962,3cyclictest26002-21cat12:20:131
154099962,3cyclictest19465-21sshd09:20:491
154099962,3cyclictest16422-21cat08:20:141
154099962,3cyclictest1-21systemd12:36:001
154099962,1cyclictest0-21swapper/111:35:341
154099962,1cyclictest0-21swapper/111:25:271
154099962,1cyclictest0-21swapper/111:05:041
154099962,1cyclictest0-21swapper/110:40:091
154099962,1cyclictest0-21swapper/110:27:141
154099962,1cyclictest0-21swapper/109:27:441
154099961,4cyclictest0-21swapper/111:40:401
154099961,3cyclictest19982-21systemd-journal07:40:381
154099961,2cyclictest7661-21lldpd11:30:011
154099960,2cyclictest4391-21pmu-power09:05:161
154099960,2cyclictest19982-21systemd-journal09:40:531
154059966,0cyclictest0-21swapper/011:40:430
154059963,2cyclictest9790-21cut10:10:010
154059963,2cyclictest9292-21sh12:30:170
154059963,2cyclictest5908-21mailstats11:45:200
154059963,2cyclictest5335-21diskmemload09:18:290
154059963,2cyclictest508-21dbus-daemon08:04:480
154059963,2cyclictest29782-21cat08:50:150
154059963,2cyclictest26107-21df10:50:160
154059963,2cyclictest25945-21hddtemp_smartct09:55:150
154059963,2cyclictest24892-21sh11:36:320
154059963,2cyclictest20479-21sh12:37:130
154059963,2cyclictest12-21ksoftirqd/008:45:010
154059963,2cyclictest12-21ksoftirqd/007:15:000
154059963,1cyclictest0-21swapper/012:15:060
154059962,3cyclictest31533-21fschecks_time10:00:130
154059962,3cyclictest30654-21snmpd12:01:170
154059962,3cyclictest30654-21snmpd11:30:120
154059962,3cyclictest30654-21snmpd10:19:170
154059962,3cyclictest30654-21snmpd08:27:190
154059962,3cyclictest30654-21snmpd07:10:200
154059962,3cyclictest30578-21expr07:40:140
154059962,3cyclictest28506-21cat09:30:190
154059962,3cyclictest2723-21cat07:50:130
154059962,3cyclictest0-21swapper/011:50:080
154059962,3cyclictest0-21swapper/009:10:080
154059962,1cyclictest0-21swapper/009:20:280
154059961,3cyclictest19982-21systemd-journal07:25:220
154059960,6cyclictest0-21swapper/009:35:090
154059960,5cyclictest14022-21cstates09:45:120
154059960,4cyclictest19982-21systemd-journal08:59:020
154139952,2cyclictest30654-21snmpd09:10:142
154139952,2cyclictest23667-21fschecks_count07:25:132
154139952,2cyclictest20795-21hddtemp_smartct08:30:152
154139952,2cyclictest17941-21dpkg07:15:012
154139951,3cyclictest508-21dbus-daemon08:00:012
154139951,3cyclictest31926-21hddtemp_smartct08:55:142
154139951,3cyclictest28386-21/usr/sbin/munin08:45:192
154099952,2cyclictest30654-21snmpd09:00:051
154099950,4cyclictest17581-21apt-get07:15:011
154099950,3cyclictest19982-21systemd-journal07:10:101
154059952,2cyclictest3585-21cat09:05:120
154059952,2cyclictest1350-21cat09:00:120
154059951,3cyclictest13909-21/usr/sbin/munin11:05:130
154059951,2cyclictest502-21systemd-logind07:35:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional