You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-04-02 - 06:51
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackaslot8.osadl.org (updated Wed Apr 02, 2025 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
122922274239,23sleep10-21swapper/119:08:131
121392269235,22sleep30-21swapper/319:06:143
123902265214,17sleep20-21swapper/219:09:312
122562265232,21sleep00-21swapper/019:07:430
111312630,0sleep30-21swapper/323:38:393
257192570,0sleep20-21swapper/200:14:382
236322570,0sleep30-21swapper/321:50:163
62752560,0sleep00-21swapper/000:24:400
5992560,0sleep00-21swapper/023:30:510
137522560,0sleep00-21swapper/019:10:200
276052530,1sleep20-21swapper/219:40:172
212172220,0sleep00-21swapper/022:12:110
7202180,0sleep30-21swapper/323:30:583
168622180,0sleep10-21swapper/100:33:431
138552180,0sleep10-21swapper/122:30:141
300742160,0sleep20-21swapper/222:41:122
313502150,0sleep00-21swapper/022:19:440
206002150,0sleep20-21swapper/220:45:152
308202130,0sleep20-21swapper/223:53:112
158462130,0sleep20-21swapper/222:55:142
1253399129,1cyclictest19982-21systemd-journal23:15:401
1252999118,2cyclictest12-21ksoftirqd/023:45:000
1253399109,1cyclictest22-21ksoftirqd/120:35:001
4795290,0sleep30-21swapper/321:36:523
125429996,2cyclictest30654-21snmpd00:19:313
125429990,2cyclictest19372-21awk19:20:213
125389998,1cyclictest28-21ksoftirqd/220:35:002
125389996,2cyclictest19982-21systemd-journal00:10:002
16677280,0sleep30-21swapper/322:09:423
125429983,3cyclictest19982-21systemd-journal23:25:163
125429983,3cyclictest19982-21systemd-journal19:31:373
125389985,2cyclictest12657-21cron23:40:012
125389985,2cyclictest1045-21grep23:55:122
125339983,3cyclictest19982-21systemd-journal19:55:491
125339981,3cyclictest508-21dbus-daemon22:00:011
125299983,3cyclictest19982-21systemd-journal22:08:300
125299982,3cyclictest21740-21ls21:50:010
4628270,1sleep2271rcuc/222:47:212
125429974,2cyclictest11736-21in:imuxsock19:58:453
125429973,3cyclictest8847-21cut20:15:163
125429973,3cyclictest508-21dbus-daemon21:05:013
125429973,3cyclictest508-21dbus-daemon20:45:033
125429973,3cyclictest508-21dbus-daemon20:32:563
125429973,3cyclictest30654-21snmpd22:46:513
125429973,3cyclictest30654-21snmpd20:07:303
125429973,3cyclictest19982-21systemd-journal19:49:343
125429973,3cyclictest10925-21fschecks_count23:15:153
125429973,3cyclictest0-21swapper/323:56:523
125429973,1cyclictest0-21swapper/322:56:553
125429973,1cyclictest0-21swapper/322:22:233
125429973,1cyclictest0-21swapper/321:59:263
125429973,1cyclictest0-21swapper/300:38:023
125429973,1cyclictest0-21swapper/300:20:463
125429973,1cyclictest0-21swapper/300:13:593
125429972,3cyclictest19982-21systemd-journal23:44:283
125429972,3cyclictest19982-21systemd-journal21:12:353
125389974,2cyclictest30654-21snmpd22:34:392
125389974,2cyclictest11736-21in:imuxsock22:52:192
125389973,3cyclictest0-21swapper/200:01:142
125389973,2cyclictest508-21dbus-daemon00:29:562
125389972,3cyclictest3181-21expr23:10:092
125389972,3cyclictest19982-21systemd-journal00:35:002
125389971,0cyclictest141rcu_preempt20:35:122
125389970,5cyclictest19982-21systemd-journal21:23:002
125389970,2cyclictest19982-21systemd-journal00:25:002
125339974,2cyclictest1-21systemd21:08:491
125339973,3cyclictest508-21dbus-daemon23:46:081
125339973,3cyclictest508-21dbus-daemon20:42:081
125339973,3cyclictest30654-21snmpd22:52:501
125339973,3cyclictest19982-21systemd-journal23:27:451
125339973,3cyclictest19982-21systemd-journal21:15:551
125339973,3cyclictest0-21swapper/123:58:111
125339973,3cyclictest0-21swapper/121:49:541
125339973,1cyclictest0-21swapper/123:51:211
125339973,1cyclictest0-21swapper/123:36:071
125339973,1cyclictest0-21swapper/123:34:151
125339973,1cyclictest0-21swapper/123:09:061
125339972,4cyclictest19116-21gdbus22:25:011
125339972,2cyclictest20258-21awk21:25:011
125299974,2cyclictest508-21dbus-daemon00:13:400
125299974,2cyclictest19982-21systemd-journal20:00:330
125299974,2cyclictest12656-21cron23:40:010
125299974,2cyclictest12-21ksoftirqd/020:05:510
125299974,2cyclictest11736-21in:imuxsock23:28:110
125299974,2cyclictest11736-21in:imuxsock00:30:450
125299973,3cyclictest508-21dbus-daemon21:00:000
125299973,3cyclictest30654-21snmpd21:30:050
125299973,3cyclictest30654-21snmpd20:47:000
125299973,3cyclictest15505-21smart_sda19:15:020
125299973,3cyclictest1-21systemd19:28:430
125299973,3cyclictest11701-21cron00:29:590
125299973,1cyclictest0-21swapper/023:50:500
125299973,1cyclictest0-21swapper/022:48:350
125299973,1cyclictest0-21swapper/022:37:130
125299973,1cyclictest0-21swapper/021:27:540
125299972,2cyclictest0-21swapper/021:57:330
125299971,4cyclictest19982-21systemd-journal20:10:510
125299971,3cyclictest29961-21rm23:05:160
125299970,4cyclictest7629-21dump-pmu-power00:00:000
125429963,2cyclictest4780-21df22:00:123
125429963,2cyclictest34-21ksoftirqd/321:22:533
125429963,2cyclictest34-21ksoftirqd/300:30:153
125429963,2cyclictest30918-21rm22:41:593
125429963,2cyclictest29101-21cstates21:05:143
125429963,2cyclictest27802-21ssh23:50:233
125429963,2cyclictest27608-21pmu-power21:30:183
125429963,2cyclictest25581-21ssh23:01:263
125429963,2cyclictest16548-21ssh21:45:233
125429963,1cyclictest0-21swapper/319:15:223
125429962,3cyclictest8160-21ls20:15:003
125429962,3cyclictest30654-21snmpd23:47:243
125429962,3cyclictest30654-21snmpd23:22:053
125429962,3cyclictest30654-21snmpd20:52:463
125429962,3cyclictest30654-21snmpd20:01:293
125429962,3cyclictest30654-21snmpd19:35:233
125429962,3cyclictest19966-21date19:25:003
125429962,3cyclictest13538-21cat22:30:123
125429962,3cyclictest13251-21wc20:30:003
125429962,3cyclictest10687-21cpuspeed20:20:133
125429962,3cyclictest0-21swapper/322:18:573
125429962,1cyclictest0-21swapper/323:10:023
125429962,1cyclictest0-21swapper/322:52:343
125429962,1cyclictest0-21swapper/322:29:523
125429962,1cyclictest0-21swapper/322:11:403
125429962,1cyclictest0-21swapper/321:40:143
125429962,1cyclictest0-21swapper/321:25:293
125429962,1cyclictest0-21swapper/300:28:583
125429961,4cyclictest0-21swapper/300:02:273
125429961,1cyclictest25327-21missed_timers20:55:173
125429960,6cyclictest0-21swapper/320:40:143
125429960,3cyclictest20948-21cut22:35:153
125429960,2cyclictest424-21grep19:50:273
125429960,0cyclictest0-21swapper/300:05:403
125389966,0cyclictest0-21swapper/221:46:292
125389966,0cyclictest0-21swapper/200:15:022
125389963,2cyclictest668-21runrttasks23:20:152
125389963,2cyclictest668-21runrttasks22:36:482
125389963,2cyclictest6079-21sh21:15:062
125389963,2cyclictest3151-21ssh21:35:252
125389963,2cyclictest31151-21rm21:10:042
125389963,2cyclictest30842-21diskmemload23:00:282
125389963,2cyclictest30654-21snmpd23:40:532
125389963,2cyclictest30654-21snmpd19:35:172
125389963,2cyclictest30075-21ntpq19:45:172
125389963,2cyclictest29115-21sh21:31:112
125389963,2cyclictest25185-21ssh23:25:212
125389963,2cyclictest18736-21ntpq19:20:182
125389963,2cyclictest12956-21cstates19:10:142
125389963,2cyclictest10788-21cut20:20:122
125389962,3cyclictest9057-21cat20:15:162
125389962,3cyclictest6833-21cat20:10:132
125389962,3cyclictest508-21dbus-daemon19:31:132
125389962,3cyclictest30654-21snmpd22:06:342
125389962,3cyclictest30654-21snmpd21:25:232
125389962,3cyclictest30654-21snmpd20:00:082
125389962,3cyclictest30654-21snmpd19:56:052
125389962,3cyclictest30177-21basename21:55:172
125389962,3cyclictest22810-21cat21:50:112
125389962,3cyclictest20677-21cat19:25:162
125389962,3cyclictest19982-21systemd-journal20:53:492
125389962,3cyclictest17975-21wc20:40:142
125389962,3cyclictest10128-21apt-config23:15:012
125389962,3cyclictest0-21swapper/222:25:442
125389962,1cyclictest0-21swapper/223:45:212
125389962,1cyclictest0-21swapper/223:06:202
125389962,1cyclictest0-21swapper/222:15:112
125389962,1cyclictest0-21swapper/222:02:012
125389961,3cyclictest19982-21systemd-journal21:42:382
125389961,3cyclictest19982-21systemd-journal21:09:322
125389961,3cyclictest19982-21systemd-journal20:55:042
125389961,3cyclictest19982-21systemd-journal19:15:462
125389961,3cyclictest19982-21systemd-journal00:36:362
125389961,2cyclictest30569-21ssh23:30:042
125389960,3cyclictest32134-21/usr/sbin/munin22:20:162
125339966,0cyclictest0-21swapper/120:55:171
125339964,2cyclictest11736-21in:imuxsock23:10:151
125339964,2cyclictest11736-21in:imuxsock20:55:011
125339964,1cyclictest18389-21grep19:20:161
125339963,2cyclictest668-21runrttasks20:11:071
125339963,2cyclictest508-21dbus-daemon21:02:331
125339963,2cyclictest30654-21snmpd00:21:011
125339963,2cyclictest28143-21cut19:40:211
125339963,2cyclictest22-21ksoftirqd/123:00:151
125339963,2cyclictest21124-21uname19:25:201
125339963,2cyclictest11736-21in:imuxsock21:35:571
125339962,3cyclictest5433-21ntpq22:00:151
125339962,3cyclictest30654-21snmpd21:10:581
125339962,3cyclictest30654-21snmpd20:36:511
125339962,3cyclictest30654-21snmpd20:26:391
125339962,3cyclictest30654-21snmpd20:15:421
125339962,3cyclictest30654-21snmpd19:50:141
125339962,3cyclictest30654-21snmpd19:45:411
125339962,3cyclictest30654-21snmpd19:38:081
125339962,3cyclictest30654-21snmpd00:37:111
125339962,3cyclictest25423-21sh22:15:151
125339962,3cyclictest21109-21which00:10:151
125339962,3cyclictest0-21swapper/121:53:111
125339962,1cyclictest0-21swapper/123:41:581
125339962,1cyclictest0-21swapper/123:21:491
125339962,1cyclictest0-21swapper/122:55:181
125339962,1cyclictest0-21swapper/122:46:311
125339962,1cyclictest0-21swapper/122:40:091
125339962,1cyclictest0-21swapper/122:11:011
125339962,1cyclictest0-21swapper/122:05:401
125339962,1cyclictest0-21swapper/100:27:571
125339962,1cyclictest0-21swapper/100:05:111
125339962,1cyclictest0-21swapper/100:00:541
125339961,3cyclictest19982-21systemd-journal22:35:121
125339961,2cyclictest9953-21ssh22:27:491
125339960,6cyclictest0-21swapper/121:40:461
125339960,6cyclictest0-21swapper/121:31:371
125339960,6cyclictest0-21swapper/121:28:221
125339960,6cyclictest0-21swapper/119:30:371
125339960,4cyclictest19982-21systemd-journal19:13:421
125339960,3cyclictest7661-21lldpd20:06:431
125339960,2cyclictest27565-21ntp_states00:15:201
125299964,1cyclictest19820-21dump-pmu-power20:45:010
125299963,2cyclictest668-21runrttasks19:35:220
125299963,2cyclictest657-21cat22:20:170
125299963,2cyclictest30654-21snmpd19:20:280
125299963,2cyclictest27401-21sh22:40:080
125299963,2cyclictest23810-21sh21:50:170
125299963,2cyclictest19982-21systemd-journal20:50:280
125299963,2cyclictest16513-21sh21:21:350
125299963,2cyclictest14594-21ssh22:30:220
125299963,2cyclictest10097-21ssh21:40:190
125299963,2cyclictest0-21swapper/020:30:160
125299963,1cyclictest30842-21diskmemload22:01:500
125299962,3cyclictest7821-21ssh22:25:520
125299962,3cyclictest30654-21snmpd23:10:190
125299962,3cyclictest30654-21snmpd21:17:550
125299962,3cyclictest30654-21snmpd21:05:160
125299962,3cyclictest30654-21snmpd21:00:370
125299962,3cyclictest30654-21snmpd20:25:090
125299962,3cyclictest30654-21snmpd20:24:450
125299962,3cyclictest30654-21snmpd19:56:560
125299962,3cyclictest30654-21snmpd19:43:400
125299962,3cyclictest30654-21snmpd00:05:190
125299962,3cyclictest26626-21cpuspeed00:15:140
125299962,3cyclictest24136-21cat23:00:190
125299962,3cyclictest22842-21basename19:30:190
125299962,3cyclictest18040-21expr23:20:150
125299962,3cyclictest0-21swapper/023:15:160
125299962,3cyclictest0-21swapper/000:00:100
125299962,1cyclictest0-21swapper/022:57:390
125299961,2cyclictest4859-21kworker/u8:121:10:170
125299961,2cyclictest1147-21ssh21:35:020
125299960,3cyclictest21412-21rm23:46:100
125299960,3cyclictest17899-21rm00:35:060
125299960,2cyclictest8930-21hddtemp_smartct22:50:110
125429952,2cyclictest5995-21ssh21:15:033
125429952,2cyclictest26924-21cat19:40:133
125429952,2cyclictest16693-21which20:35:173
125429951,3cyclictest29911-21ssh23:05:143
125429951,3cyclictest13410-21cat19:10:173
125389952,2cyclictest31629-21expr19:50:202
125389951,3cyclictest30654-21snmpd22:10:072
125389951,3cyclictest29741-11brltty20:05:512
125389951,2cyclictest502-21systemd-logind20:26:172
125389951,2cyclictest19982-21systemd-journal21:00:012
125339953,1cyclictest20175-21cpuspeed_turbos20:45:141
125339952,2cyclictest4026-21cat20:00:161
125339952,2cyclictest15172-21cat19:15:021
125339951,3cyclictest10828-21cat20:20:141
125299952,2cyclictest31494-21cut19:50:190
125299951,3cyclictest8683-21cat20:15:150
125299951,3cyclictest30654-21snmpd20:35:090
125299951,3cyclictest30654-21snmpd19:45:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional