You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-12-21 - 13:23
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackaslot8.osadl.org (updated Sat Dec 21, 2024 00:44:25)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
293212337308,18sleep20-21swapper/219:05:132
310442281248,21sleep30-21swapper/319:06:583
312302265229,22sleep00-21swapper/019:09:250
310522261225,22sleep10-21swapper/119:07:041
290352590,0sleep10-21swapper/121:15:091
70312580,0sleep00-21swapper/021:46:250
133712570,0sleep30-21swapper/323:53:253
296962560,0sleep10-21swapper/122:27:061
71442550,0sleep00-21swapper/022:34:580
217852550,1sleep30-21swapper/323:10:133
135382510,0sleep20-21swapper/219:40:012
7412170,4sleep122-21ksoftirqd/120:20:201
191192150,0sleep00-21swapper/021:30:550
64442140,0sleep10-21swapper/122:58:461
246962140,0sleep30-21swapper/322:48:303
3139999100,9cyclictest23649-21sed21:10:200
250342100,0sleep10-21swapper/121:11:371
314079994,3cyclictest19982-21systemd-journal19:53:382
314079990,8cyclictest22141-21sh00:26:492
313999994,3cyclictest19982-21systemd-journal23:44:210
20637290,0sleep00-21swapper/023:34:280
314129983,3cyclictest19982-21systemd-journal20:16:113
314079985,2cyclictest502-21systemd-logind22:16:442
314079983,4cyclictest0-21swapper/222:00:032
314079983,3cyclictest19982-21systemd-journal23:42:412
314079983,3cyclictest19982-21systemd-journal22:05:302
314039983,3cyclictest19982-21systemd-journal20:52:021
313999987,1cyclictest121ksoftirqd/020:35:010
313999986,1cyclictest12-21ksoftirqd/019:15:010
313999984,3cyclictest19982-21systemd-journal22:52:370
313999983,3cyclictest19982-21systemd-journal20:46:120
313999980,5cyclictest27422-21idleruntime-cro23:15:010
26256280,0sleep30-21swapper/322:00:133
1972280,0sleep10-21swapper/119:15:021
1689280,0sleep30-21swapper/322:55:153
314129976,1cyclictest0-21swapper/319:20:133
314129973,3cyclictest9265-21ntp_states23:00:163
314129973,3cyclictest30654-21snmpd20:28:003
314129973,3cyclictest19982-21systemd-journal22:20:013
314129973,3cyclictest19982-21systemd-journal20:39:403
314129973,3cyclictest1-21systemd22:28:513
314129973,3cyclictest0-21swapper/323:15:383
314129973,3cyclictest0-21swapper/323:15:383
314129973,1cyclictest0-21swapper/322:08:123
314129973,1cyclictest0-21swapper/300:34:483
314129973,1cyclictest0-21swapper/300:10:173
314129973,1cyclictest0-21swapper/300:09:393
314129972,3cyclictest7661-21lldpd22:53:363
314129972,3cyclictest19982-21systemd-journal21:57:333
314129970,3cyclictest15470-21memory23:30:123
314079973,3cyclictest508-21dbus-daemon21:30:012
314079973,3cyclictest508-21dbus-daemon20:30:002
314079973,3cyclictest508-21dbus-daemon20:10:012
314079973,3cyclictest30654-21snmpd00:18:582
314079973,3cyclictest19982-21systemd-journal22:32:422
314079973,3cyclictest19982-21systemd-journal20:38:412
314079973,3cyclictest19982-21systemd-journal20:05:012
314079973,3cyclictest0-21swapper/222:35:582
314079972,3cyclictest26239-21awk22:50:012
314079972,3cyclictest19982-21systemd-journal21:50:052
314079972,3cyclictest19982-21systemd-journal20:10:192
314079970,4cyclictest14864-21munin-run20:55:002
314079970,1cyclictest0-21swapper/223:23:472
314039974,2cyclictest19982-21systemd-journal19:51:401
314039974,2cyclictest11736-21in:imuxsock21:22:041
314039974,2cyclictest11736-21in:imuxsock19:40:431
314039973,3cyclictest508-21dbus-daemon21:35:001
314039973,3cyclictest30654-21snmpd23:25:001
314039973,3cyclictest30654-21snmpd22:44:321
314039973,3cyclictest30654-21snmpd00:18:411
314039973,3cyclictest26562-21sshd22:50:071
314039973,3cyclictest19982-21systemd-journal23:11:241
314039973,3cyclictest0-21swapper/122:21:201
314039973,2cyclictest19982-21systemd-journal21:07:281
314039973,1cyclictest0-21swapper/123:44:061
314039973,1cyclictest0-21swapper/122:46:391
314039972,3cyclictest19982-21systemd-journal22:35:111
314039972,3cyclictest19982-21systemd-journal19:30:011
314039971,3cyclictest29151-21rm21:38:421
313999973,3cyclictest508-21dbus-daemon23:58:330
313999973,3cyclictest508-21dbus-daemon00:25:010
313999973,3cyclictest30654-21snmpd20:16:480
313999973,3cyclictest24233-21smart_sda20:00:170
313999973,2cyclictest7661-21lldpd21:16:110
313999973,1cyclictest0-21swapper/021:21:000
313999973,1cyclictest0-21swapper/000:15:460
313999971,3cyclictest5339-21turbostat21:45:010
313999971,3cyclictest15787-21munin-run19:45:010
32208260,0sleep3331rcuc/321:40:193
314129964,1cyclictest31053-21df00:35:133
314129963,2cyclictest8795-21ssh21:23:263
314129963,2cyclictest6419-21grep22:10:103
314129963,2cyclictest508-21dbus-daemon23:46:023
314129963,2cyclictest26647-21grep20:05:193
314129963,2cyclictest23978-21ntp_offset20:00:153
314129963,2cyclictest21378-21uname22:20:153
314129963,2cyclictest21141-21expr19:55:103
314129963,2cyclictest13545-21if_enp4s020:50:133
314129963,2cyclictest1-21systemd21:35:193
314129963,2cyclictest11736-21in:imuxsock21:30:013
314129963,2cyclictest11736-21in:imuxsock19:31:563
314129963,2cyclictest0-21swapper/323:35:053
314129963,1cyclictest0-21swapper/323:40:093
314129962,3cyclictest8828-21df_inode20:40:143
314129962,3cyclictest8780-21awk00:15:133
314129962,3cyclictest5164-21ntpd19:40:183
314129962,3cyclictest508-21dbus-daemon00:00:003
314129962,3cyclictest32656-21irqstats20:20:163
314129962,3cyclictest30654-21snmpd21:50:333
314129962,3cyclictest30654-21snmpd21:14:023
314129962,3cyclictest30654-21snmpd21:05:323
314129962,3cyclictest30654-21snmpd19:36:353
314129962,3cyclictest30654-21snmpd19:14:043
314129962,3cyclictest29277-21expr21:15:133
314129962,3cyclictest22117-21kworker/3:200:20:033
314129962,3cyclictest15156-21sshd23:05:173
314129962,3cyclictest0-21swapper/321:45:273
314129962,1cyclictest0-21swapper/323:26:023
314129961,4cyclictest10671-21apt-get20:45:113
314129961,3cyclictest19982-21systemd-journal22:35:083
314129961,3cyclictest19982-21systemd-journal22:30:053
314129961,3cyclictest19982-21systemd-journal20:30:213
314129961,3cyclictest19982-21systemd-journal20:14:563
314129961,3cyclictest19982-21systemd-journal19:16:313
314129961,3cyclictest19982-21systemd-journal00:25:143
314129961,2cyclictest12982-21ssh21:27:063
314129960,6cyclictest0-21swapper/323:21:093
314129960,6cyclictest0-21swapper/322:40:293
314129960,4cyclictest19982-21systemd-journal20:57:413
314129960,3cyclictest17105-21wc19:45:183
314129960,3cyclictest16982-21grep23:55:183
314079964,1cyclictest2625-21grep19:15:142
314079964,1cyclictest16372-21strings23:55:142
314079963,2cyclictest9689-21sh21:24:162
314079963,2cyclictest5959-21sshd19:21:392
314079963,2cyclictest5614-21taskset20:31:162
314079963,2cyclictest30654-21snmpd22:10:352
314079963,2cyclictest30654-21snmpd21:16:222
314079963,2cyclictest28312-21entropy23:15:152
314079963,2cyclictest28312-21entropy23:15:152
314079963,2cyclictest27513-21rm22:25:052
314079963,2cyclictest19982-21systemd-journal00:36:442
314079963,2cyclictest14946-21cut00:20:162
314079963,2cyclictest13106-21ssh21:27:142
314079963,2cyclictest11736-21in:imuxsock23:10:332
314079963,2cyclictest10096-21ssh23:25:582
314079962,3cyclictest9077-21cat23:50:112
314079962,3cyclictest30654-21snmpd23:35:032
314079962,3cyclictest30654-21snmpd22:52:502
314079962,3cyclictest30654-21snmpd21:57:002
314079962,3cyclictest30654-21snmpd20:40:032
314079962,3cyclictest30654-21snmpd19:30:072
314079962,3cyclictest24672-21cat21:35:152
314079962,3cyclictest22695-21cat21:10:142
314079962,3cyclictest19982-21systemd-journal19:45:382
314079962,3cyclictest1901-21cat22:55:162
314079962,3cyclictest16056-21ntpq20:55:172
314079962,3cyclictest15331-21cat23:30:112
314079962,1cyclictest0-21swapper/223:06:242
314079962,1cyclictest0-21swapper/222:40:142
314079962,1cyclictest0-21swapper/221:46:012
314079962,1cyclictest0-21swapper/200:30:082
314079962,1cyclictest0-21swapper/200:11:292
314079961,3cyclictest19982-21systemd-journal21:01:142
314079961,3cyclictest19982-21systemd-journal19:11:062
314079961,3cyclictest19982-21systemd-journal00:05:372
314079960,6cyclictest0-21swapper/221:43:492
314079960,6cyclictest0-21swapper/221:05:122
314079960,6cyclictest0-21swapper/220:22:152
314079960,6cyclictest0-21swapper/200:00:062
314079960,5cyclictest20882-21cstates22:20:112
314079960,0cyclictest0-21swapper/223:46:522
314039966,0cyclictest0-21swapper/123:45:231
314039963,2cyclictest668-21runrttasks23:30:091
314039963,2cyclictest668-21runrttasks23:00:491
314039963,2cyclictest3111-21ntp_kernel_pll_00:10:121
314039963,2cyclictest20650-21ssh21:55:481
314039963,2cyclictest18215-21sh23:56:201
314039963,2cyclictest1430-21cut22:30:111
314039963,2cyclictest13323-21cpuspeed_turbos22:15:121
314039963,2cyclictest13133-21ssh21:50:271
314039963,2cyclictest11736-21in:imuxsock19:55:181
314039963,2cyclictest0-21swapper/123:26:521
314039963,2cyclictest0-21swapper/123:05:271
314039963,1cyclictest0-21swapper/121:25:011
314039962,3cyclictest7821-21cat19:25:201
314039962,3cyclictest7821-21cat19:25:201
314039962,3cyclictest30654-21snmpd21:00:191
314039962,3cyclictest30654-21snmpd20:57:041
314039962,3cyclictest30654-21snmpd20:04:021
314039962,3cyclictest29741-11brltty19:35:171
314039962,3cyclictest23197-21ls00:00:131
314039962,3cyclictest1-21systemd22:10:041
314039962,3cyclictest0-21swapper/122:00:311
314039962,3cyclictest0-21swapper/100:36:061
314039962,2cyclictest13243-1kworker/u9:021:40:431
314039962,1cyclictest0-21swapper/123:50:161
314039962,1cyclictest0-21swapper/123:15:171
314039962,1cyclictest0-21swapper/123:15:171
314039962,1cyclictest0-21swapper/121:46:231
314039962,1cyclictest0-21swapper/100:31:391
314039962,1cyclictest0-21swapper/100:25:291
314039962,1cyclictest0-21swapper/100:05:141
314039961,4cyclictest22942-21smartctl23:35:191
314039961,3cyclictest502-21systemd-logind19:20:151
314039961,3cyclictest19982-21systemd-journal20:43:181
314039961,3cyclictest19982-21systemd-journal20:35:461
314039961,3cyclictest19982-21systemd-journal20:18:151
314039961,2cyclictest1911-21ssh22:06:311
314039960,6cyclictest0-21swapper/120:10:261
314039960,6cyclictest0-21swapper/100:20:171
314039960,3cyclictest3715-21munin-run20:30:001
314039960,2cyclictest31596-21/usr/sbin/munin19:10:141
313999964,1cyclictest107232sleep023:50:550
313999963,2cyclictest508-21dbus-daemon19:53:380
313999963,2cyclictest508-21dbus-daemon19:20:400
313999963,2cyclictest508-21dbus-daemon19:16:050
313999963,2cyclictest508-21dbus-daemon00:00:010
313999963,2cyclictest31315-21sh23:17:000
313999963,2cyclictest31315-21sh23:17:000
313999963,2cyclictest29922-21ssh21:39:270
313999963,2cyclictest21691-21latency_hist21:10:000
313999963,2cyclictest21450-21if_err_enp4s019:55:120
313999963,2cyclictest19982-21systemd-journal22:05:070
313999963,2cyclictest19031-21ssh23:09:010
313999963,2cyclictest18579-21ssh00:23:190
313999963,2cyclictest17432-21cpuspeed21:00:120
313999963,2cyclictest13203-21ssh21:27:200
313999963,2cyclictest12671-21find21:50:150
313999963,2cyclictest11736-21in:imuxsock23:00:110
313999963,2cyclictest11736-21in:imuxsock20:07:490
313999963,2cyclictest11736-21in:imuxsock19:35:020
313999962,3cyclictest9747-21cut19:30:170
313999962,3cyclictest8438-21cat22:35:150
313999962,3cyclictest6874-21cat20:35:170
313999962,3cyclictest508-21dbus-daemon23:26:240
313999962,3cyclictest31952-21awk20:20:130
313999962,3cyclictest30654-21snmpd22:45:390
313999962,3cyclictest30654-21snmpd20:41:270
313999962,3cyclictest30654-21snmpd19:47:170
313999962,3cyclictest30654-21snmpd00:35:080
313999962,3cyclictest30654-21snmpd00:34:080
313999962,3cyclictest26574-21smartctl22:00:150
313999962,3cyclictest2223-21tune2fs20:25:150
313999962,3cyclictest19982-21systemd-journal22:55:110
313999962,3cyclictest15522-21ntpq22:40:180
313999962,3cyclictest0-21swapper/023:47:150
313999962,1cyclictest0-21swapper/023:35:010
313999962,1cyclictest0-21swapper/022:26:300
313999962,1cyclictest0-21swapper/022:16:090
313999962,1cyclictest0-21swapper/022:10:020
313999961,3cyclictest19982-21systemd-journal21:55:030
313999961,3cyclictest19982-21systemd-journal20:53:420
313999960,6cyclictest30099-21ssh00:05:510
313999960,5cyclictest20591-21/usr/sbin/munin22:20:120
313999960,3cyclictest2039-21ssh00:10:020
313999960,2cyclictest3460-21ntpq23:20:180
314129952,2cyclictest18834-21ls19:50:133
314129952,2cyclictest17749-21forks21:00:133
314129951,2cyclictest19982-21systemd-journal19:25:163
314129951,2cyclictest19982-21systemd-journal19:25:163
314079952,2cyclictest29750-21awk20:15:122
314079952,2cyclictest21260-21fschecks_time19:55:122
314079952,2cyclictest13786-21chrt19:40:052
314079951,3cyclictest7030-21expr19:25:152
314079951,3cyclictest7030-21expr19:25:152
314079951,3cyclictest29741-11brltty23:00:072
314079950,3cyclictest11277-21hostname20:45:132
314039952,2cyclictest4072-21grep20:30:101
314039952,2cyclictest25932-21cat20:05:151
314039952,2cyclictest16002-21seq19:45:051
314039952,2cyclictest11077-21uniq20:45:131
313999952,2cyclictest7753-21cat19:25:210
313999952,2cyclictest7753-21cat19:25:200
313999952,2cyclictest30654-21snmpd20:55:040
313999952,2cyclictest27939-21fschecks_time20:10:150
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional