You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-11-23 - 17:26
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackdslot0.osadl.org (updated Sat Nov 23, 2024 12:45:57)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
231199230,5cyclictest0-21swapper/208:21:002
2310992218,3cyclictest0-21swapper/112:03:001
230999220,21cyclictest823-21systemd-network08:39:010
2310992121,0cyclictest0-21swapper/109:44:421
231199200,19cyclictest414-20systemd-journal10:49:552
231099207,13cyclictest0-21swapper/112:37:061
231099200,17cyclictest21148-21fschecks_time12:30:171
2311991914,4cyclictest0-21swapper/212:06:212
2311991914,4cyclictest0-21swapper/212:06:212
231099191,16cyclictest4593-21H212:26:331
230999194,1cyclictest0-21swapper/010:42:020
230999193,15cyclictest0-21swapper/012:06:590
230999193,15cyclictest0-21swapper/012:06:590
230999192,2cyclictest25208-21chrt07:48:500
2309991916,2cyclictest1845-21systemd-journal07:15:010
2309991916,1cyclictest0-21swapper/008:30:350
2311991816,1cyclictest22726-21cat09:35:212
2311991815,2cyclictest4523-21H212:26:332
231199181,2cyclictest4536-21H212:26:332
231199181,1cyclictest0-21swapper/208:27:172
231199180,3cyclictest16579-21proc_pri09:25:202
231199180,3cyclictest16579-21proc_pri09:25:202
231199180,17cyclictest26626-21chrt11:41:422
231199180,17cyclictest0-21swapper/210:55:122
231199180,16cyclictest4534-21H212:26:332
231199180,16cyclictest4530-21H212:26:332
231199180,15cyclictest4538-21H212:26:332
231099182,1cyclictest31102sleep111:57:431
2310991815,2cyclictest22672-21nfsd408:40:181
2310991814,3cyclictest4593-21H212:26:331
2310991814,3cyclictest0-21swapper/108:54:311
2310991814,3cyclictest0-21swapper/107:12:191
2310991814,2cyclictest11827-21munin-plugin-st09:20:011
231099181,16cyclictest27580-21latency09:45:161
231099180,3cyclictest970-21dbus-daemon11:08:591
231099180,2cyclictest4536-21H212:26:331
231099180,17cyclictest4581-21H212:26:331
231099180,17cyclictest3707-21lxd10:21:001
231099180,16cyclictest4534-21H212:26:331
2309991814,3cyclictest1147-21snapd08:23:430
230999181,2cyclictest15290-21fschecks_count07:30:160
230999180,2cyclictest4536-21H212:26:330
230999180,17cyclictest454-21plymouthd11:50:200
230999180,15cyclictest4593-21H212:26:330
2311991715,1cyclictest0-21swapper/212:20:142
2311991715,1cyclictest0-21swapper/209:10:102
2311991715,1cyclictest0-21swapper/207:25:222
2311991714,2cyclictest9014-21dpkg09:15:022
2311991714,2cyclictest4680-21http_loadtime12:00:162
2311991714,2cyclictest4538-21H212:26:332
2311991714,2cyclictest4523-21H212:26:332
2311991714,2cyclictest24163-21/usr/sbin/munin08:45:172
2311991714,2cyclictest17052-21/usr/sbin/munin10:25:122
2311991714,2cyclictest12275-21/usr/sbin/munin12:15:232
2311991714,2cyclictest11923-21users11:10:242
231199171,15cyclictest4523-21H212:26:332
231199170,2cyclictest4593-21H212:26:332
231199170,2cyclictest26849-21missed_timers07:50:152
231199170,2cyclictest25326-21gpgv12:36:562
231199170,2cyclictest23060-21ntp_offset11:35:182
231199170,2cyclictest1472-21lxd07:19:002
231199170,16cyclictest7086-21pzem_power10:05:222
231199170,16cyclictest4593-21H212:26:332
231199170,16cyclictest4581-21H212:26:332
231199170,16cyclictest3350-21master09:32:232
231199170,16cyclictest28863-21cat07:55:132
231199170,16cyclictest27963-21missed_timers08:50:182
231199170,16cyclictest27200-21grep09:45:142
231199170,16cyclictest25385-21pzem_energy09:40:202
231199170,16cyclictest2376-21fschecks_time08:05:142
231199170,16cyclictest2376-21fschecks_time08:05:142
231199170,16cyclictest22985-21/usr/sbin/munin07:45:182
231199170,16cyclictest20714-21expr07:40:142
231199170,16cyclictest15096-21latency_hist11:20:002
231199170,16cyclictest14639-21taskset07:30:102
231199170,16cyclictest12804-21if_enp1s009:20:152
231199170,16cyclictest10029-21cut08:20:012
2310991715,1cyclictest84112sleep110:10:031
2310991714,2cyclictest4532-21H212:26:331
2310991714,2cyclictest4532-21H212:26:331
2310991714,2cyclictest30604-21chrt07:57:161
2310991714,2cyclictest26691-21latency_hist08:50:001
2310991714,2cyclictest2519-21nfsd410:55:171
2310991714,2cyclictest2249-21chrt09:03:001
2310991714,2cyclictest22423-21ps09:35:191
2310991714,2cyclictest17699-21fschecks_time10:25:151
2310991714,2cyclictest17247-21/usr/sbin/munin08:30:211
2310991714,2cyclictest15869-21nfsd407:30:191
2310991714,2cyclictest10484-21kernelversion12:10:181
231099171,15cyclictest21-21ksoftirqd/108:20:181
231099170,2cyclictest4688-21pzem_voltage09:05:201
231099170,2cyclictest4532-21H212:26:331
231099170,2cyclictest414-20systemd-journal08:30:001
231099170,2cyclictest31831-21ntp_offset11:50:181
231099170,2cyclictest21369-21ls11:35:001
231099170,2cyclictest17578-21sshd11:22:411
231099170,16cyclictest8682-21cstates07:20:151
231099170,16cyclictest3441-21gsd-color11:36:271
231099170,16cyclictest20165-21perf09:35:011
231099170,16cyclictest13960-21switchtime12:15:231
231099170,16cyclictest0-21swapper/107:47:111
2309991715,1cyclictest9-21ksoftirqd/007:27:120
2309991715,1cyclictest0-21swapper/010:50:470
2309991715,1cyclictest0-21swapper/010:11:250
2309991714,2cyclictest4536-21H212:26:330
2309991714,2cyclictest4536-21H212:26:330
2309991714,2cyclictest4528-21H212:26:330
2309991714,2cyclictest30869-21sendmail_mailqu09:50:260
2309991714,2cyclictest17022-21sendmail_mailst11:20:200
2309991714,2cyclictest1702-21chrt09:55:280
2309991714,2cyclictest15051-21apache_processe12:20:120
2309991714,2cyclictest10621-21ntp_states09:15:190
2309991713,3cyclictest4538-21H212:26:330
230999170,2cyclictest4536-21H212:26:330
230999170,2cyclictest31095-21latency_hist08:00:010
230999170,2cyclictest2041-21idleruntime10:55:150
230999170,2cyclictest1946-21cstates08:05:130
230999170,2cyclictest1946-21cstates08:05:130
230999170,2cyclictest19100-21sshd10:26:530
230999170,2cyclictest12407-21nfsd410:15:200
230999170,2cyclictest1131-21snapd12:14:120
230999170,1cyclictest4526-21H212:26:330
230999170,1cyclictest0-21swapper/010:48:480
230999170,16cyclictest5428-21expr08:10:150
230999170,16cyclictest4534-21H212:26:330
230999170,16cyclictest28889-21cron09:50:000
230999170,16cyclictest19775-21apache_accesses10:30:140
230999170,16cyclictest19675-21timerwakeupswit09:30:280
230999170,16cyclictest14678-21/usr/sbin/munin08:25:190
230999170,16cyclictest13134-21expr11:15:140
230999170,16cyclictest0-21swapper/010:21:490
230999170,16cyclictest0-21swapper/009:25:010
2311991614,1cyclictest0-21swapper/211:55:172
2311991614,1cyclictest0-21swapper/211:45:012
2311991614,1cyclictest0-21swapper/210:50:232
2311991614,1cyclictest0-21swapper/210:40:132
2311991614,1cyclictest0-21swapper/207:10:152
2311991613,2cyclictest4530-21H212:26:332
2311991613,2cyclictest18926-21chrt11:30:052
231199160,2cyclictest31714-21expr08:00:142
231199160,1cyclictest0-21swapper/212:30:142
231199160,15cyclictest32587-21grep09:00:142
231199160,15cyclictest0-21swapper/212:25:132
231199160,15cyclictest0-21swapper/212:10:152
231199160,15cyclictest0-21swapper/211:25:292
231199160,15cyclictest0-21swapper/211:20:132
231199160,15cyclictest0-21swapper/211:05:152
231199160,15cyclictest0-21swapper/211:00:142
231199160,15cyclictest0-21swapper/210:35:142
231199160,15cyclictest0-21swapper/209:51:472
231199160,15cyclictest0-21swapper/209:05:132
231199160,15cyclictest0-21swapper/208:10:152
2310991614,1cyclictest4770-21expr11:00:141
2310991614,1cyclictest17836-21grep12:25:131
2310991614,1cyclictest0-21swapper/112:05:181
2310991614,1cyclictest0-21swapper/112:05:181
2310991614,1cyclictest0-21swapper/110:33:391
2310991614,1cyclictest0-21swapper/109:50:221
2310991614,1cyclictest0-21swapper/108:00:071
2310991613,2cyclictest26400-21fschecks_time07:50:131
2310991613,2cyclictest25835-21expr10:40:131
2310991613,2cyclictest13920-21nfsd411:15:181
2310991613,2cyclictest11452-21ps11:10:221
231099160,2cyclictest13917-21pluginstate10:20:011
231099160,1cyclictest27730-21apt-get11:45:121
231099160,1cyclictest0-21swapper/108:35:131
231099160,15cyclictest8851-21nfsd408:15:201
231099160,15cyclictest27417-21cat11:45:011
231099160,15cyclictest16256-21nfsd412:20:191
231099160,15cyclictest0-21swapper/111:26:541
231099160,15cyclictest0-21swapper/110:50:151
231099160,15cyclictest0-21swapper/110:35:141
231099160,15cyclictest0-21swapper/110:07:591
231099160,15cyclictest0-21swapper/109:25:011
231099160,15cyclictest0-21swapper/109:25:011
231099160,15cyclictest0-21swapper/109:20:151
231099160,15cyclictest0-21swapper/109:10:251
231099160,15cyclictest0-21swapper/108:55:121
231099160,15cyclictest0-21swapper/108:05:111
231099160,15cyclictest0-21swapper/108:05:111
2309991614,1cyclictest0-21swapper/011:40:160
2309991614,1cyclictest0-21swapper/011:35:140
2309991614,1cyclictest0-21swapper/010:08:590
2309991614,1cyclictest0-21swapper/009:40:130
2309991614,1cyclictest0-21swapper/009:38:580
2309991613,2cyclictest6816-21latency_hist11:05:000
230999160,2cyclictest4536-21H212:26:330
230999160,2cyclictest23643-21expr12:35:150
230999160,1cyclictest0-21swapper/008:55:140
230999160,1cyclictest0-21swapper/008:00:170
230999160,15cyclictest4593-21H212:26:330
230999160,15cyclictest27667-21dpkg11:45:010
230999160,15cyclictest27188-21ps07:50:180
230999160,15cyclictest2529-21cpu10:00:120
230999160,15cyclictest18096-21expr12:25:130
230999160,15cyclictest12306-21dpkg12:15:130
230999160,15cyclictest0-21swapper/012:35:000
230999160,15cyclictest0-21swapper/011:55:180
230999160,15cyclictest0-21swapper/011:10:220
230999160,15cyclictest0-21swapper/011:05:180
230999160,15cyclictest0-21swapper/010:36:070
230999150,14cyclictest0-21swapper/012:00:140
230999150,14cyclictest0-21swapper/011:30:140
230999150,14cyclictest0-21swapper/011:26:370
230999150,14cyclictest0-21swapper/008:15:180
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional