You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-03-12 - 12:25
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack9slot2.osadl.org (updated Wed Mar 12, 2025 00:43:25)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
28702304267,24sleep20-21swapper/22
29252296264,20sleep00-21swapper/00
26542286248,25sleep10-21swapper/11
306199268262,3cyclictest7622-21tr3
27222246192,24sleep30-21swapper/33
305199208202,4cyclictest7586-21munin-run0
305399165158,5cyclictest7618-21awk1
305799162157,3cyclictest0-21swapper/22
71252480,4sleep07128-21tr0
71252480,4sleep07128-21tr0
243402450,2sleep00-21swapper/00
126672420,2sleep20-21swapper/22
100432420,1sleep30-21swapper/33
123712400,2sleep3306199cyclictest3
87912370,2sleep10-21swapper/11
3051993026,2cyclictest9-21ksoftirqd/00
3051993012,2cyclictest9-21ksoftirqd/00
305399261,22cyclictest14011-21ls1
3051992610,4cyclictest9-21ksoftirqd/00
305799259,14cyclictest11946-21latency_hist2
305199252,18cyclictest25266-21basename0
3051992518,4cyclictest6583-21sh0
3051992516,2cyclictest9-21ksoftirqd/00
305799246,16cyclictest28-21ksoftirqd/22
305799244,18cyclictest0-21swapper/22
305199248,6cyclictest9-21ksoftirqd/00
3051992415,6cyclictest13635-21idleruntime-cro0
305199240,4cyclictest9-21ksoftirqd/00
305799234,17cyclictest3588-21cat2
305799234,17cyclictest31997-21sendmail-mta2
305799234,17cyclictest31997-21sendmail-mta2
305799234,17cyclictest28-21ksoftirqd/22
305799233,17cyclictest12600-21latency_hist2
3057992317,3cyclictest23850-21munin-run2
305799231,3cyclictest14172-21munin-run2
305799231,19cyclictest7935-21sendmail2
305199236,6cyclictest9-21ksoftirqd/00
3051992314,3cyclictest9-21ksoftirqd/00
3051992314,2cyclictest9-21ksoftirqd/00
211522230,2sleep30-21swapper/33
305799222,18cyclictest23633-21latency_hist2
305799221,4cyclictest21252-21munin-run2
305799221,3cyclictest29954-21munin-run2
305799220,4cyclictest4983-21latency_hist2
305799220,19cyclictest12014-21chrt2
3053992214,5cyclictest505-21dbus-daemon1
305399221,18cyclictest22300-21expr1
305199228,4cyclictest9-21ksoftirqd/00
3051992218,3cyclictest9-21ksoftirqd/00
3051992212,3cyclictest9-21ksoftirqd/00
3061992116,3cyclictest9067-21ntp_states3
3061992114,4cyclictest26864-21date3
3061992114,4cyclictest14159-21cut3
306199211,18cyclictest15953-21grep3
305799214,15cyclictest17221-21cron2
305799212,17cyclictest15231-21latency_hist2
305799212,17cyclictest0-21swapper/22
305799212,17cyclictest0-21swapper/22
305799212,13cyclictest25879-21apt-get2
3057992116,3cyclictest28-21ksoftirqd/22
305799211,4cyclictest7532-21munin-run2
305799211,3cyclictest15643-21munin-run2
305799210,3cyclictest5244-1kworker/2:1H2
305799210,18cyclictest5576-21tr2
305399215,4cyclictest115502sed1
305399212,16cyclictest24581-21grep1
305399211,8cyclictest111782grep1
3053992115,4cyclictest3372-21seq1
3053992115,4cyclictest31452-21ls1
3053992115,4cyclictest3078-21sed1
3053992115,4cyclictest21-21ksoftirqd/11
3053992115,4cyclictest18345-21seq1
3053992115,4cyclictest12981-21seq1
3053992114,4cyclictest4114-21ntpq1
305199219,9cyclictest0-21swapper/00
305199217,7cyclictest9-21ksoftirqd/00
305199217,4cyclictest9-21ksoftirqd/00
305199215,3cyclictest9-21ksoftirqd/00
305199215,3cyclictest9-21ksoftirqd/00
3051992116,3cyclictest9-21ksoftirqd/00
3051992116,3cyclictest13461-21/usr/sbin/munin0
3051992114,4cyclictest2082-21systemd-journal0
3051992111,3cyclictest9-21ksoftirqd/00
3051992110,3cyclictest111rcu_preempt0
305199210,7cyclictest22798-21cron0
3061992015,3cyclictest8258-21fw_packets3
3061992015,3cyclictest665-21runrttasks3
3061992015,3cyclictest29475-21entropy3
3061992015,3cyclictest24369-21ntp_offset3
3061992015,3cyclictest21807-21missed_timers3
3061992015,3cyclictest2115-21cpuspeed_turbos3
3061992015,3cyclictest14163-21cron3
3061992014,4cyclictest17967-21cat3
3061992013,4cyclictest27760-21grep3
306199201,2cyclictest111rcu_preempt3
3061992011,5cyclictest7869-21apt-get3
306199200,19cyclictest0-21swapper/33
306199200,18cyclictest14587-21cat3
305799207,10cyclictest15360-21if_err_enp2s02
3057992015,3cyclictest3993-21dpkg2
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional