You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-11-22 - 08:52
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackdslot0.osadl.org (updated Fri Nov 22, 2024 00:45:58)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2921599230,18cyclictest0-21swapper/200:10:192
2921199236,2cyclictest10124-21mii-tool21:25:161
2921599210,17cyclictest0-21swapper/220:28:262
2921199210,19cyclictest13424-21fschecks_time20:35:141
2921099210,3cyclictest0-21swapper/020:17:360
2921599200,13cyclictest0-21swapper/223:34:202
2921599190,18cyclictest14044-21nfsd420:35:172
29211991915,3cyclictest0-21swapper/121:44:021
2921199190,15cyclictest0-21swapper/119:25:141
29210991913,3cyclictest0-21swapper/000:27:000
2921599187,0cyclictest0-21swapper/220:49:252
2921599183,1cyclictest0-21swapper/222:34:332
2921599182,15cyclictest0-21swapper/219:30:172
29215991816,1cyclictest0-21swapper/219:10:212
29215991815,3cyclictest0-21swapper/223:06:202
29215991815,2cyclictest28161-21nfsd422:55:162
2921599180,17cyclictest5579-21nvmesmart_nvme023:10:172
2921599180,17cyclictest30362-21cstates23:00:112
2921599180,17cyclictest30362-21cstates23:00:112
2921599180,15cyclictest0-21swapper/200:25:182
29211991815,2cyclictest23914-21cut23:50:001
29211991815,2cyclictest13743-21ntpq23:25:181
29211991814,3cyclictest823-21systemd-network21:36:191
29211991813,4cyclictest0-21swapper/121:15:001
2921199180,3cyclictest3772-21egrep21:15:141
2921099183,1cyclictest0-21swapper/021:01:570
29210991814,3cyclictest0-21swapper/022:10:170
29210991814,3cyclictest0-21swapper/022:10:170
29210991813,3cyclictest18973-21nfsd421:40:170
2921099180,17cyclictest652-21sshd20:11:270
2921099180,15cyclictest21076-21latency_hist22:45:010
29215991715,1cyclictest31832-21idleruntime20:10:162
29215991715,1cyclictest11299-21switchtime23:20:232
29215991715,1cyclictest0-21swapper/221:35:112
29215991714,2cyclictest7386-21cut19:25:192
29215991714,2cyclictest5789-21nfsd420:20:192
29215991714,2cyclictest18932-21switchtime19:45:232
29215991714,2cyclictest12939-21kernelversion21:30:212
29215991714,1cyclictest0-21swapper/223:57:142
29215991713,3cyclictest27850-21munin-plugin-st20:05:012
2921599171,15cyclictest5615-21taskset19:23:202
2921599171,15cyclictest0-21swapper/221:25:202
2921599171,15cyclictest0-21swapper/200:20:142
2921599170,2cyclictest9097-21ntp_offset22:20:182
2921599170,2cyclictest5902-21cron21:17:012
2921599170,2cyclictest25047-21tr20:00:012
2921599170,2cyclictest17973-21cat21:40:132
2921599170,2cyclictest17794-21acpi23:35:112
2921599170,2cyclictest17429-21cat00:35:122
2921599170,2cyclictest16520-21chrt00:32:582
2921599170,16cyclictest920-21in:imuxsock00:07:422
2921599170,16cyclictest31175-21cat21:05:182
2921599170,16cyclictest29550-21latency22:00:172
2921599170,16cyclictest22325-21anvil21:48:442
2921599170,16cyclictest12626-21cstates23:25:122
2921599170,16cyclictest11228-21nfsd420:30:192
2921599170,15cyclictest4581-21H212:26:332
2921599170,15cyclictest0-21swapper/200:00:192
2921199172,1cyclictest0-21swapper/119:15:211
29211991714,2cyclictest9501-21fschecks_count19:30:141
29211991714,2cyclictest8042-21grep21:20:211
29211991714,2cyclictest5312-21cat00:10:291
29211991714,2cyclictest3692-21master19:42:181
29211991714,2cyclictest26274-21expr21:55:111
29211991714,2cyclictest19968-21munin-plugin-st00:40:001
29211991714,2cyclictest19593-21wc23:35:221
29211991714,2cyclictest12795-21sed00:25:171
2921199171,1cyclictest0-21swapper/100:05:231
2921199171,15cyclictest4535-21H212:26:331
2921199171,15cyclictest4535-21H212:26:331
2921199171,15cyclictest27740-21cat23:55:151
2921199171,15cyclictest0-21swapper/119:35:121
2921199170,2cyclictest4526-21H212:26:331
2921199170,2cyclictest30159-21expr00:00:121
2921199170,2cyclictest29006-21systemctl21:00:211
2921199170,2cyclictest28592-21cpu22:00:131
2921199170,2cyclictest25769-21cat21:55:011
2921199170,2cyclictest23041-21pzem_voltage22:45:201
2921199170,2cyclictest1238-21snapd20:21:131
2921199170,16cyclictest9221-21cat00:20:131
2921199170,16cyclictest7761-21basename00:15:211
2921199170,16cyclictest7035-21sendmail-mta22:17:041
2921199170,16cyclictest32006-21latency_hist19:15:021
2921199170,16cyclictest2974-21apt-config19:20:011
2921199170,16cyclictest28316-21awk22:55:161
2921199170,16cyclictest26044-21expr23:50:191
2921199170,16cyclictest2594-21fschecks_time22:10:171
2921199170,16cyclictest2594-21fschecks_time22:10:161
2921199170,16cyclictest24866-21cut22:50:171
2921199170,16cyclictest20644-21expr21:45:121
2921199170,16cyclictest1845-21systemd-journal20:05:011
2921199170,16cyclictest1555-21lxd20:54:531
2921199170,16cyclictest13139-21/usr/sbin/munin22:30:211
2921199170,16cyclictest12665-21sed20:35:011
2921199170,16cyclictest10444-21wc22:25:121
2921199170,15cyclictest0-21swapper/121:05:221
29210991715,1cyclictest0-21swapper/021:09:000
29210991714,2cyclictest8193-21grep23:15:170
29210991714,2cyclictest4803-21grep20:20:130
29210991714,2cyclictest32384-21grep19:15:140
29210991714,2cyclictest24149-21missed_timers21:50:200
29210991714,2cyclictest22768-21netstat20:50:180
29210991714,2cyclictest16918-21memory22:35:160
29210991714,2cyclictest16603-21chrt19:42:070
29210991714,2cyclictest14100-21/usr/sbin/munin20:35:160
29210991714,2cyclictest1355-21lxd23:40:530
29210991714,2cyclictest13308-21nfsd421:30:210
29210991714,2cyclictest10104-21nfsd419:30:180
29210991714,2cyclictest10021-21apache_volume20:30:120
2921099170,2cyclictest970-21dbus-daemon00:20:210
2921099170,2cyclictest32400-21/usr/sbin/munin00:05:120
2921099170,2cyclictest20673-21apt-get20:50:010
2921099170,2cyclictest17388-21expr20:40:210
2921099170,16cyclictest8133-21chrt19:25:330
2921099170,16cyclictest3441-21gsd-color23:55:180
2921099170,16cyclictest31475-21ntpq23:00:170
2921099170,16cyclictest31475-21ntpq23:00:170
2921099170,16cyclictest28163-21perf22:00:010
2921099170,16cyclictest17375-21cat00:35:130
2921099170,16cyclictest14729-21/usr/sbin/munin21:35:090
29215991614,1cyclictest0-21swapper/223:15:172
29215991614,1cyclictest0-21swapper/222:45:142
29215991614,1cyclictest0-21swapper/222:15:152
29215991614,1cyclictest0-21swapper/221:20:112
29215991614,1cyclictest0-21swapper/221:10:142
29215991614,1cyclictest0-21swapper/220:50:142
29215991614,1cyclictest0-21swapper/219:50:102
29215991614,1cyclictest0-21swapper/219:40:172
2921599160,2cyclictest2175-21cstates22:10:152
2921599160,2cyclictest2175-21cstates22:10:142
2921599160,1cyclictest25178-21latency22:50:202
2921599160,1cyclictest0-21swapper/222:05:122
2921599160,1cyclictest0-21swapper/220:40:132
2921599160,1cyclictest0-21swapper/220:18:392
2921599160,15cyclictest28158-21apache_accesses20:05:112
2921599160,15cyclictest22246-21pzem_power23:40:202
2921599160,15cyclictest20504-21grep22:40:212
2921599160,15cyclictest2038-21cron19:17:002
2921599160,15cyclictest10406-21/usr/sbin/munin22:25:172
2921599160,15cyclictest0-21swapper/223:50:252
2921599160,15cyclictest0-21swapper/223:45:492
2921599160,15cyclictest0-21swapper/222:35:112
2921599160,15cyclictest0-21swapper/221:50:152
2921599160,15cyclictest0-21swapper/219:35:132
2921599160,15cyclictest0-21swapper/200:15:162
29211991614,1cyclictest0-21swapper/123:40:141
29211991614,1cyclictest0-21swapper/122:05:151
29211991614,1cyclictest0-21swapper/120:40:131
29211991614,1cyclictest0-21swapper/120:05:181
29211991614,1cyclictest0-21swapper/119:50:151
29211991614,1cyclictest0-21swapper/119:49:001
29211991614,1cyclictest0-21swapper/100:30:201
29211991613,2cyclictest7286-21cat23:15:141
29211991613,2cyclictest11046-21nvmesmart_nvme023:20:201
2921199160,1cyclictest0-21swapper/122:35:131
2921199160,15cyclictest8800-21missed_timers22:20:181
2921199160,15cyclictest22774-21cpuspeed_turbos19:55:121
2921199160,15cyclictest15188-21cpuspeed_turbos23:30:161
2921199160,15cyclictest1464-21/usr/sbin/munin20:15:211
2921199160,15cyclictest0-21swapper/123:12:451
2921199160,15cyclictest0-21swapper/122:40:131
2921199160,15cyclictest0-21swapper/121:30:191
2921199160,15cyclictest0-21swapper/120:45:121
29210991614,1cyclictest15226-21expr23:30:170
29210991614,1cyclictest10672-21cstates22:25:130
29210991614,1cyclictest0-21swapper/023:47:110
29210991614,1cyclictest0-21swapper/023:10:180
29210991614,1cyclictest0-21swapper/022:45:130
29210991614,1cyclictest0-21swapper/022:30:160
29210991614,1cyclictest0-21swapper/022:15:130
29210991614,1cyclictest0-21swapper/022:05:150
29210991614,1cyclictest0-21swapper/022:00:180
29210991614,1cyclictest0-21swapper/020:00:210
29210991614,1cyclictest0-21swapper/019:50:140
29210991614,1cyclictest0-21swapper/019:45:140
29210991614,1cyclictest0-21swapper/000:15:180
29210991614,1cyclictest0-21swapper/000:10:220
2921099161,15cyclictest4534-21H212:26:330
2921099160,2cyclictest9074-21/usr/sbin/munin22:20:190
2921099160,2cyclictest454-21plymouthd23:55:010
2921099160,2cyclictest4538-21H212:26:330
2921099160,2cyclictest20755-21expr21:45:110
2921099160,1cyclictest0-21swapper/022:50:250
2921099160,15cyclictest9528-21tr21:25:150
2921099160,15cyclictest6728-21expr21:20:140
2921099160,15cyclictest454-21plymouthd21:10:190
2921099160,15cyclictest26931-21/usr/sbin/munin22:55:120
2921099160,15cyclictest14649-21/usr/sbin/munin00:30:160
2921099160,15cyclictest0-21swapper/023:27:000
2921099160,15cyclictest0-21swapper/023:20:130
2921099160,15cyclictest0-21swapper/023:05:020
2921099160,15cyclictest0-21swapper/021:15:210
2921099160,15cyclictest0-21swapper/020:55:000
2921099160,15cyclictest0-21swapper/020:05:150
2921099160,15cyclictest0-21swapper/019:35:130
2921099160,15cyclictest0-21swapper/000:00:180
2921599150,1cyclictest27445-21apache_accesses21:00:112
2921199150,1cyclictest0-21swapper/123:05:091
2921199150,1cyclictest0-21swapper/120:55:121
29210991513,1cyclictest0-21swapper/019:10:160
2921099150,1cyclictest18753-21latency23:35:160
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional