You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-11-25 - 11:02
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack9slot5.osadl.org (updated Thu Jul 13, 2023 00:43:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1357922215,4sleep00-21swapper/019:09:120
14032991815,2cyclictest20855-21cat00:20:001
137532187,7sleep10-21swapper/119:09:441
246099130,2rtkit-daemon2459-21rtkit-daemon00:15:230
14032991310,2cyclictest15119-21kernelversion20:00:271
14032991310,2cyclictest1012-21munin-run21:20:001
14031991312,1cyclictest31104-21fschecks_time21:15:210
14031991311,1cyclictest25013-21x2golistsession21:55:230
246099120,2rtkit-daemon2459-21rtkit-daemon20:03:090
14032991210,1cyclictest8969-21open_files22:20:271
14031991211,1cyclictest28424-21x2gosqlitewrapp23:40:250
1403299119,1cyclictest22042-21needreboot00:20:301
1403299119,1cyclictest14625-21aten_r9power_cu00:10:181
1403299119,1cyclictest12080-21x2golistsession22:25:241
1403299119,1cyclictest0-21swapper/119:40:001
1403299118,2cyclictest7901-21latency_hist00:00:001
1403299118,2cyclictest30541-21apt00:35:001
1403199119,1cyclictest2167-21idleruntime21:20:220
1403199118,2cyclictest17671-21df_abs19:15:200
1403199118,2cyclictest12531-21unixbench-2d23:15:270
1403199118,2cyclictest0-21swapper/022:40:200
1403299108,1cyclictest21955-21needreboot23:30:291
1403299108,1cyclictest1692-21fschecks_count20:30:231
1403299108,1cyclictest0-21swapper/121:00:211
1403299108,1cyclictest0-21swapper/120:40:261
1403299107,2cyclictest28240-21pmu-power21:10:231
1403299107,2cyclictest25006-21ntp_kernel_pll_21:55:231
1403299105,4cyclictest7895-21x2gosqlitewrapp21:30:181
1403299100,9cyclictest13636-21x2gosqlitewrapp21:38:421
1403299100,3cyclictest317352x2gosqlitewrapp22:55:411
1403199109,1cyclictest2759-21mailstats23:00:240
1403199108,1cyclictest8520-21fschecks_time20:40:260
1403199108,1cyclictest21091-21x2gopath00:20:190
1403199108,1cyclictest0-21swapper/023:30:300
1403199108,1cyclictest0-21swapper/022:50:270
1403199108,1cyclictest0-21swapper/022:12:080
1403199107,2cyclictest9178-21unixbench-2d21:30:330
1403199107,2cyclictest31518-21gltestperf00:35:240
1403199107,2cyclictest21576-21http_loadtime21:50:230
1403199105,4cyclictest29600-21x2gosqlitewrapp21:13:140
1403199105,4cyclictest19986-21x2gosqlitewrapp22:38:050
140329998,1cyclictest23811-21latency_hist20:15:011
140329998,1cyclictest18278-21fschecks_count23:25:231
140329997,1cyclictest8652-21fschecks_count00:00:251
140329997,1cyclictest24876-21fschecks_count00:25:231
140329997,1cyclictest17548-21latency_hist23:25:001
140329997,1cyclictest14380-21latency_hist00:10:001
140329997,1cyclictest0-21swapper/123:35:301
140329997,1cyclictest0-21swapper/122:15:181
140329997,1cyclictest0-21swapper/121:55:001
140329997,1cyclictest0-21swapper/119:55:231
140329997,1cyclictest0-21swapper/119:20:271
140329996,2cyclictest8035-21/usr/sbin/munin23:10:251
140329996,2cyclictest5794-21unixbench-2d19:45:321
140329996,2cyclictest20394-21perf19:20:001
140329996,2cyclictest0-21swapper/121:10:001
140329995,4cyclictest32455-21x2gosqlitewrapp20:27:211
140329994,4cyclictest30729-21x2gosqlitewrapp00:35:081
140329994,4cyclictest27422-21x2gosqlitewrapp23:40:081
140329993,2cyclictest28-21ksoftirqd/119:45:001
140329992,2cyclictest27809-21gltestperf19:30:231
140329991,5cyclictest4565-21x2gosqlitewrapp21:25:021
140329991,5cyclictest28969-21x2gosqlitewrapp20:21:371
140319997,1cyclictest30628-21df_abs19:35:200
140319997,1cyclictest21877-21swap19:20:310
140319997,1cyclictest19082-21unixbench_multi23:25:310
140319997,1cyclictest15105-21x2gopath20:50:250
140319997,1cyclictest0-21swapper/022:16:360
140319997,1cyclictest0-21swapper/020:15:200
140319996,2cyclictest27733-21sh22:00:210
140319996,2cyclictest2614-21unixbench-2d20:30:310
140319996,2cyclictest18526-21needreboot21:45:230
140319995,4cyclictest4190-21x2gosqlitewrapp23:53:480
140319995,4cyclictest10331-21x2gosqlitewrapp23:13:020
140319995,3cyclictest7660-21basename21:30:000
140319994,4cyclictest4804-21x2gosqlitewrapp23:05:160
140319994,4cyclictest31983-21x2gosqlitewrapp22:05:320
140319994,4cyclictest27149-21x2gosqlitewrapp20:20:130
140319994,4cyclictest22204-21x2gosqlitewrapp21:00:360
140319994,4cyclictest20270-21x2gosqlitewrapp20:59:220
140319994,4cyclictest12339-21x2gosqlitewrapp00:05:300
140319994,4cyclictest10675-21x2golistsession22:24:130
140319990,8cyclictest15641-21x2gosqlitewrapp19:10:470
140319990,8cyclictest13085-21x2gosqlitewrapp22:26:510
140319990,8cyclictest11964-21iostat_ios21:35:240
140319990,3cyclictest16135-21readlink21:41:330
140329987,1cyclictest14029-21cyclictest23:45:321
140329986,1cyclictest0-21swapper/122:00:221
140329986,1cyclictest0-21swapper/120:05:281
140329985,2cyclictest24136-21/usr/sbin/munin22:45:231
140329985,2cyclictest18078-21fschecks_count20:55:221
140329985,2cyclictest11254-21cpuspeed_turbos20:45:211
140329985,2cyclictest0-21swapper/121:45:271
140329984,3cyclictest1455-21x2gosqlitewrapp23:00:121
140329983,4cyclictest2928-21seq21:20:481
140329983,1cyclictest161rcu_preempt23:50:281
140329982,4cyclictest23919-21apt-get20:15:161
140329981,6cyclictest7684-21x2gosqlitewrapp19:50:091
140329981,6cyclictest6443-21x2gosqlitewrapp23:06:091
140329981,6cyclictest27385-21x2gosqlitewrapp22:50:141
140329981,6cyclictest19667-21x2gosqlitewrapp22:37:101
140329981,6cyclictest16345-21x2gosqlitewrapp21:42:091
140329981,6cyclictest1398-21apt-get22:10:181
140329981,5cyclictest25497-21x2gosqlitewrapp19:26:101
140329981,3cyclictest14487-21basename22:30:181
140329980,6cyclictest20935-21x2golistsession22:40:181
140329980,5cyclictest5481-21x2golistsession20:35:251
140329980,3cyclictest15023-21grep20:50:241
140329980,2cyclictest31499-21ntpdc22:05:221
140319986,1cyclictest24103-21wget21:05:170
140319986,1cyclictest0-21swapper/023:56:150
140319986,1cyclictest0-21swapper/020:36:050
140319986,1cyclictest0-21swapper/019:45:370
140319986,1cyclictest0-21swapper/019:40:190
140319986,1cyclictest0-21swapper/000:25:320
140319984,4cyclictest28636-21x2gosqlitewrapp19:30:550
140319984,3cyclictest32338-21x2golistsession23:46:110
140319984,3cyclictest31069-21x2gosqlitewrapp20:25:250
140319981,6cyclictest19661-21x2gosqlitewrapp20:07:490
140319981,6cyclictest16159-21x2gosqlitewrapp22:31:230
140319980,7cyclictest20688-21/usr/sbin/munin20:10:230
140319980,7cyclictest14526-21/usr/sbin/munin23:20:190
140319980,5cyclictest24189-21x2gosqlitewrapp23:35:110
140329971,5cyclictest11189-21x2golistsession23:15:041
140329970,1cyclictest14121-21apt-get19:10:161
140319975,1cyclictest24595-21gltestperf19:25:240
140319974,2cyclictest8434-21gltestperf19:50:190
140319973,3cyclictest24993-21iostat_ios22:45:210
140319972,4cyclictest28535-21ntp_kernel_err00:30:310
140319971,5cyclictest30575-21x2gosqlitewrapp22:55:070
140319971,5cyclictest10986-21x2gosqlitewrapp20:45:070
140319970,6cyclictest8106-21x2gosqlitewrapp00:00:160
140319970,6cyclictest16104-21x2gosqlitewrapp00:10:480
140319970,6cyclictest12412-21x2gosqlitewrapp19:55:380
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional