You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-04-03 - 23:53

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack9slot4s (updated Thu Apr 03, 2025 12:59:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
89129911671158,6cyclictest0-21swapper/107:25:091
89129911321120,8cyclictest25659-21memory08:05:201
88542570523,32sleep00-21swapper/007:24:580
87972562517,30sleep10-21swapper/107:24:241
891199135105,15cyclictest0-21swapper/007:25:090
53922840,9sleep0891199cyclictest10:20:200
8911998174,4cyclictest0-21swapper/008:05:200
26702660,3sleep12669-21sh10:14:591
148382426,31sleep12220-21dbus-daemon10:50:321
247982400,8sleep1891299cyclictest11:20:331
8911993716,7cyclictest18300-21awk11:00:270
63562362,4sleep00-21swapper/012:10:460
891199351,11cyclictest81rcu_preempt12:08:490
8911993510,13cyclictest3020-21runrttasks08:04:190
891199349,12cyclictest2220-21dbus-daemon10:05:370
891199345,15cyclictest22323-21kernelversion11:15:200
278172341,29sleep027839-21munin-run11:35:010
891199332,19cyclictest1249-21/usr/sbin/munin08:30:170
8911993312,7cyclictest3020-21runrttasks09:09:220
42592331,4sleep04268-21munin-run12:05:010
104212331,4sleep12220-21dbus-daemon12:23:501
891299326,4cyclictest81rcu_preempt08:31:201
891299325,4cyclictest81rcu_preempt07:34:441
891199323,15cyclictest0-21swapper/009:33:110
891199321,18cyclictest29552-21ntp_states08:15:250
86752321,5sleep00-21swapper/010:31:320
68032321,5sleep00-21swapper/010:26:340
323162321,5sleep00-21swapper/010:02:150
256992321,5sleep00-21swapper/011:27:260
201662321,27sleep120171-21ntp_states07:50:301
119832321,5sleep111986-21irqstats12:30:571
105252321,5sleep00-21swapper/010:36:140
104682321,9sleep10-21swapper/110:35:371
891299316,4cyclictest81rcu_preempt12:37:261
891299315,4cyclictest81rcu_preempt12:06:351
891199319,18cyclictest111rcuc/012:33:070
891199317,12cyclictest24679-21switchtime11:20:320
891199311,4cyclictest81rcu_preempt09:39:350
8911993113,5cyclictest27457-21/usr/sbin/munin08:10:250
891199311,12cyclictest0-21swapper/011:45:370
8911993110,5cyclictest3020-21runrttasks07:41:550
3222311,5sleep00-21swapper/008:28:200
206652311,26sleep120666-21ntp_states11:10:231
125402311,5sleep00-21swapper/010:42:280
109132311,5sleep00-21swapper/012:27:240
891299307,12cyclictest40950irq/93-i91508:50:111
891299304,4cyclictest81rcu_preempt09:04:211
8912993020,6cyclictest11870-21ntpq10:40:241
891299301,7cyclictest3011-21grep12:00:191
891299301,4cyclictest81rcu_preempt10:30:491
891299301,4cyclictest81rcu_preempt08:23:291
891299300,4cyclictest81rcu_preempt08:18:251
891199306,11cyclictest13538-21fschecks_count12:35:160
891199302,14cyclictest7329-21diskstats08:50:110
891199302,14cyclictest16936-21/usr/sbin/munin09:15:170
8911993012,6cyclictest4023-21taskset08:36:340
891199301,18cyclictest28093-21mailstats09:50:240
8911993011,7cyclictest0-21swapper/010:51:520
8911993010,6cyclictest3020-21runrttasks09:22:260
258012301,25sleep125869-21users09:40:301
198482301,6sleep10-21swapper/109:22:591
122302301,5sleep00-21swapper/009:01:590
891299295,4cyclictest81rcu_preempt09:05:531
891299294,4cyclictest81rcu_preempt12:13:411
891299294,4cyclictest81rcu_preempt11:59:541
891299293,4cyclictest6928-21/usr/sbin/munin12:15:221
8912992915,11cyclictest14226-21missed_timers07:35:231
891299291,15cyclictest31704-21ntp_states10:00:261
891199299,7cyclictest15937-21/usr/sbin/munin10:55:160
891199299,7cyclictest14867-21/usr/sbin/munin09:10:150
891199297,10cyclictest6204-21gdbus09:41:490
891199292,14cyclictest6958-21/usr/sbin/munin12:15:120
891199292,14cyclictest16079-21/usr/sbin/munin12:40:270
891199292,13cyclictest30704-21ntp_states11:40:250
8911992911,5cyclictest19920-21/usr/sbin/munin11:10:090
320032291,5sleep00-21swapper/008:21:400
319002291,5sleep10-21swapper/111:46:461
304682291,5sleep00-21swapper/009:57:450
208972291,4sleep00-21swapper/007:53:300
19802291,5sleep00-21swapper/011:57:020
193192291,5sleep00-21swapper/011:06:170
189102291,5sleep00-21swapper/012:50:350
161302291,5sleep10-21swapper/109:13:301
131362291,5sleep00-21swapper/010:47:090
122062291,3sleep012289-21/usr/sbin/munin07:30:280
891299289,6cyclictest0-21swapper/112:25:461
891299289,5cyclictest0-21swapper/110:15:191
891299288,6cyclictest17651-21aten_r4power_en12:50:081
891299284,15cyclictest0-21swapper/110:57:251
891299284,15cyclictest0-21swapper/108:10:461
891299283,17cyclictest0-21swapper/110:26:581
891299283,15cyclictest0-21swapper/109:58:171
891299282,4cyclictest81rcu_preempt11:32:171
891299281,7cyclictest21793-21interrupts07:55:211
891299281,7cyclictest21793-21interrupts07:55:201
891299281,6cyclictest0-21swapper/111:42:121
891299281,4cyclictest81rcu_preempt09:47:331
891299281,4cyclictest81rcu_preempt08:46:131
8912992811,4cyclictest17455-21sensors_temp09:15:271
8912992810,4cyclictest81rcu_preempt08:55:171
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional