You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-04-02 - 04:13

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Wed Apr 02, 2025 00:59:00)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
199959912311207,21cyclictest0-21swapper/019:25:080
199969911541126,21cyclictest28583-21diskstats19:45:151
199969910761066,7cyclictest0-21swapper/119:25:111
195872639594,30sleep00-21swapper/019:21:160
195332518472,31sleep10-21swapper/119:20:431
199959911189,18cyclictest0-21swapper/019:45:140
166732840,6sleep0111rcuc/000:07:000
272282820,24sleep1201rcuc/121:15:011
41912490,6sleep14190-21cat21:40:281
210192480,8sleep01999599cyclictest22:35:270
1999699441,15cyclictest0-21swapper/100:25:081
188462410,8sleep01999599cyclictest00:15:000
1999599383,5cyclictest81rcu_preempt20:50:200
215662361,9sleep10-21swapper/122:38:291
1999599351,29cyclictest28917-21cat00:45:000
1999699347,3cyclictest81rcu_preempt20:28:241
19995993418,5cyclictest3-21ksoftirqd/022:25:590
1999599341,21cyclictest23902-21smartctl00:30:190
302742331,9sleep00-21swapper/023:07:420
1999699336,4cyclictest81rcu_preempt19:33:271
1999699333,27cyclictest24345-21gzip00:30:271
1999599331,28cyclictest26754-21fschecks_time22:55:170
1999599331,20cyclictest31334-21/usr/sbin/munin19:50:350
177202331,4sleep117122-21/usr/sbin/munin00:10:181
1999699326,4cyclictest81rcu_preempt23:08:101
1999699325,4cyclictest81rcu_preempt23:24:531
1999699324,4cyclictest81rcu_preempt22:50:151
1999599326,13cyclictest14479-21needreboot22:15:220
19995993217,5cyclictest3-21ksoftirqd/023:13:140
19995993216,5cyclictest3-21ksoftirqd/000:53:360
1999699316,4cyclictest81rcu_preempt22:09:301
1999699315,4cyclictest81rcu_preempt23:35:101
1999699315,4cyclictest81rcu_preempt21:35:061
1999699313,9cyclictest0-21swapper/123:28:291
1999699312,4cyclictest81rcu_preempt20:44:571
1999699311,4cyclictest81rcu_preempt23:56:451
1999599312,15cyclictest12626-21sort23:55:000
1999599312,13cyclictest2220-21dbus-daemon20:26:470
19995993115,5cyclictest3-21ksoftirqd/021:52:440
1999599311,4cyclictest81rcu_preempt23:02:450
19995993113,5cyclictest6843-21cut23:35:170
1999699307,4cyclictest81rcu_preempt19:51:381
1999699306,4cyclictest81rcu_preempt22:12:301
1999699305,4cyclictest81rcu_preempt21:32:281
1999699305,4cyclictest81rcu_preempt19:42:091
1999699305,4cyclictest81rcu_preempt00:52:581
1999699304,4cyclictest81rcu_preempt22:17:401
1999699304,4cyclictest81rcu_preempt21:06:151
1999699304,4cyclictest81rcu_preempt20:08:531
1999699304,17cyclictest0-21swapper/100:49:301
1999699303,17cyclictest0-21swapper/122:23:471
19996993010,6cyclictest22375-21fschecks_time22:40:171
1999599308,11cyclictest0-21swapper/023:33:080
1999599306,20cyclictest0-21swapper/019:57:120
1999599304,4cyclictest40950irq/93-i91521:55:290
1999599303,15cyclictest0-21swapper/020:47:450
1999599303,14cyclictest0-21swapper/021:33:590
19995993014,6cyclictest3-21ksoftirqd/020:44:200
19995993014,5cyclictest3-21ksoftirqd/020:39:540
19995993012,6cyclictest30951-21latency_hist21:25:010
1999599301,25cyclictest22880-21/usr/sbin/munin22:40:280
1999599301,17cyclictest6204-21gdbus21:35:250
19995993010,16cyclictest24487-21aten_r4power_vo22:50:080
92002291,5sleep00-21swapper/020:21:140
50502291,5sleep00-21swapper/021:46:080
36762291,5sleep00-21swapper/020:07:290
36272291,5sleep00-21swapper/023:23:130
31362291,5sleep00-21swapper/020:03:220
295052291,5sleep10-21swapper/123:01:101
232192291,5sleep00-21swapper/000:29:490
1999699296,4cyclictest81rcu_preempt23:33:141
1999699295,4cyclictest81rcu_preempt19:39:011
1999699294,4cyclictest81rcu_preempt21:48:431
1999699293,4cyclictest81rcu_preempt20:36:421
1999699291,4cyclictest81rcu_preempt23:16:251
1999699291,12cyclictest8454-21mailstats21:55:291
1999599292,15cyclictest0-21swapper/021:04:250
1999599292,14cyclictest10644-21diskstats20:30:110
1999599291,4cyclictest81rcu_preempt00:03:320
19995992914,5cyclictest3-21ksoftirqd/021:15:090
19995992914,5cyclictest3-21ksoftirqd/020:15:170
19995992913,6cyclictest3-21ksoftirqd/000:39:560
19995992913,5cyclictest3-21ksoftirqd/000:45:210
1999599291,24cyclictest99102sleep023:43:220
1999599291,24cyclictest99102sleep023:43:210
1999599291,15cyclictest26808-21runrttasks21:11:560
19995992911,5cyclictest24594-21/usr/sbin/munin21:05:290
1999599291,14cyclictest32710-21cat23:15:140
1999599291,14cyclictest12684-21ntpq22:10:220
1999599291,13cyclictest23131-21fschecks_time19:30:190
171572291,5sleep00-21swapper/022:23:100
124162291,5sleep10-21swapper/123:53:271
74302281,5sleep10-21swapper/120:17:311
69542281,5sleep10-21swapper/121:51:261
44262281,5sleep00-21swapper/021:41:090
43412281,5sleep00-21swapper/023:29:090
314182281,5sleep10-21swapper/121:29:111
238612281,5sleep00-21swapper/022:46:080
203692281,4sleep00-21swapper/000:16:230
1999699286,4cyclictest81rcu_preempt22:31:501
1999699283,4cyclictest81rcu_preempt00:40:071
1999699281,4cyclictest81rcu_preempt20:48:541
1999599289,5cyclictest21249-21fschecks_count00:20:170
1999599281,13cyclictest18629-21/usr/sbin/munin22:30:150
19995992810,6cyclictest27022-21irqstats19:40:220
162482281,5sleep10-21swapper/100:04:071
118302281,5sleep10-21swapper/120:32:351
107622281,5sleep00-21swapper/022:01:510
287642271,5sleep10-21swapper/121:17:481
266262271,4sleep10-21swapper/100:36:161
260172271,5sleep00-21swapper/019:37:470
203662271,22sleep120367-21sshd00:16:211
1999699277,6cyclictest24324-21kworker/1:223:00:001
1999699274,4cyclictest81rcu_preempt22:49:461
1999699273,15cyclictest0-21swapper/121:01:541
1999699271,4cyclictest81rcu_preempt20:24:061
1999699271,4cyclictest81rcu_preempt20:02:101
1999699271,17cyclictest0-21swapper/120:12:581
1999599270,4cyclictest81rcu_preempt21:25:070
175582271,5sleep10-21swapper/122:25:501
104492271,5sleep10-21swapper/123:47:281
1999699263,17cyclictest20047-21diskstats20:55:151
1999699263,14cyclictest0-21swapper/123:41:451
1999699263,14cyclictest0-21swapper/123:41:451
19996992617,6cyclictest22-21ksoftirqd/122:02:291
1999699261,4cyclictest81rcu_preempt00:20:071
19996992610,5cyclictest40950irq/93-i91521:20:211
1999599265,3cyclictest0-21swapper/020:55:160
19995992617,6cyclictest3-21ksoftirqd/023:48:100
1999599261,13cyclictest13354-21tr23:55:220
1999599261,12cyclictest5356-21/usr/sbin/munin20:10:280
166802261,4sleep10-21swapper/100:07:041
12642261,5sleep10-21swapper/119:59:521
19996992517,5cyclictest22-21ksoftirqd/123:12:491
1999699251,14cyclictest0-21swapper/120:51:311
1999599241,15cyclictest0-21swapper/022:05:210
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional