You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-27 - 14:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack9slot4s (updated Sat Jul 27, 2024 00:59:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
324539911621146,13cyclictest748-21kworker/1:219:26:521
322572562516,31sleep00-21swapper/019:23:320
316272484436,32sleep10-21swapper/119:20:301
3245299113104,6cyclictest0-21swapper/019:26:520
314942900,3sleep10-21swapper/122:10:261
3245299371,23cyclictest11990-21cron19:55:000
82352361,31sleep08296-21df21:10:120
217762351,4sleep021861-21/usr/sbin/munin21:45:220
32453993418,3cyclictest40950irq/93-i91500:05:421
3245299341,7cyclictest7030-21hddtemp_smartct19:40:200
3245299341,7cyclictest7030-21hddtemp_smartct19:40:200
3245299341,21cyclictest25710-21/usr/sbin/munin21:55:260
266912341,10sleep10-21swapper/120:31:341
3245399335,5cyclictest81rcu_preempt22:27:281
3245399335,17cyclictest40950irq/93-i91521:05:481
3245299337,21cyclictest81rcu_preempt22:30:000
3245299331,19cyclictest12750-21iostat19:55:220
134922331,28sleep113518-21munin-run21:25:001
32453993223,6cyclictest4070-21sh23:50:181
307642321,4sleep130766-21irqstats23:35:181
227632320,3sleep0111rcuc/023:15:120
90152311,5sleep00-21swapper/022:36:410
80682311,26sleep08086-21ntp_states00:00:300
72932311,5sleep10-21swapper/122:33:171
3245399315,4cyclictest81rcu_preempt19:36:131
3245399314,4cyclictest81rcu_preempt20:49:321
3245399312,4cyclictest81rcu_preempt00:47:461
32453993112,6cyclictest40950irq/93-i91523:20:221
32453993111,6cyclictest0-21swapper/119:49:381
32452993117,8cyclictest23734-21diskstats20:25:140
32452993114,6cyclictest3-21ksoftirqd/000:37:580
32452993111,16cyclictest31604-21grep22:10:290
194922311,4sleep019501-21iostat_ios23:05:190
137912311,4sleep113838-21cat22:50:181
70802301,5sleep00-21swapper/022:31:030
3245399305,4cyclictest81rcu_preempt20:16:291
3245399305,4cyclictest81rcu_preempt19:50:441
3245399305,3cyclictest81rcu_preempt20:41:181
3245399303,4cyclictest81rcu_preempt23:48:281
3245399302,11cyclictest32115-21wget23:40:081
32453993014,5cyclictest81rcu_preempt22:20:001
3245399301,24cyclictest19191-21df_inode23:05:131
3245299303,14cyclictest0-21swapper/000:20:240
3245299301,4cyclictest81rcu_preempt22:17:030
32452993012,5cyclictest12665-21users22:45:360
297762301,5sleep00-21swapper/023:32:370
274092301,5sleep00-21swapper/000:51:150
252062300,5sleep0111rcuc/000:45:300
229532301,5sleep10-21swapper/120:21:391
218622301,4sleep121907-21/usr/sbin/munin21:45:231
165042301,5sleep00-21swapper/022:56:260
53482291,5sleep00-21swapper/023:55:070
50402291,5sleep00-21swapper/023:53:290
32992291,5sleep00-21swapper/022:20:440
32852291,5sleep00-21swapper/023:49:430
3245399296,11cyclictest40950irq/93-i91520:10:241
3245399294,4cyclictest81rcu_preempt23:19:111
3245399294,15cyclictest0-21swapper/120:03:141
3245399291,5cyclictest81rcu_preempt23:03:101
3245399291,4cyclictest81rcu_preempt22:03:411
3245399291,4cyclictest81rcu_preempt21:33:451
3245299293,14cyclictest0-21swapper/022:03:070
3245299293,13cyclictest0-21swapper/019:48:430
3245299292,14cyclictest5109-21fschecks_time19:35:170
3245299292,14cyclictest28981-21df_inode22:05:170
3245299291,4cyclictest81rcu_preempt00:15:140
32452992912,5cyclictest19128-21munin-run21:40:010
32452992911,5cyclictest6431-21df_inode21:05:140
3245299291,14cyclictest15814-21ls21:30:200
3245299291,13cyclictest32535-21runrttasks20:48:350
3245299291,12cyclictest25780-21grep20:30:180
32452992910,15cyclictest191122chrt20:10:540
32452992910,14cyclictest5532-21users21:00:360
3245299290,4cyclictest81rcu_preempt00:06:120
285832290,5sleep128581-21df23:30:171
222352291,5sleep00-21swapper/023:12:220
200032291,5sleep10-21swapper/100:32:421
172822291,5sleep00-21swapper/020:06:220
163462291,5sleep10-21swapper/100:23:391
144872291,6sleep10-21swapper/100:19:021
130632291,5sleep00-21swapper/021:20:310
125882291,5sleep00-21swapper/000:13:480
111982291,5sleep00-21swapper/021:15:500
10472291,5sleep00-21swapper/023:42:090
3245399284,17cyclictest14519-21ntp_states21:25:431
3245399284,15cyclictest0-21swapper/120:55:011
3245399282,4cyclictest81rcu_preempt00:11:041
3245399282,3cyclictest81rcu_preempt22:49:081
3245399281,13cyclictest27254-21ntp_states23:25:241
3245399280,4cyclictest81rcu_preempt22:22:331
3245299289,14cyclictest17471-21ntpq00:25:240
3245299282,4cyclictest81rcu_preempt23:29:070
3245299282,13cyclictest20239-21/usr/sbin/munin21:40:330
3245299281,23cyclictest28721-21seq20:38:110
3245299281,15cyclictest10591-21ls22:40:350
3245299281,13cyclictest3230-21tune2fs19:30:160
3245299281,13cyclictest24321-21/usr/sbin/munin21:50:350
317542281,5sleep00-21swapper/023:38:400
261922281,5sleep00-21swapper/023:24:190
247912283,5sleep122-21ksoftirqd/120:26:171
238202281,5sleep00-21swapper/000:43:130
229012281,5sleep00-21swapper/020:21:050
207752281,5sleep10-21swapper/123:10:081
196692281,5sleep00-21swapper/020:15:110
153562281,4sleep00-21swapper/020:00:480
152872281,4sleep00-21swapper/021:29:100
149002281,5sleep00-21swapper/022:54:150
108642281,5sleep10-21swapper/122:41:131
70512271,5sleep10-21swapper/123:59:531
3245399279,14cyclictest0-21swapper/120:50:321
3245399275,3cyclictest81rcu_preempt21:12:061
3245399274,4cyclictest81rcu_preempt21:35:411
3245399274,4cyclictest81rcu_preempt21:01:331
3245399274,4cyclictest81rcu_preempt00:41:441
3245399274,14cyclictest0-21swapper/100:36:321
3245399272,22cyclictest0-21swapper/100:03:101
3245399271,5cyclictest19896-21iostat21:40:221
3245399271,5cyclictest0-21swapper/121:50:151
3245399271,4cyclictest81rcu_preempt22:35:401
3245299273,12cyclictest0-21swapper/020:55:130
3245299272,12cyclictest0-21swapper/020:40:300
301452271,5sleep10-21swapper/122:07:221
288812271,5sleep10-21swapper/120:39:541
20762271,4sleep00-21swapper/020:54:450
198172271,5sleep00-21swapper/000:30:470
182252271,5sleep10-21swapper/100:28:451
167092271,5sleep10-21swapper/122:58:341
136632271,4sleep10-21swapper/119:57:561
3245399262,4cyclictest81rcu_preempt19:41:481
3245399262,4cyclictest81rcu_preempt19:41:481
32453992617,6cyclictest26777-21missed_timers00:50:231
3245399261,11cyclictest3231-21grep19:30:161
32452992620,4cyclictest3-21ksoftirqd/023:00:310
3245399254,11cyclictest0-21swapper/120:05:031
3245399252,10cyclictest25216-21diskstats21:55:151
32453992413,7cyclictest10490-21irqstats21:15:211
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional