You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-11-25 - 14:22

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack9slot4s (updated Mon Nov 25, 2024 00:59:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
198579911971153,39cyclictest20594-21iostat_ios19:25:190
198589911881171,14cyclictest0-21swapper/119:25:151
197672582536,30sleep00-21swapper/019:24:390
194312461417,30sleep10-21swapper/119:21:041
19857996110,13cyclictest5240-21fschecks_time00:30:190
130832580,8sleep01985799cyclictest23:20:280
305692570,8sleep01985799cyclictest19:50:210
19857995518,7cyclictest7555-21ntp_kernel_pll_21:40:230
1985799541,13cyclictest17188-21/usr/sbin/munin22:05:320
1985799512,16cyclictest0-21swapper/022:51:140
19857995011,7cyclictest8240-21timerwakeupswit20:15:300
112932500,8sleep10-21swapper/123:15:281
230072480,8sleep11985899cyclictest19:30:171
1985799482,14cyclictest22340-21df23:50:110
1985799481,14cyclictest10419-21sort00:45:010
279272460,3sleep1211ktimersoftd/122:35:161
192512450,6sleep00-21swapper/020:45:240
303182381,6sleep130327-21df_inode19:50:171
1985899351,11cyclictest0-21swapper/100:08:391
95942341,29sleep02220-21dbus-daemon23:11:050
53982341,28sleep15496-21df20:10:121
251862340,6sleep025183-21ntpdc19:35:230
308432331,4sleep16203-21packagekitd22:43:021
19858993319,8cyclictest24683-21diskstats19:35:151
1985799337,13cyclictest14864-21mailstats23:25:270
19857993310,12cyclictest15487-21/usr/sbin/munin22:00:300
258462311,4sleep125853-21diskstats22:30:191
1985899315,4cyclictest81rcu_preempt20:07:421
19858993118,10cyclictest22-21ksoftirqd/100:45:281
1985899311,4cyclictest81rcu_preempt20:40:421
1985799313,15cyclictest22012-21cut22:20:120
1985799313,15cyclictest0-21swapper/019:46:180
1985799313,15cyclictest0-21swapper/019:44:510
1985799311,4cyclictest81rcu_preempt23:45:020
19857993112,5cyclictest30337-21python22:40:290
134062311,26sleep113546-21cat21:55:321
66372301,5sleep10-21swapper/100:35:061
43862301,5sleep10-21swapper/121:31:501
292142301,5sleep10-21swapper/121:11:551
292142301,5sleep10-21swapper/121:11:551
1985899305,4cyclictest81rcu_preempt20:35:381
1985899304,4cyclictest81rcu_preempt23:01:341
1985899304,17cyclictest0-21swapper/121:27:221
1985899302,13cyclictest3020-21runrttasks00:01:331
1985899301,5cyclictest81rcu_preempt21:38:271
1985899301,4cyclictest81rcu_preempt23:50:401
19858993013,4cyclictest7682-21interrupts20:15:201
1985899301,16cyclictest18876-21perl20:45:161
1985899301,16cyclictest11344-21ntp_states21:50:281
1985799303,13cyclictest2220-21dbus-daemon21:04:580
1985799302,16cyclictest0-21swapper/020:50:370
1985799302,15cyclictest24511-21ntp_states22:25:250
19857993012,5cyclictest5810-21iostat_ios20:10:170
19857993011,6cyclictest4166-21/usr/sbin/munin00:25:290
1985799301,14cyclictest18916-21/usr/sbin/munin23:35:290
105202301,5sleep00-21swapper/000:45:590
81202291,5sleep10-21swapper/121:41:241
59322291,5sleep00-21swapper/023:02:040
211862291,5sleep10-21swapper/123:44:091
211132291,5sleep00-21swapper/023:43:220
1985899298,4cyclictest81rcu_preempt21:15:101
1985899294,9cyclictest31755-21diskstats00:15:161
1985899294,4cyclictest81rcu_preempt22:51:211
1985899294,4cyclictest81rcu_preempt20:59:321
1985899294,4cyclictest81rcu_preempt20:22:561
1985899294,10cyclictest0-21swapper/123:06:071
1985899291,8cyclictest12490-21fschecks_time23:20:151
1985899291,4cyclictest81rcu_preempt22:13:491
1985899291,4cyclictest81rcu_preempt19:57:231
1985899291,4cyclictest81rcu_preempt19:47:011
19858992913,7cyclictest0-21swapper/120:30:011
1985799296,8cyclictest32742-21ntp_states19:55:260
1985799294,3cyclictest81rcu_preempt20:33:570
1985799291,4cyclictest81rcu_preempt20:35:060
19857992912,5cyclictest17128-21runrttasks23:31:110
19857992911,5cyclictest9126-21hddtemp_smartct21:45:170
19857992911,5cyclictest28506-21wc22:35:280
19857992911,5cyclictest24246-21idleruntime-cro19:35:010
1985799291,12cyclictest32179-21irqstats21:20:230
19857992910,5cyclictest29585-21/usr/sbin/munin00:10:160
181722291,5sleep00-21swapper/020:44:280
118752291,5sleep00-21swapper/021:51:270
312092281,5sleep10-21swapper/100:14:061
271402281,5sleep00-21swapper/000:00:510
25622281,5sleep10-21swapper/100:24:081
25162281,5sleep10-21swapper/122:55:051
249932281,5sleep10-21swapper/122:25:551
213502281,5sleep10-21swapper/122:17:121
1985899285,4cyclictest81rcu_preempt22:06:511
1985899284,9cyclictest26970-21memory19:40:221
1985899284,4cyclictest81rcu_preempt22:46:531
1985899284,4cyclictest81rcu_preempt21:23:281
1985899284,3cyclictest81rcu_preempt23:30:191
1985899283,4cyclictest81rcu_preempt20:54:141
1985899282,4cyclictest81rcu_preempt22:00:101
1985899282,4cyclictest81rcu_preempt00:30:501
1985899281,15cyclictest21912-21munin-plugin-st23:50:001
1985799288,9cyclictest0-21swapper/000:50:240
1985799286,18cyclictest111rcuc/023:18:400
1985799284,4cyclictest81rcu_preempt21:07:440
1985799282,22cyclictest0-21swapper/022:45:290
1985799282,21cyclictest2383-21/usr/sbin/munin20:00:280
1985799282,14cyclictest20714-21/usr/sbin/munin22:15:230
1985799282,12cyclictest3086-21basename21:30:140
19857992812,5cyclictest2220-21dbus-daemon21:11:360
19857992812,5cyclictest2220-21dbus-daemon21:11:360
19857992811,5cyclictest1817-21/usr/sbin/munin21:25:240
1985799281,14cyclictest7874-21grep00:35:310
19857992810,6cyclictest31942-21tune2fs00:15:160
19857992810,4cyclictest24093-21runrttasks23:55:130
1985899274,4cyclictest81rcu_preempt23:39:171
1985899274,17cyclictest24536-21iostat_ios23:55:201
1985899273,4cyclictest81rcu_preempt21:05:101
1985899273,4cyclictest81rcu_preempt20:01:301
1985899273,15cyclictest0-21swapper/121:02:271
1985899272,8cyclictest9646-21python21:45:281
1985899270,4cyclictest81rcu_preempt23:25:241
1985799279,6cyclictest29824-21cpu21:15:110
1985799277,6cyclictest22663-21sed20:55:170
1985799271,13cyclictest7766-21sshd23:06:380
1985799271,13cyclictest4399-21ls20:05:280
1985799271,13cyclictest3020-21runrttasks20:28:460
19857992710,5cyclictest28581-21proc_pri00:05:250
108652271,5sleep10-21swapper/120:25:071
19858992618,5cyclictest12881-21latency_hist00:55:011
1985899261,21cyclictest2879-21/usr/sbin/munin00:25:251
1985899261,16cyclictest0-21swapper/122:20:571
19858992610,4cyclictest81rcu_preempt00:40:281
1985799267,5cyclictest5298-21fschecks_time21:35:140
1985799266,7cyclictest0-21swapper/022:31:420
1985799261,17cyclictest0-21swapper/022:56:140
19857992610,6cyclictest0-21swapper/022:10:220
19857992610,4cyclictest13986-21taskset21:58:550
1985899252,19cyclictest9526-21users23:10:331
19857992516,6cyclictest3-21ksoftirqd/000:23:590
1985799241,21cyclictest0-21swapper/020:24:170
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional