You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-27 - 14:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack7slot7s.osadl.org (updated Sat Jul 27, 2024 00:43:57)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
8277210476,9sleep10-21swapper/119:05:011
10295210175,9sleep30-21swapper/319:08:303
1020228564,6sleep20-21swapper/219:07:162
1036628270,8sleep00-21swapper/019:09:220
47562680,0sleep30-21swapper/323:44:013
317642440,0sleep10-21swapper/122:43:091
1049899411,20cyclictest2052-21ssh22:45:010
1049899390,20cyclictest0-21swapper/022:31:140
10498993815,3cyclictest0-21swapper/022:41:000
1050399310,0cyclictest0-21swapper/123:24:151
1049899294,20cyclictest1952-21irqstats22:25:210
1050899250,20cyclictest0-21swapper/321:45:103
10508992421,2cyclictest39-21ksoftirqd/323:15:073
1049899244,18cyclictest25740-21cron22:39:590
1050899230,1cyclictest0-21swapper/300:09:293
1049899236,7cyclictest141rcu_preempt19:15:000
1049899232,19cyclictest26714-21grep19:40:270
1049899231,20cyclictest7744-21snmpd19:32:000
10508992219,2cyclictest39-21ksoftirqd/322:20:003
10498992219,1cyclictest0-21swapper/019:45:300
10498992219,1cyclictest0-21swapper/019:36:220
10498992219,1cyclictest0-21swapper/019:36:210
1050599211,19cyclictest27450-21apt19:45:122
10508992010,7cyclictest472-21avahi-daemon00:00:043
1050899200,1cyclictest0-21swapper/300:20:033
1050599203,7cyclictest224-21systemd-journal23:28:322
10505992018,1cyclictest0-21swapper/220:25:112
1049899200,1cyclictest0-21swapper/021:35:120
1049899200,1cyclictest0-21swapper/021:35:120
10508991913,2cyclictest39-21ksoftirqd/321:17:163
1050899190,18cyclictest0-21swapper/323:08:403
10505991916,1cyclictest5779-21latency_hist21:50:002
10505991914,5cyclictest37850irq/131-snd_hda00:07:172
1050399190,1cyclictest0-21swapper/123:59:421
1050399190,19cyclictest0-21swapper/122:03:461
1049899199,8cyclictest20979-21apache223:37:280
1049899190,19cyclictest0-21swapper/021:45:200
1050899185,3cyclictest20472-21cut00:35:123
10508991815,2cyclictest381rcuc/323:00:123
1050899180,17cyclictest0-21swapper/323:53:583
1050399180,1cyclictest0-21swapper/100:31:071
10498991813,1cyclictest141rcu_preempt20:30:000
1049899180,15cyclictest0-21swapper/023:01:310
1050899171,14cyclictest0-21swapper/300:31:593
1050599179,4cyclictest224-21systemd-journal23:50:002
1050599177,4cyclictest4372-21munin-run21:29:592
1050599170,1cyclictest0-21swapper/223:58:242
1050599170,1cyclictest0-21swapper/222:18:562
10503991716,1cyclictest0-21swapper/121:32:511
1050399170,3cyclictest141rcu_preempt00:05:561
1050399170,17cyclictest0-21swapper/122:09:011
1050399170,0cyclictest0-21swapper/100:03:471
1050899169,2cyclictest39-21ksoftirqd/321:20:143
1050899163,3cyclictest141rcu_preempt22:00:053
10508991613,3cyclictest15200-21kworker/u8:220:45:083
10508991613,2cyclictest39-21ksoftirqd/323:57:213
10508991613,2cyclictest39-21ksoftirqd/322:34:593
1050899160,15cyclictest0-21swapper/322:54:283
10505991615,1cyclictest29856-21kworker/2:022:49:382
1050599161,14cyclictest3667-21apache_accesses23:05:112
1050599160,15cyclictest3027-21diskmemload21:44:272
1050599160,14cyclictest0-21swapper/221:30:202
1050399160,15cyclictest0-21swapper/122:54:271
1050399160,15cyclictest0-21swapper/100:12:191
1050399160,14cyclictest0-21swapper/123:25:501
1050899158,5cyclictest0-21swapper/319:20:133
10508991513,1cyclictest39-21ksoftirqd/322:10:073
10508991512,2cyclictest39-21ksoftirqd/321:50:223
1050899150,0cyclictest141rcu_preempt21:35:063
1050899150,0cyclictest141rcu_preempt21:35:063
1050599152,13cyclictest943-21kworker/2:122:31:122
10505991510,2cyclictest31931-21wc23:40:192
1050599150,15cyclictest0-21swapper/200:25:242
10503991510,3cyclictest15579-21cat22:15:001
1050399150,2cyclictest0-21swapper/120:40:151
1049899150,1cyclictest141rcu_preempt23:05:150
1049899150,15cyclictest0-21swapper/000:20:020
1050899147,1cyclictest8049-21runrttasks23:45:233
1050899146,5cyclictest39-21ksoftirqd/322:40:453
1050899141,3cyclictest20115-21strings20:35:213
10508991413,1cyclictest0-21swapper/322:07:173
10508991411,2cyclictest6207-21wc23:25:193
10508991411,2cyclictest39-21ksoftirqd/321:05:003
10508991410,3cyclictest3872-21head20:00:313
1050899140,0cyclictest141rcu_preempt21:11:133
1050599140,13cyclictest23098-21sh00:35:592
1050599140,13cyclictest0-21swapper/221:10:062
1050399144,8cyclictest0-21swapper/122:35:171
1050399140,2cyclictest0-21swapper/100:26:021
1050399140,1cyclictest0-21swapper/123:41:191
1050399140,14cyclictest0-21swapper/100:37:481
1050399140,0cyclictest0-21swapper/123:48:541
1049899140,0cyclictest0-21swapper/021:19:440
1050899139,3cyclictest39-21ksoftirqd/323:20:223
1050899139,2cyclictest27371-21wc19:45:013
1050899139,1cyclictest39-21ksoftirqd/323:11:483
1050899137,6cyclictest39-21ksoftirqd/300:17:343
1050899137,3cyclictest381rcuc/323:30:213
10508991312,1cyclictest39-21ksoftirqd/300:11:193
10508991311,1cyclictest39-21ksoftirqd/319:15:213
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional