You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-04-03 - 23:53

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack7slot4s.osadl.org (updated Thu Apr 03, 2025 12:45:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
22533996417,36cyclictest27-21ksoftirqd/210:15:142
22533996410,43cyclictest0-21swapper/209:55:152
2253399452,25cyclictest28821-21ssh10:50:132
22510994517,24cyclictest0-21swapper/008:40:120
22544994319,17cyclictest0-21swapper/309:22:323
22544994319,17cyclictest0-21swapper/309:22:313
2254499420,25cyclictest25866irq/58-eth012:10:093
2254499420,25cyclictest25866irq/58-eth012:10:083
2253399419,24cyclictest0-21swapper/207:45:122
2253399414,12cyclictest22498-21cyclictest07:55:152
2251099412,16cyclictest18531-21sendmail-msp12:00:140
22533994013,21cyclictest0-21swapper/212:30:082
22533994013,21cyclictest0-21swapper/212:30:082
22533994013,17cyclictest27-21ksoftirqd/211:35:142
2251099402,32cyclictest29870-21sendmail-msp11:40:140
2254499393,25cyclictest25866irq/58-eth010:10:093
2253399392,18cyclictest7701-21cat10:30:322
2253399392,18cyclictest7701-21cat10:30:322
2252299391,36cyclictest13831-21sendmail-msp09:20:141
2252299391,36cyclictest13831-21sendmail-msp09:20:141
22544993829,7cyclictest0-21swapper/311:50:133
2254499382,21cyclictest25866irq/58-eth011:10:093
22533993827,8cyclictest22046irq/40-fe98000008:00:142
2253399382,29cyclictest19833-21ssh09:22:322
2253399382,29cyclictest19833-21ssh09:22:312
2253399382,28cyclictest12942-21ssh11:26:322
2252299383,23cyclictest6405-21sendmail-msp09:40:121
22510993814,19cyclictest31244-21sendmail-msp10:00:140
22544993718,9cyclictest0-21swapper/307:10:123
2253399372,28cyclictest29800-21ssh09:32:312
2253399372,27cyclictest4636-21cat09:10:322
2252299372,31cyclictest18119-21sendmail-msp10:40:131
2252299361,24cyclictest7691-21sh11:50:131
2253399354,21cyclictest22146irq/40-dwc2_hso08:50:102
2253399353,21cyclictest25242-21sendmail-msp08:20:142
22533993515,5cyclictest0-21swapper/207:30:192
2252299353,22cyclictest32077-21sendmail-msp07:20:141
2253399344,12cyclictest6950-21ssh09:15:122
2253399343,12cyclictest9763-21ssh10:10:082
2251099332,24cyclictest4528-21sendmail-msp11:20:130
2253399323,23cyclictest18531-21sendmail-msp12:00:162
2253399322,14cyclictest18149-21ssh11:03:322
2253399316,15cyclictest543-21ssh12:35:122
2253399312,21cyclictest1443-21ntp_192.168.11411:40:322
2252299312,23cyclictest24399-21sendmail-msp10:20:321
2251099313,20cyclictest11535-21sendmail-msp11:00:130
2251099312,21cyclictest1097-21/usr/sbin/munin10:50:310
2254499303,19cyclictest25866irq/58-eth007:30:203
22533993011,11cyclictest0-21swapper/209:50:092
2252299302,20cyclictest11535-21sendmail-msp11:00:321
2251099305,16cyclictest12-21ksoftirqd/010:30:140
2251099305,16cyclictest12-21ksoftirqd/010:30:140
2251099302,21cyclictest1713-21ssh10:28:320
22544992918,8cyclictest25866irq/58-eth010:00:133
2253399292,10cyclictest24399-21sendmail-msp10:20:142
2253399291,15cyclictest22146irq/40-dwc2_hso08:15:122
2253399291,11cyclictest601-21rngd12:11:362
2253399291,11cyclictest601-21rngd12:11:362
2251099292,19cyclictest18119-21sendmail-msp10:41:320
2254499283,16cyclictest0-21swapper/310:28:323
22544992811,12cyclictest0-21swapper/311:20:133
2253399289,11cyclictest0-21swapper/207:25:122
2253399286,16cyclictest0-21swapper/209:47:312
2253399284,14cyclictest22146irq/40-dwc2_hso08:30:112
2253399284,14cyclictest22146irq/40-dwc2_hso07:15:142
2253399282,21cyclictest13714-21ssh12:19:322
2252299283,19cyclictest30555-21ssh12:10:091
2252299283,19cyclictest30555-21ssh12:10:091
2252299282,19cyclictest4528-21sendmail-msp11:21:321
2252299282,19cyclictest11772-21ssh09:15:311
2251099282,20cyclictest4196-21ssh10:55:130
2254499273,16cyclictest0-21swapper/311:26:313
2254499273,12cyclictest0-21swapper/310:57:313
22544992716,5cyclictest0-21swapper/309:00:133
22544992716,5cyclictest0-21swapper/309:00:133
2253399279,6cyclictest10659-21ssh10:35:092
2253399278,15cyclictest0-21swapper/207:10:122
2253399272,15cyclictest22146irq/40-dwc2_hso09:35:132
22533992717,7cyclictest601-21rngd11:10:092
22533992713,9cyclictest601-21rngd09:05:142
22533992713,9cyclictest601-21rngd09:05:142
22533992713,5cyclictest17758-21apt-get08:55:152
2252299271,19cyclictest31244-21sendmail-msp10:01:331
2251099272,19cyclictest28051-21ssh11:12:320
2254499264,9cyclictest25866irq/58-eth012:35:133
2254499263,15cyclictest0-21swapper/311:03:323
2254499263,15cyclictest0-21swapper/310:30:323
2254499263,15cyclictest0-21swapper/310:30:313
22544992610,11cyclictest0-21swapper/312:30:103
22544992610,11cyclictest0-21swapper/312:30:103
2253399266,11cyclictest0-21swapper/212:06:022
22510992615,7cyclictest32044-21diskmemload11:30:170
2254499259,11cyclictest25866irq/58-eth009:10:143
2254499254,15cyclictest0-21swapper/309:50:103
2254499252,16cyclictest0-21swapper/310:35:123
2253399258,9cyclictest7664-21sendmail-msp08:40:372
2253399254,15cyclictest22146irq/40-dwc2_hso07:35:152
2253399251,9cyclictest11064-21ssh11:23:322
22533992518,4cyclictest15767-21ssh11:30:212
22533992511,9cyclictest4170-21apt-get10:55:132
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional