You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-04-03 - 04:26

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack1slot2s.osadl.org (updated Thu Apr 03, 2025 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2658825036,0sleep00-21swapper/018:44:240
291350440,0irq/25-eth10-21swapper/318:46:343
2683223425,0sleep20-21swapper/218:47:142
2683123228,0sleep10-21swapper/118:47:131
269909976,0cyclictest27466-21tr20:23:331
35160,0ktimersoftd/30-21swapper/319:58:323
339960,0migration/331488-21sh22:05:573
339960,0migration/33091-21kthreadcore20:53:323
339960,0migration/324357-21sh22:24:153
339960,0migration/321305-21sh21:55:073
339960,0migration/319001-21munin-node21:28:323
339960,0migration/311229-21sh23:04:083
28415060,0irq/27-eth0-tx-5053-21ssh21:44:142
28415060,0irq/27-eth0-tx-3370-21munin-node19:43:280
28415060,0irq/27-eth0-tx-16080-21ssh21:00:292
28415060,0irq/27-eth0-tx-0-21swapper/223:55:382
28415060,0irq/27-eth0-tx-0-21swapper/223:36:052
28415060,0irq/27-eth0-tx-0-21swapper/223:25:112
28415060,0irq/27-eth0-tx-0-21swapper/223:17:552
28415060,0irq/27-eth0-tx-0-21swapper/223:10:192
28415060,0irq/27-eth0-tx-0-21swapper/223:03:272
28415060,0irq/27-eth0-tx-0-21swapper/222:41:412
28415060,0irq/27-eth0-tx-0-21swapper/222:24:342
28415060,0irq/27-eth0-tx-0-21swapper/222:18:522
28415060,0irq/27-eth0-tx-0-21swapper/222:05:392
28415060,0irq/27-eth0-tx-0-21swapper/221:55:522
28415060,0irq/27-eth0-tx-0-21swapper/221:40:082
28415060,0irq/27-eth0-tx-0-21swapper/221:38:032
28415060,0irq/27-eth0-tx-0-21swapper/221:24:042
28415060,0irq/27-eth0-tx-0-21swapper/221:09:422
28415060,0irq/27-eth0-tx-0-21swapper/220:50:282
28405060,0irq/26-eth0-rx-20019-21perl22:48:233
28405060,0irq/26-eth0-rx-10583-21iostat_ios22:38:343
269929966,0cyclictest0-21swapper/221:07:062
269929964,0cyclictest27511-21grep19:58:322
269909966,0cyclictest0-21swapper/123:13:311
269909960,0cyclictest5526-21irqrtprio20:08:351
269899966,0cyclictest0-21swapper/022:47:040
269899960,0cyclictest25138-21diskmemload22:02:080
8225050,0irq/24-0000:00:7938-21latency_hist18:58:142
8225050,0irq/24-0000:00:0-21swapper/223:39:142
339950,0migration/3887-21munin-node21:13:363
339950,0migration/3696-21kthreadcore20:03:333
339950,0migration/36222-21munin-node20:33:303
339950,0migration/34626-21kthreadcore19:18:313
339950,0migration/330599-21taskset20:26:033
339950,0migration/329177-21aten_r1power_po19:38:263
339950,0migration/326975-21kthreadcore00:08:273
339950,0migration/322577-21kthreadcore23:13:313
339950,0migration/319911-21kthreadcore19:03:333
339950,0migration/314559-21kthreadcore19:48:353
339950,0migration/31200-21kthreadcore20:28:353
339950,0migration/311059-21taskset20:13:213
28415050,0irq/27-eth0-tx-8166-21munin-node18:58:330
28415050,0irq/27-eth0-tx-27204-21munin-node18:48:310
28415050,0irq/27-eth0-tx-25571-21ssh22:48:392
28415050,0irq/27-eth0-tx-22635-21ssh21:58:242
28415050,0irq/27-eth0-tx-0-21swapper/223:49:412
28415050,0irq/27-eth0-tx-0-21swapper/223:46:432
28415050,0irq/27-eth0-tx-0-21swapper/222:53:242
28415050,0irq/27-eth0-tx-0-21swapper/222:44:062
28415050,0irq/27-eth0-tx-0-21swapper/222:30:582
28415050,0irq/27-eth0-tx-0-21swapper/222:14:412
28415050,0irq/27-eth0-tx-0-21swapper/222:11:142
28415050,0irq/27-eth0-tx-0-21swapper/221:48:532
28415050,0irq/27-eth0-tx-0-21swapper/200:13:292
28405050,0irq/26-eth0-rx-9882-21ssh23:00:463
28405050,0irq/26-eth0-rx-6493-21ssh00:13:503
28405050,0irq/26-eth0-rx-32271-21latency_hist22:08:153
28405050,0irq/26-eth0-rx-315-21perl23:48:243
28405050,0irq/26-eth0-rx-21821-21perl21:33:273
28405050,0irq/26-eth0-rx-21677-21ssh23:37:153
28405050,0irq/26-eth0-rx-15720-21ssh22:17:583
28405050,0irq/26-eth0-rx-15102-21ssh23:57:583
28405050,0irq/26-eth0-rx-10294-21sh21:20:493
28405050,0irq/26-eth0-rx-0-21swapper/323:58:313
28405050,0irq/26-eth0-rx-0-21swapper/323:38:163
28405050,0irq/26-eth0-rx-0-21swapper/323:27:013
28405050,0irq/26-eth0-rx-0-21swapper/323:20:353
28405050,0irq/26-eth0-rx-0-21swapper/323:20:353
28405050,0irq/26-eth0-rx-0-21swapper/323:11:083
28405050,0irq/26-eth0-rx-0-21swapper/322:54:323
28405050,0irq/26-eth0-rx-0-21swapper/322:44:133
28405050,0irq/26-eth0-rx-0-21swapper/322:31:393
28405050,0irq/26-eth0-rx-0-21swapper/321:58:353
28405050,0irq/26-eth0-rx-0-21swapper/321:48:273
28405050,0irq/26-eth0-rx-0-21swapper/321:42:093
28405050,0irq/26-eth0-rx-0-21swapper/321:06:033
28405050,0irq/26-eth0-rx-0-21swapper/321:01:213
28405050,0irq/26-eth0-rx-0-21swapper/320:38:313
28405050,0irq/26-eth0-rx-0-21swapper/300:04:393
269929955,0cyclictest0-21swapper/221:14:022
269909954,0cyclictest16087-21kworker/1:222:49:381
269909954,0cyclictest16087-21kworker/1:221:58:421
269899955,0cyclictest0-21swapper/023:51:140
269899955,0cyclictest0-21swapper/018:53:350
269899950,0cyclictest0-21swapper/021:44:380
259950,0migration/23300-21munin-node20:03:372
259950,0migration/226209-21kthreadcore19:08:352
259950,0migration/217699-21munin-node20:18:272
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional