You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-11-23 - 21:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Sat Nov 23, 2024 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
291350440,0irq/25-eth10-21swapper/306:52:373
2790123422,0sleep00-21swapper/006:52:030
2772123425,0sleep20-21swapper/206:49:572
2768923324,0sleep10-21swapper/106:49:361
280479999,0cyclictest2375-21sensors12:03:181
339960,0migration/329930-21sh09:56:483
339960,0migration/329601-21diskmemload12:03:093
339960,0migration/328328-21sh10:15:443
339960,0migration/327744-21sh12:20:263
339960,0migration/326863-21sh10:35:073
339960,0migration/322859-21latency09:08:133
339960,0migration/314274-21sh09:45:533
28415060,0irq/27-eth0-tx-8727-21port_sshpriv11:03:152
28415060,0irq/27-eth0-tx-20145-21munin-node10:33:142
28415060,0irq/27-eth0-tx-0-21swapper/212:19:432
28415060,0irq/27-eth0-tx-0-21swapper/212:03:112
28415060,0irq/27-eth0-tx-0-21swapper/212:02:002
28415060,0irq/27-eth0-tx-0-21swapper/211:33:382
28415060,0irq/27-eth0-tx-0-21swapper/211:25:362
28415060,0irq/27-eth0-tx-0-21swapper/211:20:072
28415060,0irq/27-eth0-tx-0-21swapper/211:09:232
28415060,0irq/27-eth0-tx-0-21swapper/210:56:052
28415060,0irq/27-eth0-tx-0-21swapper/210:51:092
28415060,0irq/27-eth0-tx-0-21swapper/210:43:062
28415060,0irq/27-eth0-tx-0-21swapper/210:28:592
28415060,0irq/27-eth0-tx-0-21swapper/210:09:152
28415060,0irq/27-eth0-tx-0-21swapper/209:54:352
28415060,0irq/27-eth0-tx-0-21swapper/209:50:302
28415060,0irq/27-eth0-tx-0-21swapper/209:37:592
28415060,0irq/27-eth0-tx-0-21swapper/209:30:472
28415060,0irq/27-eth0-tx-0-21swapper/209:23:292
28415060,0irq/27-eth0-tx-0-21swapper/209:14:412
28415060,0irq/27-eth0-tx-0-21swapper/209:11:492
28415060,0irq/27-eth0-tx-0-21swapper/209:06:282
28415060,0irq/27-eth0-tx-0-21swapper/208:58:122
28415060,0irq/27-eth0-tx-0-21swapper/008:53:130
28405060,0irq/26-eth0-rx-16029-21tr11:13:093
28405060,0irq/26-eth0-rx-15317-21cut10:08:123
28405060,0irq/26-eth0-rx-13635-21if_err_eth012:13:123
280469965,0cyclictest4468-21crond11:47:540
280469960,0cyclictest0-21swapper/010:23:120
249960,0watchdog/20-21swapper/211:55:492
249960,0watchdog/20-21swapper/210:23:092
149960,0migration/024254-21sh09:10:100
8225050,0irq/24-0000:00:4309-21latency_hist07:47:552
4150,0ktimersoftd/00-21swapper/010:38:490
339950,0migration/39084-21missed_timers10:43:143
339950,0migration/37468-21kthreadcore12:08:123
339950,0migration/33730-21munin-node09:58:173
339950,0migration/33498-21kthreadcore08:33:143
339950,0migration/332578-21kthreadcore07:18:123
339950,0migration/33101-21sh11:23:523
339950,0migration/330407-21kthreadcore10:38:113
339950,0migration/327164-21kthreadcore07:13:153
339950,0migration/327130-21kthreadcore08:28:113
339950,0migration/323903-21sshd07:58:263
339950,0migration/323561-21aten_r1power_cu07:38:043
339950,0migration/320870-21kthreadcore09:28:133
339950,0migration/320497-21munin-node10:53:123
339950,0migration/319254-21kthreadcore09:48:153
339950,0migration/317915-21sh10:48:463
339950,0migration/315197-21kthreadcore08:43:123
339950,0migration/311786-21kthreadcore07:03:133
28415050,0irq/27-eth0-tx-26222-21diskmemload11:30:462
28415050,0irq/27-eth0-tx-24166-21munin-node09:33:152
28415050,0irq/27-eth0-tx-0-21swapper/210:41:042
28415050,0irq/27-eth0-tx-0-21swapper/210:04:582
28415050,0irq/27-eth0-tx-0-21swapper/209:59:312
28415050,0irq/27-eth0-tx-0-21swapper/209:19:102
28415050,0irq/27-eth0-tx-0-21swapper/208:56:182
28415050,0irq/27-eth0-tx-0-21swapper/007:45:260
28415050,0irq/27-eth0-tx-0-21swapper/007:03:070
28405050,0irq/26-eth0-rx-22066-21irqrtprio11:58:133
28405050,0irq/26-eth0-rx-2021-21kthreadcore09:38:123
28405050,0irq/26-eth0-rx-20209-21diskstats08:48:073
28405050,0irq/26-eth0-rx-10822-21ssh10:23:203
28405050,0irq/26-eth0-rx-0-21swapper/311:46:453
28405050,0irq/26-eth0-rx-0-21swapper/311:28:103
28405050,0irq/26-eth0-rx-0-21swapper/310:04:583
28405050,0irq/26-eth0-rx-0-21swapper/309:25:473
28405050,0irq/26-eth0-rx-0-21swapper/309:13:213
280489954,0cyclictest10447-21kworker/2:011:39:062
280479955,0cyclictest0-21swapper/110:53:211
280479954,0cyclictest29748-21kworker/1:010:37:261
280479954,0cyclictest29748-21kworker/1:009:24:231
280479954,0cyclictest13142-21awk08:18:091
280479950,0cyclictest0-21swapper/111:29:461
280479950,0cyclictest0-21swapper/111:14:571
280479950,0cyclictest0-21swapper/111:07:521
280479950,0cyclictest0-21swapper/110:29:331
280479950,0cyclictest0-21swapper/108:59:221
280469955,0cyclictest26222-21diskmemload11:35:150
280469955,0cyclictest0-21swapper/011:48:490
280469955,0cyclictest0-21swapper/010:31:520
280469955,0cyclictest0-21swapper/009:51:120
280469955,0cyclictest0-21swapper/009:06:440
280469954,0cyclictest5749-21grep12:08:110
280469950,0cyclictest0-21swapper/010:56:380
280469950,0cyclictest0-21swapper/009:59:520
259950,0migration/221725-21cpuspeed_turbos10:13:102
259950,0migration/215303-21diskmemload11:13:082
259950,0migration/215180-21kthreadcore07:28:142
259950,0migration/212689-21latency_hist12:12:542
249950,0watchdog/223848-21sed07:13:142
249950,0watchdog/20-21swapper/212:10:492
249950,0watchdog/20-21swapper/211:48:132
249950,0watchdog/20-21swapper/210:58:412
249950,0watchdog/20-21swapper/209:43:532
249950,0watchdog/20-21swapper/208:47:172
249950,0watchdog/20-21swapper/208:40:412
249950,0watchdog/20-21swapper/208:36:492
249950,0watchdog/20-21swapper/208:30:172
249950,0watchdog/20-21swapper/208:22:132
249950,0watchdog/20-21swapper/208:07:452
249950,0watchdog/20-21swapper/207:43:422
249950,0watchdog/20-21swapper/207:36:342
249950,0watchdog/20-21swapper/207:08:262
249950,0watchdog/20-21swapper/207:04:142
249950,0watchdog/20-21swapper/207:02:422
249950,0watchdog/20-21swapper/206:53:422
179950,0migration/19419-21munin-node07:03:081
179950,0migration/18564-21kthreadcore10:03:131
179950,0migration/16295-21kthreadcore12:08:111
179950,0migration/14809-21kernelversion07:23:111
179950,0migration/14623-21latency_hist11:27:541
179950,0migration/121829-21munin-node11:18:081
179950,0migration/115576-21switchtime09:03:181
179950,0migration/113681-21latency_hist10:07:541
169950,0watchdog/11477-21cut10:18:131
149950,0migration/08735-21aten_r1power_cu09:23:050
149950,0migration/08306-21taskset09:22:280
149950,0migration/030006-21taskset09:57:030
149950,0migration/026768-21munin-node11:58:190
149950,0migration/025532-21kthreadcore07:38:100
149950,0migration/023740-21kthreadcore11:38:120
149950,0migration/022312-21kthreadcore08:48:120
149950,0migration/022002-21taskset07:09:170
149950,0migration/021214-21kthreadcore07:33:100
149950,0migration/020064-21sh11:15:490
149950,0migration/018275-21missed_timers11:53:150
149950,0migration/018123-21kthreadcore09:28:120
149950,0migration/014196-21kthreadcore08:18:110
149950,0migration/013785-21kthreadcore07:53:140
149950,0migration/013614-21latency_hist10:07:540
149950,0migration/012443-21kthreadcore09:43:140
149950,0migration/011611-21sh11:09:420
339940,0migration/39602-21kthreadcore08:13:143
339940,0migration/37195-21kthreadcore11:48:133
339940,0migration/34722-21kthreadcore11:03:113
339940,0migration/326809-21switchtime11:38:183
339940,0migration/310102-21kthreadcore08:38:113
28415040,0irq/27-eth0-tx-17881-21munin-node07:58:070
28415040,0irq/27-eth0-tx-0-21swapper/008:38:140
28415040,0irq/27-eth0-tx-0-21swapper/008:28:100
28415040,0irq/27-eth0-tx-0-21swapper/008:12:140
28405040,0irq/26-eth0-rx-0-21swapper/311:53:013
28405040,0irq/26-eth0-rx-0-21swapper/311:33:273
28405040,0irq/26-eth0-rx-0-21swapper/311:19:343
28405040,0irq/26-eth0-rx-0-21swapper/311:08:093
28405040,0irq/26-eth0-rx-0-21swapper/310:58:223
28405040,0irq/26-eth0-rx-0-21swapper/310:28:293
28405040,0irq/26-eth0-rx-0-21swapper/310:18:073
28405040,0irq/26-eth0-rx-0-21swapper/309:20:543
28405040,0irq/26-eth0-rx-0-21swapper/309:03:063
28405040,0irq/26-eth0-rx-0-21swapper/308:58:123
28405040,0irq/26-eth0-rx-0-21swapper/308:54:573
28405040,0irq/26-eth0-rx-0-21swapper/308:03:113
280489944,0cyclictest10447-21kworker/2:011:43:062
280489944,0cyclictest10447-21kworker/2:010:17:542
280489944,0cyclictest10447-21kworker/2:008:13:012
280489944,0cyclictest10447-21kworker/2:008:08:012
280489944,0cyclictest10447-21kworker/2:007:53:252
280489944,0cyclictest10447-21kworker/2:007:38:132
280489943,0cyclictest30175-21awk07:18:102
280489942,0cyclictest3425-21lldpd07:58:142
280479944,0cyclictest29748-21kworker/1:012:13:001
280479944,0cyclictest29748-21kworker/1:011:58:041
280479944,0cyclictest29748-21kworker/1:011:53:461
280479944,0cyclictest29748-21kworker/1:011:50:421
280479944,0cyclictest29748-21kworker/1:011:43:021
280479944,0cyclictest29748-21kworker/1:011:32:561
280479944,0cyclictest29748-21kworker/1:011:08:001
280479944,0cyclictest29748-21kworker/1:010:58:161
280479944,0cyclictest29748-21kworker/1:010:48:101
280479944,0cyclictest29748-21kworker/1:010:43:001
280479944,0cyclictest29748-21kworker/1:010:23:181
280479944,0cyclictest29748-21kworker/1:010:12:561
280479944,0cyclictest29748-21kworker/1:009:57:541
280479944,0cyclictest29748-21kworker/1:009:53:131
280479944,0cyclictest29748-21kworker/1:009:49:151
280479944,0cyclictest29748-21kworker/1:009:42:591
280479944,0cyclictest29748-21kworker/1:009:37:571
280479944,0cyclictest29748-21kworker/1:009:33:351
280479944,0cyclictest29748-21kworker/1:009:17:591
280479944,0cyclictest29748-21kworker/1:009:13:151
280479944,0cyclictest29748-21kworker/1:009:08:471
280479944,0cyclictest29748-21kworker/1:008:53:011
280479944,0cyclictest29748-21kworker/1:008:42:571
280479944,0cyclictest29748-21kworker/1:008:28:051
280479944,0cyclictest29748-21kworker/1:008:23:171
280479944,0cyclictest29748-21kworker/1:008:13:031
280479944,0cyclictest29748-21kworker/1:008:08:311
280479944,0cyclictest29748-21kworker/1:008:03:091
280479944,0cyclictest29748-21kworker/1:007:57:571
280479944,0cyclictest29748-21kworker/1:007:53:011
280479944,0cyclictest29748-21kworker/1:007:48:051
280479944,0cyclictest29748-21kworker/1:007:33:031
280479944,0cyclictest29748-21kworker/1:007:08:011
280479944,0cyclictest29748-21kworker/1:006:58:031
280479944,0cyclictest29748-21kworker/1:006:53:451
280479943,0cyclictest30151-21awk07:18:101
280479943,0cyclictest29748-21kworker/1:012:19:021
280479943,0cyclictest24398-21awk07:38:081
280479943,0cyclictest23493-21awk07:13:121
280479943,0cyclictest20769-21awk08:48:091
280469944,0cyclictest0-21swapper/010:10:260
280469944,0cyclictest0-21swapper/007:31:400
280469943,0cyclictest646-21awk08:33:110
280469943,0cyclictest6445-21snmpd12:04:420
280469943,0cyclictest6445-21snmpd11:18:420
280469943,0cyclictest4011-21awk11:03:100
280469943,0cyclictest3425-21lldpd11:24:020
280469943,0cyclictest28257-21munin-node06:53:080
280469943,0cyclictest2756-21awk08:58:100
280469943,0cyclictest13999-21awk08:43:100
259940,0migration/23587-21munin-node07:23:062
249940,0watchdog/20-21swapper/208:48:092
249940,0watchdog/20-21swapper/208:22:572
179940,0migration/16710-21munin-node08:38:061
179940,0migration/131276-21irqcore07:43:111
179940,0migration/128064-21sh10:38:041
179940,0migration/122122-21processes09:28:161
179940,0migration/12191-21kthreadcore08:33:131
169940,0watchdog/110211-21chrt07:28:021
169940,0watchdog/10-21swapper/111:38:131
149940,0migration/09110-21latency_hist07:02:550
149940,0migration/08081-21kthreadcore10:43:130
149940,0migration/031264-21kthreadcore10:18:120
149940,0migration/031128-21kthreadcore10:58:120
149940,0migration/029479-21cpuspeed_turbos07:18:070
149940,0migration/029319-21kthreadcore09:13:200
149940,0migration/025685-21irqcore08:03:110
149940,0migration/023182-21kthreadcore10:33:160
149940,0migration/020286-21kthreadcore08:23:110
28415030,0irq/27-eth0-tx-0-21swapper/008:13:080
28415030,0irq/27-eth0-tx-0-21swapper/007:13:070
28405030,0irq/26-eth0-rx-0-21swapper/309:33:073
28405030,0irq/26-eth0-rx-0-21swapper/308:18:053
28405030,0irq/26-eth0-rx-0-21swapper/308:08:223
28405030,0irq/26-eth0-rx-0-21swapper/307:48:143
28405030,0irq/26-eth0-rx-0-21swapper/307:45:303
28405030,0irq/26-eth0-rx-0-21swapper/307:34:283
28405030,0irq/26-eth0-rx-0-21swapper/307:23:073
280469932,0cyclictest903-21kthreadcore09:38:110
280469932,0cyclictest5408-21awk07:48:090
280469932,0cyclictest3849-21tr07:23:070
280469932,0cyclictest3425-21lldpd12:20:030
280469932,0cyclictest3110-21irqbalance10:48:090
280469932,0cyclictest22049-21tune2fs10:13:110
280469930,0cyclictest29625-21memory09:33:180
280469930,0cyclictest16611-21tr12:13:150
339920,0migration/312233-21iostat_ios07:53:123
28405020,0irq/26-eth0-rx-0-21swapper/308:23:063
28405020,0irq/26-eth0-rx-0-21swapper/307:28:403
28405020,0irq/26-eth0-rx-0-21swapper/307:07:573
28405020,0irq/26-eth0-rx-0-21swapper/306:58:113
28405020,0irq/26-eth0-rx-0-21swapper/306:53:123
280469921,0cyclictest4567-21latency_hist11:27:540
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional