You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-11-22 - 02:25
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2.osadl.org (updated Fri Nov 22, 2024 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3068824028,0sleep30-21swapper/318:40:333
3069823825,0sleep00-21swapper/018:40:380
3052323627,0sleep20-21swapper/218:38:362
3042423526,0sleep10-21swapper/118:37:271
29925080,0irq/32-eth0-rx-22391-21kthreadcore20:47:123
8315070,0irq/26-0000:00:0-21swapper/319:11:543
329970,0watchdog/319646-21cut21:22:143
329970,0watchdog/30-21swapper/323:05:573
8315060,0irq/26-0000:00:0-21swapper/319:42:143
339960,0migration/327682-21sh22:06:553
339960,0migration/323445-21sh22:42:053
329960,0watchdog/39624-21grep20:17:103
329960,0watchdog/3299250irq/32-eth0-rx-22:37:023
329960,0watchdog/323942sleep319:06:583
329960,0watchdog/30-21swapper/323:23:133
329960,0watchdog/30-21swapper/323:15:533
329960,0watchdog/30-21swapper/322:56:573
329960,0watchdog/30-21swapper/322:52:053
329960,0watchdog/30-21swapper/322:46:573
329960,0watchdog/30-21swapper/322:34:063
329960,0watchdog/30-21swapper/322:30:263
329960,0watchdog/30-21swapper/322:18:543
329960,0watchdog/30-21swapper/322:02:103
329960,0watchdog/30-21swapper/321:57:143
329960,0watchdog/30-21swapper/321:48:023
329960,0watchdog/30-21swapper/321:33:103
329960,0watchdog/30-21swapper/321:28:063
329960,0watchdog/30-21swapper/321:14:143
329960,0watchdog/30-21swapper/320:46:143
329960,0watchdog/30-21swapper/320:46:143
329960,0watchdog/30-21swapper/320:02:143
329960,0watchdog/30-21swapper/318:42:143
329960,0watchdog/30-21swapper/300:00:453
308899960,0cyclictest0-21swapper/221:32:072
308809960,0cyclictest0-21swapper/023:42:140
29925060,0irq/32-eth0-rx-0-21swapper/323:52:393
29925060,0irq/32-eth0-rx-0-21swapper/323:48:263
29925060,0irq/32-eth0-rx-0-21swapper/323:41:573
29925060,0irq/32-eth0-rx-0-21swapper/323:38:383
29925060,0irq/32-eth0-rx-0-21swapper/323:21:453
29925060,0irq/32-eth0-rx-0-21swapper/322:23:203
29925060,0irq/32-eth0-rx-0-21swapper/322:12:243
29925060,0irq/32-eth0-rx-0-21swapper/321:51:573
29925060,0irq/32-eth0-rx-0-21swapper/321:09:113
29925060,0irq/32-eth0-rx-0-21swapper/321:03:353
29925060,0irq/32-eth0-rx-0-21swapper/320:52:123
27160,0ktimersoftd/20-21swapper/222:52:242
149960,0migration/03858-21idleruntime20:37:090
149960,0migration/027438-21sh23:26:490
149960,0migration/024338-21aten_r1power_po23:02:090
149960,0migration/020285-21sh21:04:580
8315050,0irq/26-0000:00:3220-13audispd19:51:543
8315050,0irq/26-0000:00:18566-21sed20:46:542
339950,0migration/331784-21kernelversion00:07:113
339950,0migration/331319-21kthreadcore20:32:113
339950,0migration/328149-21fschecks_count19:02:063
339950,0migration/314799-21kthreadcore18:52:123
329950,0watchdog/39902-21kthreadcore21:17:103
329950,0watchdog/321614-21irqcore18:57:103
329950,0watchdog/30-21swapper/323:33:053
329950,0watchdog/30-21swapper/323:27:013
329950,0watchdog/30-21swapper/323:10:333
329950,0watchdog/30-21swapper/321:42:263
329950,0watchdog/30-21swapper/320:27:263
329950,0watchdog/30-21swapper/320:22:383
329950,0watchdog/30-21swapper/320:11:583
329950,0watchdog/30-21swapper/320:09:023
329950,0watchdog/30-21swapper/319:47:463
329950,0watchdog/30-21swapper/319:38:423
329950,0watchdog/30-21swapper/319:32:383
329950,0watchdog/30-21swapper/319:27:063
329950,0watchdog/30-21swapper/319:25:143
329950,0watchdog/30-21swapper/319:17:063
329950,0watchdog/30-21swapper/318:48:143
308899954,0cyclictest3823-21irqcore19:52:102
308899954,0cyclictest11782-21awk21:57:092
308899954,0cyclictest0-21swapper/221:06:542
308829955,0cyclictest0-21swapper/123:37:271
308829955,0cyclictest0-21swapper/123:16:291
308829950,0cyclictest0-21swapper/123:10:201
308829950,0cyclictest0-21swapper/122:29:111
308829950,0cyclictest0-21swapper/122:23:401
308809954,0cyclictest29815-21ssh22:44:120
29935050,0irq/33-eth0-tx-3617-21ssh22:11:482
29935050,0irq/33-eth0-tx-27606-21munin-node19:02:090
29935050,0irq/33-eth0-tx-1982-21munin-node21:52:072
29935050,0irq/33-eth0-tx-19299-21munin-node22:02:112
29935050,0irq/33-eth0-tx-18635-21irqrtprio21:42:122
29935050,0irq/33-eth0-tx-17027-21munin-node20:02:070
29935050,0irq/33-eth0-tx-0-21swapper/223:57:122
29935050,0irq/33-eth0-tx-0-21swapper/220:57:022
29935050,0irq/33-eth0-tx-0-21swapper/019:52:100
29935050,0irq/33-eth0-tx-0-21swapper/019:12:130
29925050,0irq/32-eth0-rx-23216-21irqcore00:02:153
29925050,0irq/32-eth0-rx-0-21swapper/321:37:453
29925050,0irq/32-eth0-rx-0-21swapper/320:57:313
29925050,0irq/32-eth0-rx-0-21swapper/320:37:123
29925050,0irq/32-eth0-rx-0-21swapper/319:57:093
259950,0migration/225945-21kthreadcore20:27:092
259950,0migration/222053-21munin-node23:42:152
259950,0migration/219926-21latency22:37:132
249950,0watchdog/28424-21kthreadcore22:32:102
19150,0ktimersoftd/10-21swapper/100:01:151
179950,0migration/1487-21kthreadcore20:52:131
179950,0migration/130280-21kthreadcore19:47:131
179950,0migration/125981-21sh22:02:241
179950,0migration/121894-21gltestperf23:42:131
179950,0migration/111541-21munin-node23:52:171
179950,0migration/110039-21ntp_offset20:57:161
169950,0watchdog/121764-21basename20:27:061
169950,0watchdog/111825-21kthreadcore19:32:141
149950,0migration/07586-21irqcore21:17:080
149950,0migration/06477-21sh22:50:330
149950,0migration/06304-21fschecks_time23:52:110
149950,0migration/05931-21needreboot21:32:130
149950,0migration/03942-21aten_r1power_en23:32:040
149950,0migration/03611-21kthreadcore00:07:120
149950,0migration/03549-21runrttasks20:56:510
149950,0migration/031781-21fschecks_time18:42:070
149950,0migration/031472-21munin-node21:12:100
149950,0migration/031062-21kthreadcore19:47:130
149950,0migration/030198-21kthreadcore23:27:110
149950,0migration/029481-21sh00:05:200
149950,0migration/028924-21taskset22:26:310
149950,0migration/02785-21kthreadcore23:07:120
149950,0migration/027744-21kthreadcore21:27:100
149950,0migration/027479-21kthreadcore19:22:120
149950,0migration/026928-21if_eth021:47:090
149950,0migration/024581-21kthreadcore20:47:130
149950,0migration/023100-21kthreadcore18:57:120
149950,0migration/023071-21kthreadcore21:07:080
149950,0migration/02233-21taskset20:33:310
149950,0migration/018163-21kthreadcore22:17:170
149950,0migration/01701-21kthreadcore22:27:090
149950,0migration/014946-21munin-node21:37:190
149950,0migration/014300-21gltestperf19:37:070
149950,0migration/014211-21aten2.4-expect22:37:060
149950,0migration/013546-21sh22:36:090
149950,0migration/013193-21missed_timers22:52:140
149950,0migration/013057-21taskset20:18:540
149950,0migration/011670-21sh21:00:130
308899943,0cyclictest3262-21irqbalance23:17:072
308899943,0cyclictest3262-21irqbalance20:37:382
308899943,0cyclictest3262-21irqbalance20:33:382
308899943,0cyclictest3262-21irqbalance20:17:182
308899943,0cyclictest3262-21irqbalance20:14:382
308899943,0cyclictest3262-21irqbalance19:58:082
308899943,0cyclictest3262-21irqbalance19:46:582
308899943,0cyclictest3262-21irqbalance19:40:082
308899943,0cyclictest3262-21irqbalance19:22:082
308899943,0cyclictest3262-21irqbalance19:16:582
308899943,0cyclictest3262-21irqbalance19:12:282
308899943,0cyclictest3262-21irqbalance19:07:282
308899943,0cyclictest3262-21irqbalance19:01:382
308899943,0cyclictest3262-21irqbalance18:54:082
308899943,0cyclictest32447-21awk19:27:092
308899943,0cyclictest23871-21snmpd21:26:592
308899943,0cyclictest23871-21snmpd20:06:582
308899943,0cyclictest23871-21snmpd18:41:582
308899943,0cyclictest21589-21awk19:42:102
308899943,0cyclictest17253-21ps22:57:102
308899943,0cyclictest0-21swapper/222:12:052
308899940,0cyclictest0-21swapper/221:37:002
308829944,0cyclictest0-21swapper/123:22:381
308829944,0cyclictest0-21swapper/121:31:571
308829943,0cyclictest3599-21lldpd21:51:561
308829943,0cyclictest3599-21lldpd19:03:181
308829943,0cyclictest32471-21awk19:27:091
308829943,0cyclictest32070-21awk22:47:091
308829943,0cyclictest28866-21awk22:07:091
308829943,0cyclictest27150-21sadc20:51:541
308829943,0cyclictest25356-21awk20:07:081
308829943,0cyclictest24680-21awk21:27:071
308829943,0cyclictest23871-21snmpd23:19:451
308829943,0cyclictest23078-21awk00:02:131
308829943,0cyclictest22526-21awk21:07:071
308829943,0cyclictest21493-21awk18:57:091
308829943,0cyclictest17958-21awk19:17:111
308829943,0cyclictest16174-21awk21:22:111
308829943,0cyclictest13322-21sadc20:21:541
308829943,0cyclictest11256-21awk20:42:101
308829943,0cyclictest11256-21awk20:42:101
308809943,0cyclictest3650-21awk19:07:090
308809943,0cyclictest3599-21lldpd23:37:120
308809943,0cyclictest3599-21lldpd19:46:180
308809943,0cyclictest3262-21irqbalance23:46:570
308809943,0cyclictest3262-21irqbalance21:24:480
308809943,0cyclictest32564-21awk20:12:090
308809943,0cyclictest23871-21snmpd19:32:430
308809943,0cyclictest18311-21awk21:42:100
308809943,0cyclictest15007-21awk23:57:100
308809943,0cyclictest14629-21awk20:22:100
308809943,0cyclictest12574-21kworker/0:022:10:200
308809943,0cyclictest11833-21awk21:57:090
308809943,0cyclictest10073-21awk23:12:100
308809940,0cyclictest5982-21munin-node18:47:080
29935040,0irq/33-eth0-tx-30166-21ssh21:12:052
29935040,0irq/33-eth0-tx-24181-21ssh23:02:002
29935040,0irq/33-eth0-tx-0-21swapper/223:51:552
29935040,0irq/33-eth0-tx-0-21swapper/223:50:562
29935040,0irq/33-eth0-tx-0-21swapper/223:32:552
29935040,0irq/33-eth0-tx-0-21swapper/223:26:542
29935040,0irq/33-eth0-tx-0-21swapper/223:22:062
29935040,0irq/33-eth0-tx-0-21swapper/223:12:152
29935040,0irq/33-eth0-tx-0-21swapper/222:47:072
29935040,0irq/33-eth0-tx-0-21swapper/222:41:552
29935040,0irq/33-eth0-tx-0-21swapper/222:17:032
29935040,0irq/33-eth0-tx-0-21swapper/221:47:022
29935040,0irq/33-eth0-tx-0-21swapper/221:17:292
29935040,0irq/33-eth0-tx-0-21swapper/221:07:122
29935040,0irq/33-eth0-tx-0-21swapper/220:52:082
29935040,0irq/33-eth0-tx-0-21swapper/220:43:282
29935040,0irq/33-eth0-tx-0-21swapper/220:43:282
29935040,0irq/33-eth0-tx-0-21swapper/200:07:152
29935040,0irq/33-eth0-tx-0-21swapper/200:04:192
29935040,0irq/33-eth0-tx-0-21swapper/020:42:130
29935040,0irq/33-eth0-tx-0-21swapper/020:42:130
29935040,0irq/33-eth0-tx-0-21swapper/020:07:040
259940,0migration/26668-21fschecks_count19:32:092
259940,0migration/26129-21aten_r1power_vo18:47:062
259940,0migration/2339-21kthreadcore19:02:112
259940,0migration/226334-21kthreadcore22:22:192
259940,0migration/213622-21aten_r1power_en20:22:062
249940,0watchdog/27344-21ssh23:08:052
249940,0watchdog/22416-21grep22:27:102
249940,0watchdog/20-21swapper/223:37:132
249940,0watchdog/20-21swapper/221:22:142
249940,0watchdog/20-21swapper/220:02:102
179940,0migration/19854-21aten_r1power_cu19:57:031
179940,0migration/19107-21kthreadcore21:17:091
179940,0migration/17844-21kthreadcore22:12:111
179940,0migration/132083-21munin-node21:47:161
179940,0migration/131956-21taskset23:05:281
179940,0migration/131013-21fschecks_time00:07:071
179940,0migration/130749-21irqcore23:47:101
179940,0migration/128499-21needreboot22:42:101
179940,0migration/123574-21kthreadcore19:42:131
179940,0migration/120922-21sh22:37:561
179940,0migration/118367-21latency22:17:171
179940,0migration/117600-21kthreadcore18:52:121
179940,0migration/117326-21aten_r1power_po21:42:061
179940,0migration/114272-21gltestperf19:37:071
179940,0migration/111630-21gltestperf21:57:061
179940,0migration/11114-21kthreadcore18:42:121
169940,0watchdog/14364-21grep19:07:101
169940,0watchdog/130074-21ntp_kernel_pll_19:22:141
169940,0watchdog/12930-21sed19:52:061
169940,0watchdog/128075-21df23:27:051
169940,0watchdog/116074-21df_inode22:57:051
169940,0watchdog/115293-21vmstat21:37:221
169940,0watchdog/111966-21ntp_kernel_err18:47:141
169940,0watchdog/10-21swapper/122:52:131
169940,0watchdog/10-21swapper/121:15:181
169940,0watchdog/10-21swapper/119:12:141
149940,0migration/017198-21irqrtprio22:57:100
149940,0migration/016907-21kthreadcore18:52:120
308829933,0cyclictest0-21swapper/120:36:561
308829932,0cyclictest4380-21kthreadcore20:12:111
308829932,0cyclictest18407-21cut20:22:131
308829932,0cyclictest18160-21awk20:02:091
308829932,0cyclictest13710-21awk21:02:141
308829930,0cyclictest0-21swapper/120:36:181
308809933,0cyclictest30064-21kworker/0:119:56:560
308809933,0cyclictest30064-21kworker/0:119:27:040
308809933,0cyclictest30064-21kworker/0:119:16:540
308809933,0cyclictest13428-21kworker/0:123:16:540
308809933,0cyclictest12574-21kworker/0:022:11:580
308809933,0cyclictest12574-21kworker/0:021:52:020
308809932,0cyclictest23871-21snmpd22:02:020
308809930,0cyclictest21622-21perl20:27:050
169930,0watchdog/10-21swapper/123:32:011
169930,0watchdog/10-21swapper/122:32:061
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional