You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-27 - 14:20
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot3.osadl.org (updated Sat Jul 27, 2024 12:46:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
14749210893sleep20-21swapper/207:05:034
17587210792sleep10-21swapper/107:06:151
17708210292sleep110-21swapper/1107:07:503
122501020irq/42-ahci0-21swapper/307:09:115
12250940irq/42-ahci0-21swapper/707:08:409
12250930irq/42-ahci0-21swapper/807:08:5010
1105250920irq/52-eth0-rx-0-21swapper/407:07:046
1789127573sleep90-21swapper/907:09:3611
1105250710irq/52-eth0-rx-0-21swapper/507:06:367
1790826562sleep100-21swapper/1007:09:492
1768526353sleep60-21swapper/607:07:328
1472925753sleep00-21swapper/007:05:010
1807799300cyclictest0-21swapper/1109:15:083
1802699300cyclictest0-21swapper/009:15:140
18026992120cyclictest0-21swapper/009:29:220
18076991816cyclictest0-21swapper/1007:40:012
1807699181cyclictest12250irq/42-ahci10:10:062
18075991816cyclictest15230-21snmp_easybox.os08:30:2311
18075991816cyclictest15230-21snmp_easybox.os08:30:2211
1807599181cyclictest15595-1kworker/9:1H08:23:2111
1807599181cyclictest0-21swapper/910:15:2311
1807599181cyclictest0-21swapper/909:50:1811
18073991816cyclictest31584-21snmp_rack3slot907:25:129
18060991816cyclictest2357-21lldpd09:32:136
18076991716cyclictest0-21swapper/1011:10:442
18076991716cyclictest0-21swapper/1007:54:212
1807699170cyclictest98572chrt09:50:532
1807699170cyclictest71402sleep1011:16:032
1807699170cyclictest68362sleep1010:32:342
1807699170cyclictest318572chrt10:21:452
1807699170cyclictest301742sleep1007:24:382
1807699170cyclictest241542sleep1009:27:382
1807699170cyclictest230242sleep1007:55:532
1807699170cyclictest22642sleep1008:59:112
1807699170cyclictest220632sleep1012:20:592
1807699170cyclictest215342sleep1010:54:252
1807699170cyclictest133052sleep1009:13:492
1807699170cyclictest12250irq/42-ahci12:11:072
1807699170cyclictest12250irq/42-ahci11:29:502
1807699170cyclictest12250irq/42-ahci10:55:292
1807699170cyclictest12250irq/42-ahci10:08:362
1807699170cyclictest12250irq/42-ahci09:46:082
1807699170cyclictest12250irq/42-ahci09:40:012
1807699170cyclictest12250irq/42-ahci09:35:372
1807699170cyclictest12250irq/42-ahci09:21:482
1807699170cyclictest12250irq/42-ahci08:47:102
1807699170cyclictest12250irq/42-ahci08:12:562
1807699170cyclictest12250irq/42-ahci08:08:382
1807699170cyclictest12250irq/42-ahci07:47:302
1807699170cyclictest12250irq/42-ahci07:28:012
1807699170cyclictest12250irq/42-ahci07:15:502
1807699170cyclictest1105250irq/52-eth0-rx-12:25:252
1807699170cyclictest1105250irq/52-eth0-rx-12:15:322
1807699170cyclictest1105250irq/52-eth0-rx-12:00:322
1807699170cyclictest1105250irq/52-eth0-rx-11:41:122
1807699170cyclictest1105250irq/52-eth0-rx-11:41:112
1807699170cyclictest1105250irq/52-eth0-rx-11:30:172
1807699170cyclictest1105250irq/52-eth0-rx-11:05:342
1807699170cyclictest1105250irq/52-eth0-rx-11:01:252
1807699170cyclictest1105250irq/52-eth0-rx-10:40:252
1807699170cyclictest1105250irq/52-eth0-rx-10:28:472
1807699170cyclictest1105250irq/52-eth0-rx-10:16:172
1807699170cyclictest1105250irq/52-eth0-rx-09:30:112
1807699170cyclictest1105250irq/52-eth0-rx-09:08:162
1807699170cyclictest1105250irq/52-eth0-rx-09:02:262
1807699170cyclictest1105250irq/52-eth0-rx-08:50:342
1807699170cyclictest1105250irq/52-eth0-rx-08:31:332
1807699170cyclictest1105250irq/52-eth0-rx-08:31:322
1807699170cyclictest1105250irq/52-eth0-rx-08:17:572
1807699170cyclictest1105250irq/52-eth0-rx-07:40:332
1807699170cyclictest1105250irq/52-eth0-rx-07:30:242
18075991715cyclictest22210-21snmp_easybox.os07:55:2311
18075991715cyclictest13160-21chrt09:11:4811
1807599170cyclictest0-21swapper/910:55:2211
18073991715cyclictest537-21snmp_rack3slot912:36:399
18073991715cyclictest27825-21snmp_rack3slot907:20:099
18073991715cyclictest22943-21snmp_easybox.os12:25:139
18073991715cyclictest20022-21df12:20:139
18073991715cyclictest15426-21snmp_rack3slot910:45:139
18073991715cyclictest11115-21snmp_rack3slot909:10:149
18073991715cyclictest10325-21snmp_rack3slot908:25:149
18060991716cyclictest2357-21lldpd12:02:196
18060991715cyclictest25093-21smartctl12:25:326
18026991716cyclictest0-21swapper/009:21:310
1802699170cyclictest8914-21chrt08:20:340
1807699160cyclictest12250irq/42-ahci08:00:432
1807699160cyclictest1105250irq/52-eth0-rx-11:55:122
18075991615cyclictest0-21swapper/907:28:2611
18075991614cyclictest28052-21snmp_easybox.os08:50:1011
18075991614cyclictest23299-21yum07:15:1511
18075991614cyclictest1673-21taskset08:12:0511
18075991614cyclictest12010-21snmp_rack3slot910:40:1411
18073991614cyclictest28629-21snmp_rack3slot911:01:249
18060991615cyclictest2357-21lldpd07:19:366
1806099160cyclictest0-21swapper/411:52:226
1806099160cyclictest0-21swapper/411:52:216
1806099160cyclictest0-21swapper/411:08:336
18047991615cyclictest1936-21rsyslogd12:25:334
18047991614cyclictest2320-21snmpd10:29:314
18047991614cyclictest2320-21snmpd07:42:154
18077991514cyclictest282622sleep1110:17:223
1807599158cyclictest28647-21snmp_rack3slot911:01:3711
1807599156cyclictest0-21swapper/907:42:1211
1807599154cyclictest0-21swapper/911:20:0111
18075991514cyclictest0-21swapper/910:45:1611
18075991513cyclictest595-21chrt12:37:2311
18075991513cyclictest18518-21snmp_rack3slot909:20:1611
18075991513cyclictest14997-21taskset12:13:5511
1807599150cyclictest0-21swapper/912:02:0511
1807599150cyclictest0-21swapper/911:34:2611
1807599150cyclictest0-21swapper/911:05:5311
1807599150cyclictest0-21swapper/909:56:2211
1807599150cyclictest0-21swapper/909:36:1611
1807599150cyclictest0-21swapper/908:45:5611
1807599150cyclictest0-21swapper/908:39:5411
1807599150cyclictest0-21swapper/908:28:4211
1807599150cyclictest0-21swapper/908:15:1911
1807599150cyclictest0-21swapper/908:09:2811
1807499155cyclictest0-21swapper/809:40:0010
18073991513cyclictest29838-21df_inode10:20:129
18073991513cyclictest24235-21df07:15:199
18064991513cyclictest9604-21qemu-kvm09:15:477
18064991513cyclictest9603-21qemu-kvm09:08:167
18064991513cyclictest30551-21qemu-kvm08:44:547
18064991513cyclictest30550-21qemu-kvm08:27:497
18064991513cyclictest30550-21qemu-kvm08:11:547
1805399150cyclictest0-21swapper/308:25:015
18026991514cyclictest130762sleep009:10:410
1802699150cyclictest1250-21chrt07:28:030
5999140watchdog/70-21swapper/708:20:339
31140ksoftirqd/00-21swapper/010:40:300
31140ksoftirqd/00-21swapper/010:05:290
18076991413cyclictest30615-1kworker/10:2H08:36:112
1807699141cyclictest12250irq/42-ahci08:20:032
1807599147cyclictest6121-21munin-node09:45:3811
1807599147cyclictest15780-21taskset07:46:3011
1807599147cyclictest0-21swapper/909:25:0011
1807599146cyclictest0-21swapper/912:30:0711
1807599146cyclictest0-21swapper/911:45:1411
1807599146cyclictest0-21swapper/909:15:1811
1807599146cyclictest0-21swapper/909:02:5111
1807599145cyclictest0-21swapper/912:16:0211
1807599143cyclictest0-21swapper/908:43:3011
1807599143cyclictest0-21swapper/907:10:0011
18075991413cyclictest0-21swapper/910:35:2711
18075991413cyclictest0-21swapper/907:35:3111
18075991412cyclictest21706-21snmp_easybox.os10:10:1311
1807599141cyclictest0-21swapper/911:55:0211
1807599141cyclictest0-21swapper/911:55:0111
1807599140cyclictest0-21swapper/912:23:3611
1807599140cyclictest0-21swapper/911:40:0011
1807599140cyclictest0-21swapper/911:40:0011
1807599140cyclictest0-21swapper/910:54:0511
1807599140cyclictest0-21swapper/910:31:5211
1807599140cyclictest0-21swapper/910:24:1511
1807599140cyclictest0-21swapper/910:07:0911
1807599140cyclictest0-21swapper/909:30:4011
1807599140cyclictest0-21swapper/907:51:3311
1807599140cyclictest0-21swapper/907:31:0211
1807599140cyclictest0-21swapper/907:20:5011
1807499144cyclictest0-21swapper/812:20:0210
1807499144cyclictest0-21swapper/809:30:0010
1807499144cyclictest0-21swapper/807:30:0010
1807499144cyclictest0-21swapper/807:25:0110
1807399144cyclictest0-21swapper/710:15:019
1807399144cyclictest0-21swapper/707:30:029
18073991412cyclictest19395-21snmp_rack3slot907:10:169
1807299143cyclictest0-21swapper/609:08:428
1807299140cyclictest30550-21qemu-kvm08:25:008
1806099142cyclictest0-21swapper/411:49:206
18060991413cyclictest2357-21lldpd08:56:116
18060991413cyclictest2357-21lldpd08:54:426
18060991413cyclictest2357-21lldpd07:36:396
1805399143cyclictest0-21swapper/309:05:015
1805399143cyclictest0-21swapper/307:20:165
18047991412cyclictest2320-21snmpd11:38:474
18047991412cyclictest2320-21snmpd11:38:464
18047991412cyclictest2320-21snmpd09:03:304
1804099144cyclictest0-21swapper/107:40:011
14850140irq/18-uhci_hcd0-21swapper/007:30:270
1807699130cyclictest104862sleep1010:37:472
1807599137cyclictest0-21swapper/908:55:2411
1807599136cyclictest0-21swapper/911:41:1111
1807599136cyclictest0-21swapper/911:41:1011
1807599133cyclictest0-21swapper/910:25:0111
1807599132cyclictest0-21swapper/911:56:2011
18075991312cyclictest0-21swapper/908:00:1211
1807599131cyclictest0-21swapper/912:08:3111
1807599130cyclictest0-21swapper/911:22:4611
1807599130cyclictest0-21swapper/911:10:3511
1807599130cyclictest0-21swapper/909:09:4311
1807499134cyclictest0-21swapper/811:25:0110
1807499134cyclictest0-21swapper/808:20:0110
1807499134cyclictest0-21swapper/807:45:0010
1807499134cyclictest0-21swapper/807:35:0110
1807499133cyclictest0-21swapper/812:35:0110
1807499133cyclictest0-21swapper/810:40:0010
1807499133cyclictest0-21swapper/810:17:4710
1807499133cyclictest0-21swapper/809:35:0010
1807499133cyclictest0-21swapper/809:20:0210
1807399134cyclictest0-21swapper/711:30:029
1807399134cyclictest0-21swapper/710:45:019
1807399134cyclictest0-21swapper/709:10:019
1807399133cyclictest0-21swapper/711:50:019
1807399133cyclictest0-21swapper/711:50:019
1807399133cyclictest0-21swapper/710:30:009
18073991311cyclictest3582-21snmp_rack3slot909:45:129
1807299134cyclictest0-21swapper/611:05:008
1807299134cyclictest0-21swapper/610:50:018
1807299133cyclictest0-21swapper/611:26:028
1807299133cyclictest0-21swapper/607:42:468
1807299133cyclictest0-21swapper/607:26:128
18064991311cyclictest30551-21qemu-kvm08:45:187
18064991311cyclictest2320-21snmpd08:06:447
1806099133cyclictest2254-40kipmi010:50:226
1806099133cyclictest0-21swapper/410:56:316
1806099132cyclictest0-21swapper/408:30:406
1806099132cyclictest0-21swapper/408:30:396
1806099130cyclictest0-21swapper/409:58:526
1806099130cyclictest0-21swapper/408:15:056
1804799133cyclictest0-21swapper/208:55:214
18047991311cyclictest2320-21snmpd10:38:314
18047991311cyclictest2320-21snmpd10:17:024
18026991312cyclictest3328-21chrt10:29:230
14850130irq/18-uhci_hcd0-21swapper/008:40:330
31120ksoftirqd/00-21swapper/008:25:310
31120ksoftirqd/00-21swapper/008:05:270
1807599121cyclictest0-21swapper/911:29:4911
1807599121cyclictest0-21swapper/910:00:2011
1807599120cyclictest0-21swapper/912:29:3211
1807499123cyclictest0-21swapper/809:20:0210
1807499122cyclictest0-21swapper/807:33:1510
1807499121cyclictest0-21swapper/811:20:2310
1807399124cyclictest0-21swapper/708:15:019
1807399124cyclictest0-21swapper/708:10:019
1807399123cyclictest0-21swapper/708:35:019
1807399123cyclictest0-21swapper/708:35:019
1807299123cyclictest0-21swapper/612:25:028
1807299123cyclictest0-21swapper/608:45:028
1807299121cyclictest0-21swapper/609:11:428
18064991211cyclictest2880-21turbostat09:45:017
1806099124cyclictest0-21swapper/408:25:216
1806099122cyclictest0-21swapper/412:39:446
1806099122cyclictest0-21swapper/412:32:166
1806099122cyclictest0-21swapper/412:17:106
1806099122cyclictest0-21swapper/410:26:496
18060991211cyclictest2357-21lldpd09:46:136
18060991211cyclictest2357-21lldpd08:36:416
18060991211cyclictest2357-21lldpd07:40:096
1806099120cyclictest0-21swapper/411:42:166
1806099120cyclictest0-21swapper/411:42:156
1806099120cyclictest0-21swapper/410:07:086
1806099120cyclictest0-21swapper/407:56:236
1805399123cyclictest0-21swapper/308:30:005
1805399123cyclictest0-21swapper/308:10:205
1804799122cyclictest0-21swapper/211:20:224
18047991210cyclictest2320-21snmpd07:12:014
1804099122cyclictest0-21swapper/110:05:171
18026991210cyclictest21702-21munin-node10:10:250
1802699120cyclictest0-21swapper/007:15:010
5499110migration/619392-21munin-node07:10:158
5499110migration/614924-21munin-node08:30:198
5499110migration/614924-21munin-node08:30:188
341110ksoftirqd/30-21swapper/311:25:105
3199110watchdog/30-21swapper/308:51:555
31110ksoftirqd/00-21swapper/010:55:320
201110ksoftirqd/10-21swapper/111:25:101
1807799113cyclictest0-21swapper/1111:21:173
1807799113cyclictest0-21swapper/1109:09:163
1807799113cyclictest0-21swapper/1108:43:013
1807799113cyclictest0-21swapper/1107:28:163
1807699110cyclictest97752sleep1008:25:092
1807699110cyclictest325842sleep1011:51:082
1807699110cyclictest325842sleep1011:51:072
1807699110cyclictest176912sleep1010:46:482
1807699110cyclictest12250irq/42-ahci11:48:242
1807699110cyclictest1105250irq/52-eth0-rx-09:58:442
1807699110cyclictest1105250irq/52-eth0-rx-09:16:392
1807599115cyclictest0-21swapper/909:43:0011
1807499113cyclictest0-21swapper/812:39:0110
1807499113cyclictest0-21swapper/812:10:0110
1807499113cyclictest0-21swapper/810:32:1710
1807499113cyclictest0-21swapper/810:29:4510
1807499113cyclictest0-21swapper/809:58:3110
1807499113cyclictest0-21swapper/809:45:4610
1807499113cyclictest0-21swapper/809:11:4610
1807499113cyclictest0-21swapper/809:03:3110
1807499113cyclictest0-21swapper/808:34:0110
1807499113cyclictest0-21swapper/808:34:0010
1807499113cyclictest0-21swapper/808:11:1510
1807499112cyclictest17028-21munin-node10:45:3210
1807499111cyclictest0-21swapper/807:46:0110
1807399119cyclictest5707-21snmp_easybox.os10:30:239
1807399119cyclictest0-21swapper/708:10:239
1807399114cyclictest0-21swapper/709:36:319
1807399113cyclictest0-21swapper/712:15:019
1807399113cyclictest0-21swapper/712:07:029
1807399113cyclictest0-21swapper/711:30:499
1807399113cyclictest0-21swapper/710:59:179
1807399113cyclictest0-21swapper/710:00:009
1807399113cyclictest0-21swapper/709:22:469
1807399113cyclictest0-21swapper/708:01:019
1807399113cyclictest0-21swapper/707:53:329
1807399113cyclictest0-21swapper/707:46:169
1807399112cyclictest0-21swapper/709:45:009
1807399111cyclictest0-21swapper/710:37:019
1807299119cyclictest30551-21qemu-kvm08:08:258
1807299113cyclictest0-21swapper/612:05:038
1807299113cyclictest0-21swapper/611:50:178
1807299113cyclictest0-21swapper/611:50:168
1807299113cyclictest0-21swapper/610:59:488
1807299113cyclictest0-21swapper/609:52:028
1807299113cyclictest0-21swapper/609:32:018
1807299113cyclictest0-21swapper/608:28:018
1807299112cyclictest0-21swapper/612:37:028
1807299112cyclictest0-21swapper/611:30:018
1807299112cyclictest0-21swapper/610:05:018
1807299111cyclictest0-21swapper/610:35:008
1807299110cyclictest3387-21munin-run10:30:008
1807299110cyclictest0-21swapper/609:28:278
1806099112cyclictest0-21swapper/408:05:196
18060991110cyclictest2357-21lldpd09:14:426
1806099111cyclictest0-21swapper/411:14:106
1806099111cyclictest0-21swapper/410:37:216
1806099111cyclictest0-21swapper/409:00:126
1806099110cyclictest0-21swapper/412:11:266
1806099110cyclictest0-21swapper/410:40:176
1805399113cyclictest0-21swapper/311:00:215
1805399113cyclictest0-21swapper/308:45:205
1805399113cyclictest0-21swapper/307:15:245
1804799113cyclictest0-21swapper/208:35:194
1804799112cyclictest0-21swapper/208:50:194
1804099113cyclictest0-21swapper/110:35:191
1804099113cyclictest0-21swapper/110:25:201
1804099113cyclictest0-21swapper/110:20:171
1804099113cyclictest0-21swapper/108:50:191
1804099113cyclictest0-21swapper/108:25:201
1804099113cyclictest0-21swapper/108:20:191
1802699119cyclictest0-21swapper/010:15:280
1802699113cyclictest0-21swapper/012:00:210
1802699113cyclictest0-21swapper/010:40:000
1802699113cyclictest0-21swapper/007:40:010
1802699112cyclictest0-21swapper/012:39:370
18026991110cyclictest31770-21chrt10:20:340
1802699110cyclictest0-21swapper/011:20:310
1802699110cyclictest0-21swapper/010:30:280
1802699110cyclictest0-21swapper/009:40:130
1733121110sleep100-21swapper/1010:03:082
1699110watchdog/00-21swapper/011:56:070
1699110watchdog/00-21swapper/007:52:080
12250110irq/42-ahci0-21swapper/110:30:011
12250110irq/42-ahci0-21swapper/009:58:380
901100ksoftirqd/110-21swapper/1108:30:313
901100ksoftirqd/110-21swapper/1108:30:303
8799100watchdog/110-21swapper/1110:45:593
8799100watchdog/110-21swapper/1110:41:523
8799100watchdog/110-21swapper/1110:35:053
8799100watchdog/110-21swapper/1110:21:483
8799100watchdog/110-21swapper/1110:14:123
691100ksoftirqd/80-21swapper/811:45:3310
6899100migration/87483-21cpuspeed_turbos09:50:1110
6899100migration/82343-21crond09:00:0010
671100rcuc/88561-21timerandwakeup08:20:3310
551100ksoftirqd/621032-21qemu-kvm10:24:368
551100ksoftirqd/60-21swapper/611:45:348
5499100migration/63976-21cstates09:45:138
5499100migration/612272-21munin-node09:55:188
481100ksoftirqd/50-21swapper/511:30:157
481100ksoftirqd/50-21swapper/510:24:377
481100ksoftirqd/50-21swapper/507:23:577
4599100watchdog/50-21swapper/512:01:127
4599100watchdog/50-21swapper/507:43:047
411100ksoftirqd/40-21swapper/411:30:166
3899100watchdog/40-21swapper/411:35:286
3899100watchdog/40-21swapper/411:35:276
341100ksoftirqd/30-21swapper/311:45:335
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional