You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-11-22 - 08:26
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot3.osadl.org (updated Fri Nov 22, 2024 00:46:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1280501000irq/18-parport00-21swapper/419:06:576
120501000irq/42-ahci0-21swapper/119:08:241
2013050970irq/52-eth0-rx-0-21swapper/719:08:259
118450950irq/18-i801_smb0-21swapper/319:06:545
14850940irq/18-uhci_hcd0-21swapper/219:06:544
2013050920irq/52-eth0-rx-0-21swapper/519:08:087
2013050890irq/52-eth0-rx-0-21swapper/819:05:1710
128050860irq/18-parport00-21swapper/919:10:0111
118450850irq/18-i801_smb0-21swapper/1119:08:143
128050790irq/18-parport00-21swapper/1019:05:252
2013150600irq/53-eth0-tx-0-21swapper/019:05:160
1939525853sleep60-21swapper/619:06:198
1982699370cyclictest0-21swapper/019:15:540
19826992928cyclictest0-21swapper/020:10:020
19826992928cyclictest0-21swapper/020:09:420
19826992821cyclictest0-21swapper/019:13:160
13250280irq/18-ehci_hcd0-21swapper/119:15:551
118450280irq/18-i801_smb0-21swapper/819:16:0510
1986799269cyclictest831ksoftirqd/1020:10:152
1986799225cyclictest831ksoftirqd/1023:48:062
1986799225cyclictest831ksoftirqd/1022:36:502
1986899210cyclictest0-21swapper/1119:16:433
1986899210cyclictest0-21swapper/1119:11:503
128050210irq/18-parport00-21swapper/319:12:425
1986899200cyclictest4731-21idleruntime-cro21:45:003
14850200irq/18-uhci_hcd0-21swapper/219:12:434
1986799192cyclictest2013050irq/52-eth0-rx-22:20:142
1986699192cyclictest2013150irq/53-eth0-tx-22:55:2011
118450190irq/18-i801_smb0-21swapper/400:27:036
19868991816cyclictest166162sleep1121:15:153
1986799181cyclictest831ksoftirqd/1023:55:022
1986799181cyclictest831ksoftirqd/1020:25:272
1986799181cyclictest831ksoftirqd/1020:20:022
1986799181cyclictest831ksoftirqd/1000:00:132
1986799181cyclictest13250irq/18-ehci_hcd23:34:222
1986799181cyclictest13250irq/18-ehci_hcd23:11:282
1986799181cyclictest13250irq/18-ehci_hcd20:38:412
1986799181cyclictest13250irq/18-ehci_hcd00:11:122
1986799181cyclictest118450irq/18-i801_smb20:04:332
1986799181cyclictest118450irq/18-i801_smb00:05:282
1986799180cyclictest149362sleep1021:11:012
1986699181cyclictest24361-1kworker/9:2H21:03:3411
1986699181cyclictest0-21swapper/923:44:3811
1986699181cyclictest0-21swapper/922:50:2811
1986699181cyclictest0-21swapper/922:45:1211
1986699181cyclictest0-21swapper/922:45:1111
1986699181cyclictest0-21swapper/922:19:5511
1986699181cyclictest0-21swapper/921:10:0111
1986699181cyclictest0-21swapper/921:10:0111
1986699181cyclictest0-21swapper/900:04:1011
19858991816cyclictest32367-21qemu-kvm20:08:188
19828991816cyclictest936-21diskstats19:25:144
19826991816cyclictest0-21swapper/022:14:420
13250180irq/18-ehci_hcd0-21swapper/719:11:169
13250180irq/18-ehci_hcd0-21swapper/219:15:064
118450180irq/18-i801_smb0-21swapper/519:15:597
19867991716cyclictest831ksoftirqd/1022:50:352
19867991716cyclictest31903-21cstates23:05:132
19867991716cyclictest31903-21cstates23:05:122
19867991716cyclictest26316-21cat20:45:102
19867991716cyclictest24593-21fschecks_count22:10:162
1986799170cyclictest90542sleep1023:16:392
1986799170cyclictest831ksoftirqd/1023:40:132
1986799170cyclictest831ksoftirqd/1023:35:222
1986799170cyclictest831ksoftirqd/1022:45:362
1986799170cyclictest831ksoftirqd/1022:45:362
1986799170cyclictest831ksoftirqd/1022:15:122
1986799170cyclictest831ksoftirqd/1021:35:082
1986799170cyclictest831ksoftirqd/1021:15:122
1986799170cyclictest831ksoftirqd/1021:00:132
1986799170cyclictest831ksoftirqd/1019:45:132
1986799170cyclictest831ksoftirqd/1019:35:012
1986799170cyclictest831ksoftirqd/1019:30:102
1986799170cyclictest831ksoftirqd/1019:25:022
1986799170cyclictest831ksoftirqd/1019:20:122
1986799170cyclictest831ksoftirqd/1019:15:032
1986799170cyclictest80562sleep1021:45:532
1986799170cyclictest72642sleep1022:30:212
1986799170cyclictest49382sleep1022:25:572
1986799170cyclictest38982chrt20:55:472
1986799170cyclictest326442sleep1020:51:102
1986799170cyclictest320882chrt00:35:582
1986799170cyclictest306682chrt23:03:492
1986799170cyclictest296892sleep1021:33:262
1986799170cyclictest29542sleep1021:40:162
1986799170cyclictest293382sleep1020:05:042
1986799170cyclictest269332chrt22:57:592
1986799170cyclictest249192chrt00:27:112
1986799170cyclictest248832chrt19:56:282
1986799170cyclictest238262sleep1021:25:142
1986799170cyclictest213012sleep1022:05:182
1986799170cyclictest201932sleep1021:20:132
1986799170cyclictest2013050irq/52-eth0-rx-20:30:102
1986799170cyclictest2013050irq/52-eth0-rx-19:50:242
1986799170cyclictest2013050irq/52-eth0-rx-00:20:122
1986799170cyclictest191512sleep1022:02:422
1986799170cyclictest176342sleep1000:17:082
1986799170cyclictest148092chrt23:25:142
1986799170cyclictest14850irq/18-uhci_hcd23:56:292
1986799170cyclictest139202sleep1019:41:032
1986799170cyclictest13250irq/18-ehci_hcd21:05:072
1986799170cyclictest13250irq/18-ehci_hcd21:05:072
1986799170cyclictest130272sleep1022:40:122
1986799170cyclictest126442sleep1023:21:032
1986799170cyclictest12050irq/42-ahci21:55:392
1986799170cyclictest12050irq/42-ahci20:40:072
1986799170cyclictest12050irq/42-ahci19:10:192
1986799170cyclictest118450irq/18-i801_smb00:31:362
1986799170cyclictest117142chrt21:51:042
1986799170cyclictest108382sleep1020:21:432
1986799170cyclictest108382sleep1020:21:432
19866991715cyclictest29746-21chrt21:34:1311
19866991715cyclictest18576-21chrt21:16:0011
1986699170cyclictest25124-21kworker/9:219:30:1511
1986699170cyclictest24361-1kworker/9:2H23:13:4611
1986699170cyclictest0-21swapper/923:55:2111
1986699170cyclictest0-21swapper/922:35:2211
1986699170cyclictest0-21swapper/920:25:2311
1986699170cyclictest0-21swapper/919:25:2711
19858991716cyclictest11431-21qemu-kvm21:12:208
19852991715cyclictest19584-21qemu-kvm19:13:087
1983999171cyclictest32154-21fschecks_count23:05:145
1983999171cyclictest32154-21fschecks_count23:05:145
1983999170cyclictest0-21swapper/323:20:205
19828991715cyclictest15355-21snmp_rack3slot921:56:104
19826991716cyclictest15388-21rs:main0
1982699170cyclictest0-21swapper/019:25:520
13250170irq/18-ehci_hcd0-21swapper/021:10:260
128050170irq/18-parport04598-21snmp_rack3slot919:30:139
2013150160irq/53-eth0-tx-3794-21munin-node00:00:111
19868991614cyclictest71952sleep1120:16:433
19866991615cyclictest761ksoftirqd/921:45:1611
19866991615cyclictest741rcuc/920:02:2811
19866991615cyclictest0-21swapper/923:29:4411
19866991615cyclictest0-21swapper/922:43:3311
19866991615cyclictest0-21swapper/922:30:0111
19866991615cyclictest0-21swapper/920:16:2611
1986599165cyclictest0-21swapper/822:45:0210
1986599165cyclictest0-21swapper/822:45:0110
19858991615cyclictest32367-21qemu-kvm20:17:548
19858991614cyclictest32367-21qemu-kvm20:46:428
1984599160cyclictest0-21swapper/400:00:206
1983999161cyclictest0-21swapper/300:40:015
19828991615cyclictest2470-21snmpd21:49:254
1982699162cyclictest0-21swapper/020:16:280
1982699160cyclictest0-21swapper/022:45:370
1982699160cyclictest0-21swapper/022:45:370
1982699160cyclictest0-21swapper/022:26:030
14850160irq/18-uhci_hcd0-21swapper/719:15:149
13250160irq/18-ehci_hcd0-21swapper/023:22:110
31150ksoftirqd/00-21swapper/023:56:320
31150ksoftirqd/00-21swapper/023:37:060
31150ksoftirqd/00-21swapper/021:25:160
31150ksoftirqd/00-21swapper/020:30:000
31150ksoftirqd/00-21swapper/020:00:500
31150ksoftirqd/00-21swapper/019:58:420
31150ksoftirqd/00-21swapper/019:35:160
31150ksoftirqd/00-21swapper/019:20:370
31150ksoftirqd/00-21swapper/000:33:020
19868991514cyclictest22224-21taskset21:20:503
19866991514cyclictest15426-21chrt21:57:0511
19866991514cyclictest0-21swapper/923:50:1511
19866991514cyclictest0-21swapper/900:05:5411
1986699150cyclictest0-21swapper/919:16:4311
1986599154cyclictest0-21swapper/823:55:0210
19865991513cyclictest31184-21diskstats21:35:1010
1985899154cyclictest0-21swapper/623:55:018
1984599150cyclictest0-21swapper/420:00:196
1984599150cyclictest0-21swapper/419:30:016
1982899150cyclictest0-21swapper/223:50:014
1982899150cyclictest0-21swapper/200:00:304
1982799150cyclictest0-21swapper/122:45:161
1982799150cyclictest0-21swapper/122:45:151
1982799150cyclictest0-21swapper/122:05:331
1982799150cyclictest0-21swapper/120:30:121
1982799150cyclictest0-21swapper/120:25:101
1982799150cyclictest0-21swapper/119:50:301
1982799150cyclictest0-21swapper/100:35:001
19826991514cyclictest185662sleep021:15:510
19826991513cyclictest0-21swapper/022:24:240
14850150irq/18-uhci_hcd0-21swapper/021:20:050
13250150irq/18-ehci_hcd0-21swapper/023:14:400
13250150irq/18-ehci_hcd0-21swapper/022:38:530
13250150irq/18-ehci_hcd0-21swapper/022:16:460
13250150irq/18-ehci_hcd0-21swapper/021:35:180
13250150irq/18-ehci_hcd0-21swapper/021:32:410
13250150irq/18-ehci_hcd0-21swapper/000:05:540
13250150irq/18-ehci_hcd0-21swapper/000:00:260
761140ksoftirqd/90-21swapper/900:25:0811
6699140watchdog/80-21swapper/800:10:2310
621140ksoftirqd/70-21swapper/721:03:389
621140ksoftirqd/70-21swapper/720:23:169
621140ksoftirqd/70-21swapper/720:23:169
551140ksoftirqd/60-21swapper/619:16:318
411140ksoftirqd/4505-21usb-storage19:11:206
411140ksoftirqd/40-21swapper/422:44:426
411140ksoftirqd/40-21swapper/421:03:386
341140ksoftirqd/30-21swapper/322:44:415
341140ksoftirqd/30-21swapper/321:03:385
31140ksoftirqd/00-21swapper/023:27:570
31140ksoftirqd/00-21swapper/021:59:450
31140ksoftirqd/00-21swapper/021:51:210
31140ksoftirqd/00-21swapper/021:08:320
31140ksoftirqd/00-21swapper/021:08:310
31140ksoftirqd/00-21swapper/021:01:490
31140ksoftirqd/00-21swapper/020:35:300
31140ksoftirqd/00-21swapper/020:32:360
31140ksoftirqd/00-21swapper/019:54:480
31140ksoftirqd/00-21swapper/000:19:490
31140ksoftirqd/00-21swapper/000:14:390
201140ksoftirqd/10-21swapper/122:10:311
201140ksoftirqd/10-21swapper/120:45:441
201140ksoftirqd/10-21swapper/119:35:201
19866991413cyclictest675-21chrt21:35:4911
19866991413cyclictest26406-21taskset22:11:2811
19866991413cyclictest25428-21chrt20:41:5611
19866991413cyclictest14088-21taskset00:13:2411
19866991413cyclictest0-21swapper/922:30:1711
19866991413cyclictest0-21swapper/921:23:4911
19866991413cyclictest0-21swapper/900:39:4611
1986699140cyclictest0-21swapper/920:20:3111
1986699140cyclictest0-21swapper/920:20:3111
19865991413cyclictest20630-21df22:05:1410
1985299143cyclictest0-21swapper/519:33:127
19852991412cyclictest13906-21snmp_rack3slot922:40:217
19828991413cyclictest2470-21snmpd20:34:404
1982699140cyclictest0-21swapper/023:18:430
1982699140cyclictest0-21swapper/023:05:500
1982699140cyclictest0-21swapper/023:05:500
1982699140cyclictest0-21swapper/021:44:300
13250140irq/18-ehci_hcd0-21swapper/319:15:585
13250140irq/18-ehci_hcd0-21swapper/023:04:180
13250140irq/18-ehci_hcd0-21swapper/022:50:280
13250140irq/18-ehci_hcd0-21swapper/019:46:080
13250140irq/18-ehci_hcd0-21swapper/000:35:160
13250140irq/18-ehci_hcd0-21swapper/000:25:360
128050140irq/18-parport00-21swapper/119:11:061
12050140irq/42-ahci0-21swapper/919:13:1911
118450140irq/18-i801_smb0-21swapper/819:12:3010
118450140irq/18-i801_smb0-21swapper/619:41:438
901130ksoftirqd/110-21swapper/1122:44:423
901130ksoftirqd/110-21swapper/1121:34:153
901130ksoftirqd/110-21swapper/1120:01:463
901130ksoftirqd/110-21swapper/1119:40:273
691130ksoftirqd/80-21swapper/823:56:1510
691130ksoftirqd/80-21swapper/823:41:3410
691130ksoftirqd/80-21swapper/800:25:0810
621130ksoftirqd/70-21swapper/722:50:499
621130ksoftirqd/70-21swapper/722:44:419
621130ksoftirqd/70-21swapper/721:59:299
621130ksoftirqd/70-21swapper/721:40:599
551130ksoftirqd/60-21swapper/623:56:168
551130ksoftirqd/60-21swapper/623:41:358
551130ksoftirqd/60-21swapper/623:14:488
551130ksoftirqd/60-21swapper/621:34:158
551130ksoftirqd/60-21swapper/600:25:078
481130ksoftirqd/50-21swapper/523:41:357
481130ksoftirqd/50-21swapper/519:40:277
481130ksoftirqd/50-21swapper/500:25:087
411130ksoftirqd/40-21swapper/423:41:346
411130ksoftirqd/40-21swapper/422:46:466
411130ksoftirqd/40-21swapper/422:46:456
341130ksoftirqd/30-21swapper/323:56:155
341130ksoftirqd/30-21swapper/319:40:265
31130ksoftirqd/00-21swapper/023:47:360
31130ksoftirqd/00-21swapper/023:40:360
31130ksoftirqd/00-21swapper/023:33:190
31130ksoftirqd/00-21swapper/021:45:220
31130ksoftirqd/00-21swapper/020:55:540
31130ksoftirqd/00-21swapper/019:40:260
271130ksoftirqd/20-21swapper/223:54:584
271130ksoftirqd/20-21swapper/223:41:344
271130ksoftirqd/20-21swapper/222:44:414
271130ksoftirqd/20-21swapper/221:34:154
201130ksoftirqd/10-21swapper/122:44:411
201130ksoftirqd/10-21swapper/122:27:001
201130ksoftirqd/10-21swapper/121:34:141
201130ksoftirqd/10-21swapper/100:18:241
1986899134cyclictest0-21swapper/1100:35:553
1986899133cyclictest0-21swapper/1100:20:013
1986699134cyclictest0-21swapper/900:33:4211
19866991312cyclictest0-21swapper/922:00:1111
19866991312cyclictest0-21swapper/920:50:3011
1986599134cyclictest0-21swapper/822:25:0110
1986599133cyclictest0-21swapper/820:22:2610
1986599133cyclictest0-21swapper/820:22:2510
1986599133cyclictest0-21swapper/819:50:0210
1986599133cyclictest0-21swapper/819:45:0010
1986499130cyclictest0-21swapper/722:08:179
1985899133cyclictest0-21swapper/623:15:018
19858991311cyclictest18882-21sensors22:45:318
19858991311cyclictest18882-21sensors22:45:308
1985299135cyclictest0-21swapper/521:30:257
1985299134cyclictest0-21swapper/520:42:187
1985299133cyclictest32366-21qemu-kvm20:27:317
1985299132cyclictest0-21swapper/519:36:407
19852991312cyclictest32366-21qemu-kvm20:24:347
19852991312cyclictest32366-21qemu-kvm20:24:347
1983999133cyclictest0-21swapper/323:00:175
1983999133cyclictest0-21swapper/300:23:515
1983999132cyclictest22737-21snmp_rack3slot922:06:515
1983999130cyclictest24816-21snmp_rack3slot900:25:485
19828991312cyclictest2962-21snmp_rack3slot922:25:124
19828991311cyclictest2470-21snmpd21:04:094
1982699139cyclictest0-21swapper/022:40:370
1982699130cyclictest0-21swapper/020:40:130
14850130irq/18-uhci_hcd0-21swapper/023:51:230
14850130irq/18-uhci_hcd0-21swapper/022:01:550
14850130irq/18-uhci_hcd0-21swapper/019:31:110
901120ksoftirqd/110-21swapper/1123:59:323
901120ksoftirqd/110-21swapper/1123:54:583
901120ksoftirqd/110-21swapper/1123:27:203
901120ksoftirqd/110-21swapper/1123:14:473
901120ksoftirqd/110-21swapper/1122:36:253
901120ksoftirqd/110-21swapper/1120:31:413
901120ksoftirqd/110-21swapper/1120:25:353
901120ksoftirqd/110-21swapper/1120:09:273
901120ksoftirqd/110-21swapper/1119:35:193
901120ksoftirqd/110-21swapper/1119:24:503
761120ksoftirqd/90-21swapper/920:31:4011
761120ksoftirqd/90-21swapper/919:51:3311
761120ksoftirqd/90-21swapper/919:40:2711
761120ksoftirqd/90-21swapper/900:18:2411
691120ksoftirqd/80-21swapper/823:37:0210
691120ksoftirqd/80-21swapper/823:14:4710
691120ksoftirqd/80-21swapper/822:58:0210
691120ksoftirqd/80-21swapper/822:42:1210
691120ksoftirqd/80-21swapper/821:17:5610
691120ksoftirqd/80-21swapper/820:09:2710
691120ksoftirqd/80-21swapper/800:33:4310
621120ksoftirqd/70-21swapper/723:56:159
621120ksoftirqd/70-21swapper/723:41:349
621120ksoftirqd/70-21swapper/722:48:009
621120ksoftirqd/70-21swapper/722:47:599
621120ksoftirqd/70-21swapper/722:36:269
621120ksoftirqd/70-21swapper/722:04:309
621120ksoftirqd/70-21swapper/720:17:139
621120ksoftirqd/70-21swapper/719:48:459
621120ksoftirqd/70-21swapper/700:25:079
551120ksoftirqd/632366-21qemu-kvm20:25:358
551120ksoftirqd/60-21swapper/623:27:208
551120ksoftirqd/60-21swapper/622:42:128
551120ksoftirqd/60-21swapper/622:36:258
551120ksoftirqd/60-21swapper/622:10:308
551120ksoftirqd/60-21swapper/621:57:098
551120ksoftirqd/60-21swapper/621:02:158
551120ksoftirqd/60-21swapper/620:53:038
551120ksoftirqd/60-21swapper/620:31:418
551120ksoftirqd/60-21swapper/619:51:338
481120ksoftirqd/50-21swapper/523:54:587
481120ksoftirqd/50-21swapper/523:37:027
481120ksoftirqd/50-21swapper/523:27:197
481120ksoftirqd/50-21swapper/523:14:477
481120ksoftirqd/50-21swapper/522:36:257
481120ksoftirqd/50-21swapper/521:35:007
481120ksoftirqd/50-21swapper/521:17:567
481120ksoftirqd/50-21swapper/520:31:407
481120ksoftirqd/50-21swapper/520:09:277
481120ksoftirqd/50-21swapper/500:33:447
481120ksoftirqd/50-21swapper/500:11:157
411120ksoftirqd/40-21swapper/423:56:156
411120ksoftirqd/40-21swapper/423:14:476
411120ksoftirqd/40-21swapper/422:10:316
411120ksoftirqd/40-21swapper/422:04:306
411120ksoftirqd/40-21swapper/421:57:106
411120ksoftirqd/40-21swapper/421:34:146
411120ksoftirqd/40-21swapper/421:17:566
411120ksoftirqd/40-21swapper/420:53:036
411120ksoftirqd/40-21swapper/419:51:336
411120ksoftirqd/40-21swapper/419:40:266
411120ksoftirqd/40-21swapper/400:11:156
341120ksoftirqd/30-21swapper/323:54:595
341120ksoftirqd/30-21swapper/323:27:195
341120ksoftirqd/30-21swapper/323:14:485
341120ksoftirqd/30-21swapper/322:58:025
341120ksoftirqd/30-21swapper/322:46:465
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional