You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-04-02 - 06:37
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot3.osadl.org (updated Wed Apr 02, 2025 00:46:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
409210893sleep20-21swapper/219:08:104
33229884sleep00-21swapper/019:07:070
12250970irq/42-ahci0-21swapper/119:09:221
12250940irq/42-ahci0-21swapper/419:08:366
46829387sleep90-21swapper/919:08:1711
12250930irq/42-ahci0-21swapper/719:09:279
2963450890irq/53-eth0-rx-0-21swapper/519:05:497
60028381sleep30-21swapper/319:09:595
50127764sleep80-21swapper/819:08:4010
38326855sleep60-21swapper/619:07:518
2963450680irq/53-eth0-rx-0-21swapper/1119:05:533
3276725955sleep100-21swapper/1019:06:412
706994018cyclictest0-21swapper/020:08:290
74399373cyclictest0-21swapper/621:19:418
74699361cyclictest0-21swapper/922:24:4411
74599363cyclictest0-21swapper/819:38:0110
74599362cyclictest0-21swapper/821:17:3910
74699353cyclictest0-21swapper/920:12:2411
74599353cyclictest0-21swapper/820:46:0110
74599353cyclictest0-21swapper/819:43:3010
74899341cyclictest0-21swapper/1100:06:263
74899341cyclictest0-21swapper/1100:06:263
74599343cyclictest0-21swapper/823:48:4910
74599341cyclictest0-21swapper/821:11:5510
74599341cyclictest0-21swapper/800:25:5110
74599333cyclictest0-21swapper/819:23:0210
74599332cyclictest0-21swapper/819:19:3110
74599330cyclictest0-21swapper/821:05:4310
74599330cyclictest0-21swapper/820:38:3010
74599330cyclictest0-21swapper/820:06:0410
74399331cyclictest0-21swapper/620:06:098
73299333cyclictest0-21swapper/421:00:186
73299333cyclictest0-21swapper/419:15:236
70699333cyclictest0-21swapper/021:30:200
74899322cyclictest0-21swapper/1121:44:143
748993213cyclictest0-21swapper/1122:29:003
74799321cyclictest0-21swapper/1000:14:392
74699322cyclictest0-21swapper/923:20:3411
74699322cyclictest0-21swapper/900:10:4511
74699321cyclictest0-21swapper/919:13:3711
74699321cyclictest0-21swapper/900:32:0311
74699321cyclictest0-21swapper/900:32:0311
74699320cyclictest0-21swapper/919:41:3911
74599323cyclictest0-21swapper/821:55:0010
74599322cyclictest0-21swapper/822:44:3210
74599320cyclictest0-21swapper/819:27:3110
74399322cyclictest0-21swapper/600:39:168
74399320cyclictest0-21swapper/623:38:468
74899313cyclictest0-21swapper/1121:01:593
74799313cyclictest0-21swapper/1020:09:392
74799311cyclictest0-21swapper/1020:50:112
74699313cyclictest0-21swapper/923:07:1411
74699311cyclictest0-21swapper/921:50:4311
74699311cyclictest0-21swapper/919:28:0411
74699311cyclictest0-21swapper/900:04:1511
74599312cyclictest0-21swapper/821:45:3110
74599312cyclictest0-21swapper/821:43:3110
74399313cyclictest0-21swapper/622:16:148
74399313cyclictest0-21swapper/600:21:168
74399313cyclictest0-21swapper/600:21:158
74399311cyclictest0-21swapper/620:00:048
748993011cyclictest0-21swapper/1119:21:593
74799302cyclictest0-21swapper/1022:54:352
74699302cyclictest0-21swapper/921:30:2811
74699302cyclictest0-21swapper/921:24:1911
74699302cyclictest0-21swapper/921:16:4311
74699302cyclictest0-21swapper/900:16:2511
74699302cyclictest0-21swapper/900:08:4611
74699302cyclictest0-21swapper/900:08:4511
74699301cyclictest0-21swapper/920:52:4111
74699300cyclictest0-21swapper/923:27:4511
74699300cyclictest0-21swapper/922:09:1411
74599303cyclictest0-21swapper/821:22:0110
74599302cyclictest0-21swapper/822:12:0310
74599302cyclictest0-21swapper/820:29:3210
74599300cyclictest0-21swapper/823:54:4510
743993029cyclictest23171-21kworker/6:021:30:388
74399302cyclictest0-21swapper/621:09:248
74399302cyclictest0-21swapper/600:12:458
74399301cyclictest0-21swapper/621:35:318
72699302cyclictest0-21swapper/323:50:125
71899302cyclictest0-21swapper/220:15:214
748992914cyclictest0-21swapper/1121:24:363
74799293cyclictest0-21swapper/1000:39:402
74699293cyclictest0-21swapper/922:29:4911
74699291cyclictest0-21swapper/922:11:4411
74699291cyclictest0-21swapper/920:42:4011
74599291cyclictest0-21swapper/800:15:4510
74599290cyclictest0-21swapper/800:14:0010
74399292cyclictest0-21swapper/619:45:018
74399292cyclictest0-21swapper/619:15:078
74399291cyclictest0-21swapper/600:31:458
74399291cyclictest0-21swapper/600:31:458
72699293cyclictest0-21swapper/321:50:025
72699291cyclictest0-21swapper/320:11:085
72699290cyclictest0-21swapper/323:30:015
71899293cyclictest0-21swapper/221:15:184
706992928cyclictest0-21swapper/022:14:350
74899282cyclictest0-21swapper/1100:25:023
74899282cyclictest0-21swapper/1100:15:313
74799281cyclictest0-21swapper/1019:22:382
74699282cyclictest0-21swapper/922:15:5511
74699282cyclictest0-21swapper/921:40:3911
74699282cyclictest0-21swapper/920:38:2311
74599282cyclictest0-21swapper/822:23:4410
74599282cyclictest0-21swapper/819:32:0110
74599280cyclictest0-21swapper/823:15:4410
74599280cyclictest0-21swapper/822:19:5910
74599280cyclictest0-21swapper/820:21:3010
74399282cyclictest0-21swapper/622:48:298
74399281cyclictest0-21swapper/623:27:328
74399280cyclictest0-21swapper/623:11:148
72699281cyclictest0-21swapper/320:53:315
70699283cyclictest0-21swapper/020:50:250
551280ksoftirqd/60-21swapper/622:37:458
551280ksoftirqd/60-21swapper/622:24:478
551280ksoftirqd/60-21swapper/620:25:098
551280ksoftirqd/60-21swapper/619:21:328
551280ksoftirqd/60-21swapper/619:12:388
74699273cyclictest0-21swapper/919:47:5311
74699271cyclictest0-21swapper/921:46:1211
74699271cyclictest0-21swapper/920:18:0911
74599273cyclictest0-21swapper/822:59:2510
74599271cyclictest0-21swapper/822:39:1710
74599271cyclictest0-21swapper/821:38:3210
74399270cyclictest0-21swapper/600:29:328
72699272cyclictest0-21swapper/319:30:215
71899271cyclictest0-21swapper/222:00:004
71899271cyclictest0-21swapper/220:40:014
551270ksoftirqd/60-21swapper/620:42:098
74899262cyclictest0-21swapper/1122:10:173
74899262cyclictest0-21swapper/1121:50:543
74899260cyclictest0-21swapper/1122:22:103
74899260cyclictest0-21swapper/1120:32:343
74699262cyclictest0-21swapper/921:37:2911
74699260cyclictest0-21swapper/922:38:1611
74399260cyclictest0-21swapper/623:59:178
74399260cyclictest0-21swapper/623:19:458
72699260cyclictest0-21swapper/322:20:395
551260ksoftirqd/60-21swapper/623:46:398
551260ksoftirqd/60-21swapper/621:22:128
74699251cyclictest0-21swapper/920:08:1511
74699250cyclictest0-21swapper/920:27:5411
74599251cyclictest0-21swapper/822:25:3110
72699251cyclictest0-21swapper/321:59:135
72699251cyclictest0-21swapper/321:26:415
72699251cyclictest0-21swapper/320:34:395
74899243cyclictest0-21swapper/1119:44:083
74899242cyclictest0-21swapper/1121:45:433
74899242cyclictest0-21swapper/1121:35:533
74899242cyclictest0-21swapper/1119:59:433
74799242cyclictest0-21swapper/1022:09:432
74699243cyclictest0-21swapper/920:30:5811
74599242cyclictest0-21swapper/800:35:0110
74599242cyclictest0-21swapper/800:35:0010
74599240cyclictest0-21swapper/820:11:3010
74399241cyclictest0-21swapper/621:54:048
74399240cyclictest0-21swapper/620:47:398
72699243cyclictest0-21swapper/321:35:185
71899242cyclictest0-21swapper/220:20:194
70699243cyclictest0-21swapper/023:00:200
74899230cyclictest0-21swapper/1121:12:123
74699231cyclictest0-21swapper/919:50:1611
74699231cyclictest0-21swapper/900:21:1111
74699231cyclictest0-21swapper/900:21:1011
74599231cyclictest0-21swapper/823:40:4810
74399233cyclictest0-21swapper/620:39:098
74399231cyclictest0-21swapper/621:02:438
73299232cyclictest0-21swapper/419:35:196
74899223cyclictest0-21swapper/1123:10:173
74899223cyclictest0-21swapper/1119:47:093
74899222cyclictest0-21swapper/1123:40:043
74899222cyclictest0-21swapper/1122:43:303
74899222cyclictest0-21swapper/1122:38:093
74899222cyclictest0-21swapper/1121:26:243
74899222cyclictest0-21swapper/1120:00:593
74899221cyclictest0-21swapper/1122:03:143
74899220cyclictest0-21swapper/1119:37:383
74799225cyclictest831ksoftirqd/1020:28:462
74799222cyclictest0-21swapper/1021:20:162
74799222cyclictest0-21swapper/1021:08:112
74699223cyclictest0-21swapper/923:12:5011
74699223cyclictest0-21swapper/921:25:1111
74699223cyclictest0-21swapper/919:19:3711
74699222cyclictest0-21swapper/920:56:5811
74699222cyclictest0-21swapper/919:23:3911
74699221cyclictest0-21swapper/922:43:0911
74699220cyclictest0-21swapper/920:21:4011
74599220cyclictest0-21swapper/821:03:1110
74599220cyclictest0-21swapper/800:35:1010
74399223cyclictest0-21swapper/619:54:438
73299222cyclictest0-21swapper/419:30:216
74799211cyclictest0-21swapper/1019:27:382
74699213cyclictest0-21swapper/900:29:4611
74699212cyclictest0-21swapper/923:02:1411
74699211cyclictest0-21swapper/923:31:1111
74699211cyclictest0-21swapper/920:02:1311
74399213cyclictest0-21swapper/623:05:448
74399212cyclictest0-21swapper/620:54:128
74399212cyclictest0-21swapper/600:08:118
74399212cyclictest0-21swapper/600:08:108
74399211cyclictest0-21swapper/623:32:458
74399211cyclictest0-21swapper/622:31:138
74899203cyclictest0-21swapper/1123:27:053
74899203cyclictest0-21swapper/1120:49:303
747992016cyclictest0-21swapper/1022:18:152
74799200cyclictest0-21swapper/1021:52:142
74699202cyclictest0-21swapper/919:55:3411
74699200cyclictest0-21swapper/922:52:1511
74599203cyclictest0-21swapper/823:06:1010
74599201cyclictest0-21swapper/822:53:4510
74399203cyclictest0-21swapper/623:43:398
74399203cyclictest0-21swapper/623:21:158
74399201cyclictest0-21swapper/621:12:428
73299203cyclictest0-21swapper/420:20:196
73299203cyclictest0-21swapper/400:00:206
72699203cyclictest0-21swapper/323:35:155
72699201cyclictest0-21swapper/320:03:095
74899192cyclictest0-21swapper/1120:13:083
74899192cyclictest0-21swapper/1119:33:583
74799192cyclictest831ksoftirqd/1023:55:152
74799191cyclictest0-21swapper/1019:20:002
74699192cyclictest0-21swapper/921:56:3011
74599191cyclictest0-21swapper/823:30:4510
72699194cyclictest0-21swapper/323:20:215
72699191cyclictest0-21swapper/320:15:085
74899183cyclictest0-21swapper/1123:58:163
74899183cyclictest0-21swapper/1100:20:163
74899183cyclictest0-21swapper/1100:20:163
748991816cyclictest0-21swapper/1100:39:563
747991817cyclictest831ksoftirqd/1000:20:312
747991817cyclictest831ksoftirqd/1000:20:302
747991817cyclictest11293-21iostat_ios22:40:192
747991817cyclictest0-21swapper/1020:04:542
74799181cyclictest831ksoftirqd/1022:10:022
74799181cyclictest831ksoftirqd/1021:30:312
74799181cyclictest831ksoftirqd/1021:20:022
74799181cyclictest831ksoftirqd/1019:50:232
74799181cyclictest831ksoftirqd/1019:35:302
74799181cyclictest2963450irq/53-eth0-rx-23:54:232
74799181cyclictest2963450irq/53-eth0-rx-20:20:232
74799181cyclictest0-21swapper/1023:43:322
74799180cyclictest0-21swapper/1020:46:412
74699181cyclictest0-21swapper/923:36:2511
74699181cyclictest0-21swapper/922:30:1811
74599182cyclictest0-21swapper/821:31:0910
74599181cyclictest0-21swapper/820:18:0110
74599180cyclictest0-21swapper/819:49:5910
74399183cyclictest0-21swapper/623:03:158
74399183cyclictest0-21swapper/622:04:348
74399183cyclictest0-21swapper/621:49:098
74399183cyclictest0-21swapper/619:26:018
74399180cyclictest0-21swapper/622:25:158
718991816cyclictest2287-21snmpd23:39:184
706991816cyclictest6803-21snmp_rack3slot900:21:510
706991816cyclictest6803-21snmp_rack3slot900:21:500
706991816cyclictest14741-21snmp_rack3slot923:40:230
74899172cyclictest0-21swapper/1120:53:293
74799172cyclictest0-21swapper/1020:34:282
747991716cyclictest831ksoftirqd/1023:00:232
747991716cyclictest26903-1kworker/10:0H19:10:042
747991716cyclictest26635-21python19:40:282
747991716cyclictest14406-21missed_timers21:00:242
747991716cyclictest0-21swapper/1020:55:192
747991716cyclictest0-21swapper/1000:00:142
74799170cyclictest89322chrt22:36:412
74799170cyclictest831ksoftirqd/1022:55:012
74799170cyclictest831ksoftirqd/1021:55:322
74799170cyclictest831ksoftirqd/1020:40:262
74799170cyclictest831ksoftirqd/1019:55:022
74799170cyclictest831ksoftirqd/1000:30:142
74799170cyclictest831ksoftirqd/1000:30:142
74799170cyclictest831ksoftirqd/1000:15:312
74799170cyclictest82172chrt23:30:352
74799170cyclictest76442chrt00:26:292
74799170cyclictest48952chrt23:29:462
74799170cyclictest40292sleep1022:30:152
74799170cyclictest37932sleep1023:21:332
74799170cyclictest310742sleep1021:29:082
74799170cyclictest2963450irq/53-eth0-rx-23:16:202
74799170cyclictest2963450irq/53-eth0-rx-22:00:092
74799170cyclictest2963450irq/53-eth0-rx-21:45:242
74799170cyclictest2963450irq/53-eth0-rx-19:45:292
74799170cyclictest29582sleep1021:35:112
74799170cyclictest281482sleep1000:05:282
74799170cyclictest281482sleep1000:05:272
74799170cyclictest266422sleep1020:35:032
74799170cyclictest226982sleep1021:11:072
74799170cyclictest163552sleep1023:45:372
74799170cyclictest144192sleep1020:15:012
74799170cyclictest140492sleep1020:11:002
74799170cyclictest133982sleep1022:46:172
74799170cyclictest12250irq/42-ahci23:10:072
74799170cyclictest12250irq/42-ahci23:10:002
74799170cyclictest12250irq/42-ahci22:25:142
74799170cyclictest12250irq/42-ahci22:20:032
74799170cyclictest12250irq/42-ahci19:30:062
74799170cyclictest118422sleep1023:35:352
743991716cyclictest457-21qemu-kvm19:44:388
743991716cyclictest457-21qemu-kvm19:31:368
73999179cyclictest0-21swapper/519:10:197
73999172cyclictest0-21swapper/523:35:197
73299171cyclictest0-21swapper/420:30:176
72699171cyclictest0-21swapper/322:45:355
718991715cyclictest2287-21snmpd19:18:454
70699172cyclictest0-21swapper/020:45:200
70699172cyclictest0-21swapper/019:40:190
706991715cyclictest6252-21snmp_rack3slot919:15:160
706991715cyclictest24521-21snmp_easybox.os00:00:130
706991715cyclictest11230-21snmp_rack3slot900:31:010
706991715cyclictest11230-21snmp_rack3slot900:31:010
70699171cyclictest0-21swapper/023:50:070
70699171cyclictest0-21swapper/020:00:130
74899163cyclictest0-21swapper/1119:50:443
748991615cyclictest2963450irq/53-eth0-rx-20:15:133
74899161cyclictest0-21swapper/1122:30:163
74899161cyclictest0-21swapper/1120:40:393
74599163cyclictest0-21swapper/800:24:4510
74599163cyclictest0-21swapper/800:24:4510
74599161cyclictest0-21swapper/823:04:4410
74599161cyclictest0-21swapper/820:44:4210
74399163cyclictest0-21swapper/621:55:138
74399163cyclictest0-21swapper/620:58:438
73999163cyclictest0-21swapper/500:35:197
739991614cyclictest22300-21qemu-kvm22:13:487
73299161cyclictest0-21swapper/423:40:006
73299161cyclictest0-21swapper/423:00:176
73299161cyclictest0-21swapper/420:20:006
73299160cyclictest0-21swapper/422:15:176
72699163cyclictest0-21swapper/321:50:155
72699163cyclictest0-21swapper/320:28:395
72699161cyclictest0-21swapper/322:11:135
718991614cyclictest2287-21snmpd21:41:034
718991614cyclictest2287-21snmpd19:22:004
71899160cyclictest0-21swapper/223:00:314
71899160cyclictest0-21swapper/220:50:004
71899160cyclictest0-21swapper/220:30:204
706991614cyclictest3092-21snmp_rack3slot900:15:500
706991614cyclictest21125-21snmp_rack3slot921:10:190
706991614cyclictest11943-21snmp_rack3slot923:36:520
70699161cyclictest0-21swapper/000:35:230
74899150cyclictest0-21swapper/1121:08:393
74699152cyclictest0-21swapper/921:08:5311
74699152cyclictest0-21swapper/900:35:3511
746991514cyclictest0-21swapper/922:57:5411
74599152cyclictest0-21swapper/822:33:4610
74599150cyclictest0-21swapper/823:23:4510
74599150cyclictest0-21swapper/822:07:2010
74399152cyclictest22301-21qemu-kvm22:11:248
74399152cyclictest0-21swapper/622:58:458
743991513cyclictest0-21swapper/623:51:168
74399150cyclictest0-21swapper/622:40:168
73999153cyclictest0-21swapper/519:35:187
73999150cyclictest17989-21munin-run20:20:007
73999150cyclictest0-21swapper/522:55:157
73999150cyclictest0-21swapper/521:40:297
73999150cyclictest0-21swapper/500:30:007
73299150cyclictest0-21swapper/421:15:016
72699150cyclictest0-21swapper/323:00:275
72699150cyclictest0-21swapper/321:17:415
71899152cyclictest0-21swapper/222:10:144
718991514cyclictest2287-21snmpd20:42:154
718991513cyclictest2287-21snmpd22:46:034
71899150cyclictest0-21swapper/222:55:144
71899150cyclictest0-21swapper/221:30:124
71899150cyclictest0-21swapper/219:25:154
70699152cyclictest0-21swapper/023:10:130
74899141cyclictest0-21swapper/1122:09:023
74899141cyclictest0-21swapper/1119:16:383
74699141cyclictest0-21swapper/923:55:4611
74699141cyclictest0-21swapper/921:00:4211
74699141cyclictest0-21swapper/919:38:3811
74599141cyclictest0-21swapper/823:26:4610
74599141cyclictest0-21swapper/820:54:0110
74599141cyclictest0-21swapper/819:55:0110
74399141cyclictest0-21swapper/600:04:258
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional