You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-16 - 08:11
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rack2slot0.osadl.org (updated Tue Jul 16, 2024 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
20062900,0sleep20-21swapper/221:23:272
29302730,0sleep00-21swapper/023:27:100
177362580,0sleep30-21swapper/300:14:593
38572560,0sleep20-21swapper/222:26:152
264412550,1sleep126440-21bash23:26:191
21422550,1sleep32145-21bash21:23:283
9502530,0sleep10-21swapper/100:06:491
145392530,1sleep00-21swapper/019:30:180
314162520,0sleep00-21swapper/023:08:440
295092520,1sleep2311rcuc/222:10:012
26122520,0sleep20-21swapper/200:32:492
251792520,0sleep30-21swapper/321:35:073
213782520,0sleep00-21swapper/023:44:050
152472520,1sleep115243-21lspci23:52:351
65952510,1sleep0101ktimersoftd/023:00:190
65952510,1sleep0101ktimersoftd/023:00:190
15112510,0sleep00-21swapper/023:20:580
91792500,0sleep20-21swapper/223:52:002
207292500,0sleep20-21swapper/223:28:532
13082490,0sleep30-21swapper/322:35:183
46592480,1sleep00-21swapper/022:10:400
219432480,0sleep10-21swapper/121:40:581
55172470,0sleep10-21swapper/100:13:451
217042470,0sleep20-21swapper/221:56:332
121542470,0sleep30-21swapper/300:33:503
248622460,0sleep00-21swapper/021:56:510
65802430,1sleep36578-21lspci00:29:583
164992410,2sleep2499899cyclictest23:37:302
316932390,1sleep031691-21sshd22:29:030
472323220,7sleep20-21swapper/219:07:592
46672276,7sleep00-21swapper/019:07:170
458922711,11sleep10-21swapper/119:06:221
457122210,7sleep30-21swapper/319:06:083
17822220,0sleep10-21swapper/100:32:441
49652200,0sleep00-21swapper/000:04:030
16002190,0sleep20-21swapper/200:16:312
191162180,0sleep30-21swapper/321:46:553
4985991716,0cyclictest23563-21lspci23:53:220
322632170,1sleep132261-21sshd22:56:391
194612160,0sleep10-21swapper/123:10:321
54222150,0sleep10-21swapper/100:23:231
499299152,2cyclictest616-17auditd00:17:501
306792150,0sleep30-21swapper/320:10:183
214662150,0sleep30-21swapper/323:22:523
166102150,1sleep216608-21lspci23:58:492
160002140,0sleep10-21swapper/122:30:321
500399130,2cyclictest5238-21sshd23:18:203
499299130,1cyclictest9491-21lspci22:17:291
234972130,1sleep341-21ksoftirqd/323:56:213
161302130,0sleep00-21swapper/000:30:510
101172130,0sleep30-21swapper/323:30:503
5003991210,1cyclictest75550irq/24-eno1-rx-22:24:193
5003991210,1cyclictest28323-21sshd21:16:393
5003991210,1cyclictest25822-21bash22:00:093
500399120,1cyclictest648-21systemd-logind00:18:093
500399120,1cyclictest0-21swapper/300:00:393
500399120,11cyclictest0-21swapper/323:50:593
499899120,11cyclictest646-21dbus-daemon23:02:302
499899120,11cyclictest646-21dbus-daemon23:02:302
499299120,11cyclictest0-21swapper/121:15:191
4985991211,0cyclictest22737-21lspci21:41:030
4985991210,1cyclictest648-21systemd-logind22:54:010
252502120,0sleep1231rcuc/122:03:151
500399119,1cyclictest27048-21lspci23:08:193
500399118,2cyclictest3054-21sshd00:39:293
500399118,2cyclictest3054-21sshd00:39:283
500399110,10cyclictest0-21swapper/300:08:493
500399110,0cyclictest0-21swapper/322:13:583
499899119,1cyclictest25381-21sshd00:09:202
499899119,1cyclictest0-21swapper/222:41:292
4998991110,0cyclictest0-21swapper/223:49:202
4998991110,0cyclictest0-21swapper/223:24:402
4998991110,0cyclictest0-21swapper/222:59:192
4998991110,0cyclictest0-21swapper/221:52:292
4998991110,0cyclictest0-21swapper/221:28:592
499899110,10cyclictest0-21swapper/223:44:302
499899110,10cyclictest0-21swapper/200:36:102
499899110,10cyclictest0-21swapper/200:36:102
499899110,0cyclictest0-21swapper/222:24:492
499299119,1cyclictest14827-21bash22:51:591
499299119,1cyclictest13569-21grep23:31:101
4992991110,0cyclictest0-21swapper/100:25:291
499299110,1cyclictest0-21swapper/122:39:191
499299110,10cyclictest0-21swapper/121:51:191
498599119,1cyclictest24238-21kworker/0:022:42:400
498599119,1cyclictest15245-21lspci21:24:480
4985991110,0cyclictest0-21swapper/000:15:220
498599110,10cyclictest0-21swapper/023:47:420
498599110,10cyclictest0-21swapper/021:49:510
498599110,0cyclictest0-21swapper/022:23:110
500399109,0cyclictest0-21swapper/323:39:093
500399109,0cyclictest0-21swapper/322:55:093
500399109,0cyclictest0-21swapper/322:44:393
500399109,0cyclictest0-21swapper/319:44:383
500399108,1cyclictest8308-21sshd22:48:193
5003991010,0cyclictest0-21swapper/321:31:293
500399100,9cyclictest0-21swapper/320:38:283
500399100,9cyclictest0-21swapper/320:17:373
500399100,0cyclictest0-21swapper/321:50:293
499899109,0cyclictest0-21swapper/222:45:092
499899109,0cyclictest0-21swapper/222:33:392
499899109,0cyclictest0-21swapper/222:08:492
499899108,1cyclictest646-21dbus-daemon22:52:292
499899100,0cyclictest0-21swapper/222:01:092
499299109,0cyclictest0-21swapper/123:58:401
499299108,1cyclictest0-21swapper/123:02:001
499299108,1cyclictest0-21swapper/123:02:001
499299100,9cyclictest0-21swapper/122:45:101
499299100,0cyclictest0-21swapper/123:23:101
498599109,0cyclictest0-21swapper/022:18:310
498599109,0cyclictest0-21swapper/020:15:310
498599109,0cyclictest0-21swapper/000:28:320
498599100,9cyclictest0-21swapper/020:25:310
498599100,9cyclictest0-21swapper/019:35:010
498599100,0cyclictest0-21swapper/023:38:020
498599100,0cyclictest0-21swapper/022:06:410
498599100,0cyclictest0-21swapper/000:20:520
138782100,1sleep3500399cyclictest21:55:453
50039998,0cyclictest0-21swapper/323:14:393
50039998,0cyclictest0-21swapper/322:19:393
50039998,0cyclictest0-21swapper/320:25:283
50039998,0cyclictest0-21swapper/319:51:273
50039998,0cyclictest0-21swapper/319:47:283
50039997,1cyclictest10217-21sshd22:33:093
50039997,1cyclictest0-21swapper/323:48:483
50039995,3cyclictest649-21avahi-daemon23:29:333
49989998,0cyclictest0-21swapper/223:32:402
49989998,0cyclictest0-21swapper/221:17:092
49989997,1cyclictest1-21systemd22:37:492
49989995,3cyclictest646-21dbus-daemon23:17:442
49929998,0cyclictest0-21swapper/123:05:101
49859998,0cyclictest0-21swapper/023:57:220
49859998,0cyclictest0-21swapper/021:50:210
49859998,0cyclictest0-21swapper/021:29:510
49859998,0cyclictest0-21swapper/021:13:200
49859997,1cyclictest9-21ksoftirqd/021:16:510
49859997,1cyclictest31111-21sshd22:32:010
49859997,1cyclictest24586-21lspci22:00:000
49859990,8cyclictest0-21swapper/021:07:010
28167290,0sleep20-21swapper/200:28:522
7402280,1sleep125-21ksoftirqd/121:48:591
50039987,0cyclictest0-21swapper/323:43:593
50039986,1cyclictest620-13audispd00:20:403
50039986,1cyclictest20870-21lspci22:09:113
50039983,2cyclictest646-21dbus-daemon22:50:533
49989986,1cyclictest2707-21sshd00:03:502
49989986,1cyclictest20889-21lspci23:07:442
49989986,1cyclictest20371-21lspci00:11:592
49989986,1cyclictest17374-21lspci21:49:572
49989985,2cyclictest649-21avahi-daemon23:14:162
49989984,3cyclictest700-21gdbus21:32:222
49929987,0cyclictest14349-21sshd23:49:301
49929986,1cyclictest649-21avahi-daemon21:38:501
49929985,2cyclictest649-21avahi-daemon22:40:331
49929985,2cyclictest21564-21sshd23:40:591
49929983,2cyclictest700-21gdbus21:57:511
49859987,0cyclictest0-21swapper/019:10:310
49859987,0cyclictest0-21swapper/000:38:220
49859987,0cyclictest0-21swapper/000:38:210
49859986,1cyclictest9-21ksoftirqd/023:17:300
49859986,1cyclictest9-21ksoftirqd/022:45:260
49859986,1cyclictest9-21ksoftirqd/022:35:200
49859986,1cyclictest9-21ksoftirqd/021:37:290
49859986,1cyclictest30879-21lspci00:09:530
49859986,1cyclictest16970-21/usr/sbin/munin23:10:220
49859985,2cyclictest700-21gdbus21:33:370
49859985,2cyclictest649-21avahi-daemon23:32:370
10842280,1sleep1646-21dbus-daemon23:15:471
50039976,0cyclictest0-21swapper/320:51:283
50039975,1cyclictest24512-21sshd21:10:053
50039975,1cyclictest17463-21lspci21:40:313
50039975,1cyclictest1238-21sshd22:26:023
50039975,1cyclictest0-21swapper/321:29:593
50039973,3cyclictest646-21dbus-daemon23:00:083
50039973,3cyclictest646-21dbus-daemon23:00:073
49989975,1cyclictest31186-21sshd22:19:382
49989974,1cyclictest649-21avahi-daemon21:38:332
49989973,3cyclictest700-21gdbus21:41:072
49989973,3cyclictest700-21gdbus00:20:572
49989972,1cyclictest121rcu_preempt21:10:552
49929976,0cyclictest0-21swapper/122:12:491
49929976,0cyclictest0-21swapper/121:12:091
49929975,1cyclictest9348-21sshd22:26:481
49929975,1cyclictest649-21avahi-daemon21:27:011
49929975,1cyclictest649-21avahi-daemon21:24:111
49929975,1cyclictest4043-21lspci22:23:111
49929974,2cyclictest649-21avahi-daemon22:06:331
49929974,2cyclictest649-21avahi-daemon00:03:301
49929974,2cyclictest648-21systemd-logind21:33:251
49859974,2cyclictest700-21gdbus00:10:010
49859974,2cyclictest14866-21sshd22:55:050
26145270,0sleep126148-21bash23:35:191
50039965,0cyclictest0-21swapper/321:06:373
50039965,0cyclictest0-21swapper/320:56:083
50039965,0cyclictest0-21swapper/319:58:583
50039965,0cyclictest0-21swapper/319:36:383
50039963,2cyclictest17299-21snmpd20:48:223
50039960,0cyclictest0-21swapper/319:34:183
49989965,0cyclictest0-21swapper/220:03:292
49989963,2cyclictest17299-21snmpd20:14:422
49989960,5cyclictest0-21swapper/220:37:392
49929966,0cyclictest31644-21kworker/1:020:38:231
49929966,0cyclictest19404-21kworker/1:019:56:291
49929965,0cyclictest0-21swapper/119:20:191
49929962,2cyclictest23376-21sshd00:35:021
49929962,2cyclictest23376-21sshd00:35:021
49859965,0cyclictest0-21swapper/020:05:110
49859965,0cyclictest0-21swapper/019:15:200
49859964,1cyclictest649-21avahi-daemon19:25:300
49859962,3cyclictest19773-21perf19:45:000
50039953,1cyclictest646-21dbus-daemon20:30:003
50039953,1cyclictest28634-21cat20:05:183
50039953,1cyclictest17299-21snmpd20:42:453
50039953,1cyclictest17299-21snmpd20:22:483
50039953,1cyclictest17299-21snmpd19:16:433
50039953,1cyclictest17299-21snmpd19:11:253
50039953,1cyclictest1058-21sendmail21:01:503
50039952,2cyclictest646-21dbus-daemon19:20:013
50039952,2cyclictest12593-21cut19:25:233
49989953,1cyclictest4411-21mii-tool20:25:142
49989953,1cyclictest28638-21cat20:05:172
49989953,1cyclictest18212-21taskset21:00:112
49989953,1cyclictest17299-21snmpd21:05:132
49989953,1cyclictest17299-21snmpd20:50:522
49989953,1cyclictest17299-21snmpd20:48:522
49989953,1cyclictest17299-21snmpd19:55:302
49989953,1cyclictest17299-21snmpd19:45:262
49989953,1cyclictest17299-21snmpd19:35:232
49989953,1cyclictest17299-21snmpd19:30:592
49989953,1cyclictest17299-21snmpd19:15:192
49989953,1cyclictest17299-21snmpd19:10:282
49989953,1cyclictest12337-21cat19:25:182
49989950,1cyclictest9808-21/usr/sbin/munin19:20:182
49989950,0cyclictest0-21swapper/220:55:282
49989950,0cyclictest0-21swapper/220:20:492
49989950,0cyclictest0-21swapper/219:50:392
49929955,0cyclictest6674-21kworker/1:119:25:411
49929953,1cyclictest8430-21grep19:15:171
49929953,1cyclictest682-21lsmd19:40:351
49929953,1cyclictest649-21avahi-daemon19:11:291
49929953,1cyclictest646-21dbus-daemon20:45:001
49929953,1cyclictest30323-21tr20:10:121
49929953,1cyclictest26255-21cstates20:00:171
49929953,1cyclictest18692-21cat21:00:151
49929953,1cyclictest17299-21snmpd21:06:261
49929953,1cyclictest17299-21snmpd20:56:031
49929953,1cyclictest17299-21snmpd20:27:041
49929953,1cyclictest17299-21snmpd20:20:091
49929953,1cyclictest17299-21snmpd20:15:301
49929953,1cyclictest17299-21snmpd19:50:051
49929953,1cyclictest17299-21snmpd19:47:141
49929953,1cyclictest17299-21snmpd19:35:021
49929953,1cyclictest17299-21snmpd19:30:021
49929952,2cyclictest17299-21snmpd20:30:031
49929950,0cyclictest0-21swapper/120:44:091
49859954,0cyclictest0-21swapper/020:11:410
49859954,0cyclictest0-21swapper/019:50:010
49859953,1cyclictest17963-21sadc21:00:000
49859953,1cyclictest17299-21snmpd21:01:280
49859953,1cyclictest17299-21snmpd20:51:430
49859953,1cyclictest17299-21snmpd20:20:330
49859953,1cyclictest17299-21snmpd20:03:240
49859953,1cyclictest17299-21snmpd19:55:120
49859953,1cyclictest12953-21grep20:45:210
49859953,1cyclictest1058-21sendmail20:30:080
49859953,1cyclictest10265-21cat19:20:160
49859952,2cyclictest17299-21snmpd20:40:580
49859952,2cyclictest17299-21snmpd19:49:320
50039942,1cyclictest1017-21runrttasks20:00:133
49989942,1cyclictest18408-21if_eno219:40:162
49989942,1cyclictest1046-21timerwakeupswit20:15:282
49989942,1cyclictest0-21swapper/220:40:182
49989940,3cyclictest5983-21/usr/sbin/munin20:30:162
49929942,1cyclictest17299-21snmpd20:05:081
49929942,1cyclictest14137-21cpu20:50:141
49859941,2cyclictest8190-21wc20:35:170
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional