You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-04-22 - 02:35
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot3.osadl.org (updated Tue Apr 22, 2025 00:43:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4154861991511,1cyclictest0-21swapper/319:30:153
4154861991211,0cyclictest0-21swapper/319:25:133
4154861991211,0cyclictest0-21swapper/300:35:133
415486199120,8cyclictest0-21swapper/300:30:143
415486199120,11cyclictest0-21swapper/321:05:023
415486199120,11cyclictest0-21swapper/320:50:083
415486199120,11cyclictest0-21swapper/320:20:213
415486199120,11cyclictest0-21swapper/320:00:173
415486199120,11cyclictest0-21swapper/319:20:183
415486199120,11cyclictest0-21swapper/300:25:013
4154861991111,0cyclictest0-21swapper/322:15:153
4154861991110,0cyclictest0-21swapper/322:20:113
4154861991110,0cyclictest0-21swapper/319:35:193
415486199110,11cyclictest0-21swapper/322:50:003
415486199110,10cyclictest0-21swapper/323:50:093
415486199110,10cyclictest0-21swapper/323:10:083
415486199110,10cyclictest0-21swapper/322:55:183
415486199110,10cyclictest0-21swapper/321:25:003
415486199110,10cyclictest0-21swapper/320:41:273
415486199110,0cyclictest0-21swapper/323:40:013
415486199110,0cyclictest0-21swapper/321:00:133
415486199110,0cyclictest0-21swapper/319:15:003
415486199108,2cyclictest0-21swapper/322:10:103
415486199108,1cyclictest0-21swapper/323:20:143
4154861991010,0cyclictest0-21swapper/320:35:143
415486199100,10cyclictest0-21swapper/319:55:013
41548619999,0cyclictest0-21swapper/323:34:283
41548619999,0cyclictest0-21swapper/322:40:163
41548619999,0cyclictest0-21swapper/322:30:153
41548619999,0cyclictest0-21swapper/320:15:193
41548619999,0cyclictest0-21swapper/319:15:013
41548619998,0cyclictest0-21swapper/323:55:123
41548619998,0cyclictest0-21swapper/300:15:023
41548619990,8cyclictest0-21swapper/319:40:213
41548619990,7cyclictest0-21swapper/300:00:133
41548619990,0cyclictest0-21swapper/323:15:133
41548619990,0cyclictest0-21swapper/322:50:083
41548619990,0cyclictest0-21swapper/321:15:173
41548619988,0cyclictest0-21swapper/323:40:163
41548619988,0cyclictest0-21swapper/323:10:013
41548619988,0cyclictest0-21swapper/323:03:523
41548619988,0cyclictest0-21swapper/321:59:093
41548619988,0cyclictest0-21swapper/321:54:043
41548619988,0cyclictest0-21swapper/321:10:153
41548619980,8cyclictest0-21swapper/319:55:183
41548619977,0cyclictest0-21swapper/322:35:143
41548619977,0cyclictest0-21swapper/321:30:083
41548619977,0cyclictest0-21swapper/321:24:593
41548619977,0cyclictest0-21swapper/320:25:173
41548619977,0cyclictest0-21swapper/300:10:153
41548619977,0cyclictest0-21swapper/300:06:473
41548619976,0cyclictest0-21swapper/321:49:473
41548619970,6cyclictest0-21swapper/321:35:143
4152786271,4sleep30-21swapper/319:05:013
41548619966,0cyclictest0-21swapper/322:00:203
41548619955,0cyclictest0-21swapper/322:09:283
41548619955,0cyclictest0-21swapper/320:30:223
4154324251,2sleep20-21swapper/219:05:242
4168642240,0sleep04168818-21latency_hist19:45:010
41548619944,0cyclictest0-21swapper/323:25:253
41548619944,0cyclictest0-21swapper/320:59:053
41548619944,0cyclictest0-21swapper/319:45:213
41548619944,0cyclictest0-21swapper/300:26:013
41548619943,0cyclictest0-21swapper/322:25:293
41548619943,0cyclictest0-21swapper/320:10:173
41548619940,4cyclictest0-21swapper/321:40:183
41548619940,3cyclictest61083-21chrt23:45:023
41548619940,3cyclictest4190714-21chrt20:46:553
41548619940,3cyclictest4176752-21chrt20:07:483
4153477241,1sleep00-21swapper/019:05:180
13989840,3rtkit-daemon613-21systemd-logind00:01:511
13989840,2rtkit-daemon614-21wpa_supplicant23:18:181
13989840,2rtkit-daemon614-21wpa_supplicant00:23:021
13989840,2rtkit-daemon53774-21turbostat.cron23:25:011
13989840,2rtkit-daemon4156871-21munin-node22:41:351
13989840,2rtkit-daemon1399-21sendmail-mta21:48:141
13989840,2rtkit-daemon1-21systemd22:16:001
61647230,2sleep161764-21latency_hist23:50:011
56384230,2sleep256388-21ssh23:32:412
4153021231,1sleep10-21swapper/119:05:031
13989830,2rtkit-daemon684-21gmain19:21:280
13989830,2rtkit-daemon600-21avahi-daemon20:28:090
13989830,2rtkit-daemon4156871-21munin-node20:50:020
13989830,2rtkit-daemon4156871-21munin-node00:37:591
13989830,1rtkit-daemon765-21lldpd20:32:270
13989830,1rtkit-daemon760-21snmpd21:40:260
13989830,1rtkit-daemon760-21snmpd20:35:270
13989830,1rtkit-daemon614-21wpa_supplicant23:35:401
13989830,1rtkit-daemon600-21avahi-daemon21:50:521
13989830,1rtkit-daemon55103-21cat23:30:141
13989830,1rtkit-daemon4980-21diskmemload21:35:200
13989830,1rtkit-daemon4156871-21munin-node19:17:040
13989830,1rtkit-daemon331-21plymouthd22:50:101
13989830,1rtkit-daemon331-21plymouthd22:10:101
13989830,1rtkit-daemon331-21plymouthd21:55:221
13989830,1rtkit-daemon331-21plymouthd21:01:280
13989830,1rtkit-daemon331-21plymouthd20:23:270
13989830,1rtkit-daemon331-21plymouthd19:11:260
13989830,1rtkit-daemon1-21systemd23:26:331
13989830,1rtkit-daemon1-21systemd23:07:311
13989830,1rtkit-daemon1-21systemd22:48:531
13989830,1rtkit-daemon1-21systemd22:25:281
13989830,1rtkit-daemon1-21systemd22:00:571
13989830,1rtkit-daemon1-21systemd21:41:291
13989830,1rtkit-daemon1-21systemd00:33:001
13989830,1rtkit-daemon1-21systemd00:17:141
13989830,1rtkit-daemon1-21systemd00:13:251
13989830,0rtkit-daemon0-21swapper/123:50:181
13989830,0rtkit-daemon0-21swapper/021:28:270
13989830,0rtkit-daemon0-21swapper/019:57:270
80239220,1sleep20-21swapper/200:40:012
78142220,1sleep00-21swapper/000:34:550
74943220,1sleep00-21swapper/000:22:060
6964220,1sleep20-21swapper/221:15:002
66105220,1sleep066131-21apt-get00:00:130
63698220,1sleep20-21swapper/223:54:472
61129220,1sleep00-21swapper/023:45:280
60439220,1sleep060442-21sshd23:41:280
59870220,1sleep160007-21sort23:40:211
46454220,0sleep00-21swapper/023:02:570
4179081220,1sleep00-21swapper/020:15:150
4157554220,1sleep24157819-21diskstats19:15:172
38771220,1sleep039008-21grep22:40:240
36656220,2sleep236852-21unixbench-2d22:35:212
30189220,0sleep00-21swapper/022:17:540
18912220,1sleep019037-21grep21:50:010
13989820,1rtkit-daemon762-21ntpd23:55:011
13989820,1rtkit-daemon760-21snmpd19:45:100
13989820,1rtkit-daemon4156871-21munin-node20:45:200
13989820,1rtkit-daemon4156871-21munin-node19:39:340
13989820,1rtkit-daemon1399-21sendmail-mta20:00:090
13989820,1rtkit-daemon1-21systemd23:10:111
13989820,1rtkit-daemon1-21systemd20:40:400
13989820,1rtkit-daemon1-21systemd20:05:210
13989820,1rtkit-daemon1-21systemd19:30:520
13989820,1rtkit-daemon1-21systemd00:05:431
13989820,0rtkit-daemon331-21plymouthd21:16:320
13989820,0rtkit-daemon331-21plymouthd21:10:290
13989820,0rtkit-daemon331-21plymouthd00:25:031
13989820,0rtkit-daemon0-21swapper/123:01:021
13989820,0rtkit-daemon0-21swapper/122:55:201
13989820,0rtkit-daemon0-21swapper/122:35:351
13989820,0rtkit-daemon0-21swapper/122:30:111
13989820,0rtkit-daemon0-21swapper/122:20:181
13989820,0rtkit-daemon0-21swapper/122:05:041
13989820,0rtkit-daemon0-21swapper/021:30:200
13989820,0rtkit-daemon0-21swapper/021:20:260
13989820,0rtkit-daemon0-21swapper/021:05:040
13989820,0rtkit-daemon0-21swapper/020:55:040
13989820,0rtkit-daemon0-21swapper/020:10:230
13989820,0rtkit-daemon0-21swapper/019:50:030
13989820,0rtkit-daemon0-21swapper/019:25:020
12210220,1sleep112211-21/usr/sbin/munin21:30:081
9239210,0sleep10-21swapper/121:20:121
8590210,0sleep10-21swapper/121:16:071
80032210,0sleep00-21swapper/000:38:110
77362210,0sleep20-21swapper/200:30:172
76056210,0sleep00-21swapper/000:29:550
75570210,0sleep20-21swapper/200:25:372
74287210,0sleep20-21swapper/200:20:192
7211210,0sleep20-21swapper/221:15:122
71519210,0sleep20-21swapper/200:15:162
70817210,0sleep00-21swapper/000:15:020
70358210,0sleep20-21swapper/200:11:002
6895210,0sleep10-21swapper/121:14:231
68733210,0sleep00-21swapper/000:10:010
68664210,1sleep00-21swapper/000:09:250
66227210,0sleep20-21swapper/200:00:152
64488210,0sleep00-21swapper/023:55:170
64136210,0sleep20-21swapper/223:55:152
62935210,0sleep00-21swapper/023:50:160
61268210,0sleep20-21swapper/223:46:422
58737210,0sleep20-21swapper/223:40:022
57692210,0sleep00-21swapper/023:35:190
56651210,0sleep20-21swapper/223:35:012
56224210,1sleep00-21swapper/023:31:140
53360210,0sleep20-21swapper/223:21:282
52488210,0sleep00-21swapper/023:20:180
51253210,0sleep20-21swapper/223:16:282
49606210,0sleep00-21swapper/023:15:020
48182210,0sleep20-21swapper/223:10:122
46967211,0sleep20-21swapper/223:05:272
44846210,0sleep20-21swapper/223:00:062
44192210,0sleep20-21swapper/222:56:352
43368210,0sleep00-21swapper/022:55:170
4235210,0sleep20-21swapper/221:05:202
4192892210,0sleep10-21swapper/120:55:021
4192575210,0sleep20-21swapper/220:51:192
4191967210,0sleep10-21swapper/120:50:141
4190335210,0sleep10-21swapper/120:45:021
4188305210,0sleep10-21swapper/120:38:451
4186496210,0sleep20-21swapper/220:35:022
4182343210,1sleep20-21swapper/220:20:452
4181456210,0sleep10-21swapper/120:20:151
4179365210,0sleep20-21swapper/220:15:172
4175880210,0sleep14176034-21ntp_states20:05:191
4174389210,0sleep20-21swapper/220:00:202
4174241210,0sleep10-21swapper/120:00:191
4172724210,0sleep10-21swapper/119:55:271
4168463210,0sleep20-21swapper/219:42:432
4167107210,0sleep10-21swapper/119:40:171
4165078210,0sleep20-21swapper/219:35:142
4165049210,0sleep14165075-21apt-get19:35:131
4161779210,0sleep20-21swapper/219:25:172
4159349210,0sleep20-21swapper/219:20:132
4159320210,0sleep10-21swapper/119:20:121
4158105210,0sleep10-21swapper/119:15:201
4155250210,0sleep10-21swapper/119:10:161
40661210,0sleep00-21swapper/022:50:080
40658210,0sleep20-21swapper/222:50:062
39971210,0sleep00-21swapper/022:46:080
37913210,0sleep20-21swapper/222:40:182
3459210,0sleep10-21swapper/121:05:151
33849210,0sleep00-21swapper/022:30:110
33613210,0sleep20-21swapper/222:30:092
33162210,0sleep20-21swapper/222:28:292
32924210,0sleep00-21swapper/022:26:230
31670210,0sleep00-21swapper/022:20:190
29314210,0sleep20-21swapper/222:15:202
27969210,0sleep00-21swapper/022:11:460
26497210,0sleep20-21swapper/222:10:082
25977210,0sleep20-21swapper/222:09:562
2589210,0sleep10-21swapper/121:02:221
23946210,0sleep20-21swapper/222:00:192
22333210,0sleep20-21swapper/221:55:232
20019210,0sleep20-21swapper/221:50:152
19690210,0sleep00-21swapper/021:50:130
17708210,0sleep20-21swapper/221:41:262
14702210,0sleep20-21swapper/221:35:182
13990210,0sleep10-21swapper/121:35:011
13844210,0sleep20-21swapper/221:33:302
11951210,0sleep10-21swapper/121:29:561
11530210,0sleep20-21swapper/221:25:332
10372210,0sleep20-21swapper/221:20:212
68169200,0sleep20-21swapper/200:05:032
54001200,0sleep20-21swapper/223:25:052
53999200,0sleep00-21swapper/023:25:030
47486200,0sleep00-21swapper/023:10:020
46691200,0sleep00-21swapper/023:05:010
4193098200,0sleep20-21swapper/220:55:032
4190567200,0sleep20-21swapper/220:45:022
4188660200,0sleep20-21swapper/220:40:022
4188404200,0sleep10-21swapper/120:40:011
4184822200,0sleep10-21swapper/120:30:051
4184584200,0sleep20-21swapper/220:30:022
4182910200,0sleep10-21swapper/120:25:041
4182674200,0sleep20-21swapper/220:25:012
4179067200,0sleep10-21swapper/120:15:041
4177159200,0sleep20-21swapper/220:10:042
4177158200,0sleep10-21swapper/120:10:031
4175249200,0sleep20-21swapper/220:05:032
4171407200,0sleep20-21swapper/219:55:032
4169498200,0sleep20-21swapper/219:50:032
4169497200,0sleep10-21swapper/119:50:021
4168876200,0sleep20-21swapper/219:45:032
4168819200,0sleep10-21swapper/119:45:021
4163126200,0sleep20-21swapper/219:30:022
4162891200,0sleep10-21swapper/119:30:011
4161218200,0sleep10-21swapper/119:25:051
4154695200,0sleep20-21swapper/219:10:012
39850200,0sleep20-21swapper/222:45:022
35661200,0sleep00-21swapper/022:35:030
30692200,0sleep20-21swapper/222:20:032
25218200,0sleep00-21swapper/022:05:020
23086200,0sleep00-21swapper/022:00:010
21000200,0sleep00-21swapper/021:55:000
18348200,0sleep20-21swapper/221:45:022
1108200,0sleep20-21swapper/221:00:032
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional