You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-01-15 - 08:51
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot3.osadl.org (updated Wed Jan 15, 2025 00:43:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
410768399130,12cyclictest0-21swapper/322:15:133
410768399120,1cyclictest0-21swapper/322:10:083
410768399120,11cyclictest0-21swapper/323:12:513
410768399120,11cyclictest0-21swapper/321:20:153
410768399120,11cyclictest0-21swapper/320:25:103
410768399119,1cyclictest0-21swapper/321:55:113
4107683991111,0cyclictest0-21swapper/321:15:013
410768399110,9cyclictest0-21swapper/319:40:123
410768399110,10cyclictest0-21swapper/322:45:013
410768399110,10cyclictest0-21swapper/320:10:223
410768399110,10cyclictest0-21swapper/300:30:153
410768399110,0cyclictest0-21swapper/320:35:123
410768399109,0cyclictest0-21swapper/323:27:013
410768399109,0cyclictest0-21swapper/300:00:023
4107683991010,0cyclictest0-21swapper/323:00:123
4107683991010,0cyclictest0-21swapper/322:45:293
4107683991010,0cyclictest0-21swapper/321:15:113
4107683991010,0cyclictest0-21swapper/319:20:143
410768399100,9cyclictest0-21swapper/321:50:173
410768399100,10cyclictest0-21swapper/319:15:023
410768399100,0cyclictest0-21swapper/323:40:213
410768399100,0cyclictest0-21swapper/321:05:003
41076839999,0cyclictest0-21swapper/322:30:143
41076839999,0cyclictest0-21swapper/322:01:213
41076839999,0cyclictest0-21swapper/321:30:133
41076839999,0cyclictest0-21swapper/320:50:013
41076839999,0cyclictest0-21swapper/319:25:113
41076839999,0cyclictest0-21swapper/300:20:133
41076839998,0cyclictest0-21swapper/322:55:173
41076839997,1cyclictest0-21swapper/321:40:123
41076839990,0cyclictest0-21swapper/300:00:193
41076839988,0cyclictest0-21swapper/320:40:133
41076839988,0cyclictest0-21swapper/320:20:123
41076839988,0cyclictest0-21swapper/320:05:143
41076839988,0cyclictest0-21swapper/319:30:233
41076839987,0cyclictest0-21swapper/300:10:083
41076839977,0cyclictest0-21swapper/323:30:083
41076839977,0cyclictest0-21swapper/322:50:143
41076839977,0cyclictest0-21swapper/319:45:153
41076839977,0cyclictest0-21swapper/300:15:133
41076839977,0cyclictest0-21swapper/300:05:023
41076839976,0cyclictest0-21swapper/320:00:123
4105878271,4sleep30-21swapper/319:05:113
13989870,5rtkit-daemon4092567-21munin-node19:06:371
41076839966,0cyclictest0-21swapper/323:50:103
41076839966,0cyclictest0-21swapper/323:45:153
41076839966,0cyclictest0-21swapper/322:40:003
41076839966,0cyclictest0-21swapper/320:15:123
41076839966,0cyclictest0-21swapper/319:55:133
41076839966,0cyclictest0-21swapper/319:50:133
41076839966,0cyclictest0-21swapper/300:35:153
41076839965,0cyclictest0-21swapper/320:50:143
41076839955,0cyclictest0-21swapper/321:35:173
41076839955,0cyclictest0-21swapper/319:35:163
41076839955,0cyclictest0-21swapper/319:15:183
41076839954,0cyclictest0-21swapper/323:38:003
41076839954,0cyclictest0-21swapper/323:06:003
41076839951,2cyclictest0-21swapper/321:00:123
41076839950,3cyclictest0-21swapper/320:34:043
13989850,0rtkit-daemon0-21swapper/122:38:171
13989850,0rtkit-daemon0-21swapper/119:36:201
5606240,2sleep05636-21apt-get23:15:130
4135681240,3sleep04135752-21/usr/sbin/munin20:20:140
41076839944,0cyclictest0-21swapper/322:25:433
41076839944,0cyclictest0-21swapper/322:20:133
41076839944,0cyclictest0-21swapper/321:45:593
41076839944,0cyclictest0-21swapper/320:56:363
41076839941,1cyclictest0-21swapper/323:20:133
41076839940,3cyclictest7120-21chrt23:17:063
41076839940,3cyclictest4174896-21chrt22:05:223
41076839940,3cyclictest31802-21chrt00:27:103
4107215242,1sleep20-21swapper/219:06:062
13989840,2rtkit-daemon614-21wpa_supplicant21:49:131
13989840,2rtkit-daemon4174639-21munin-run22:05:001
13989840,2rtkit-daemon1318-21cron20:40:011
13989840,2rtkit-daemon1-21systemd23:40:331
13989840,2rtkit-daemon1-21systemd21:54:511
13989840,1rtkit-daemon4175438-21apt-get22:10:011
4183920230,0sleep1341rcuc/122:30:141
4159078230,0sleep10-21swapper/121:20:131
4152437232,1sleep04125605-21kworker/0:2+events21:01:560
41076839933,0cyclictest0-21swapper/321:25:083
4105978231,1sleep00-21swapper/019:05:120
18377230,2sleep118485-21cut23:50:111
13989830,2rtkit-daemon762-21ntpd21:15:191
13989830,2rtkit-daemon762-21ntpd20:00:211
13989830,2rtkit-daemon579-21rpcbind21:08:241
13989830,2rtkit-daemon579-21rpcbind19:19:501
13989830,2rtkit-daemon4154597-21diskmemload00:25:461
13989830,2rtkit-daemon4109692-21munin-node21:10:021
13989830,2rtkit-daemon1399-21sendmail-mta20:23:521
13989830,2rtkit-daemon1-21systemd23:29:131
13989830,1rtkit-daemon762-21ntpd22:28:081
13989830,1rtkit-daemon760-21snmpd20:48:391
13989830,1rtkit-daemon760-21snmpd20:34:201
13989830,1rtkit-daemon614-21wpa_supplicant19:30:461
13989830,1rtkit-daemon609-21rsyslogd22:50:181
13989830,1rtkit-daemon600-21avahi-daemon20:50:071
13989830,1rtkit-daemon4109692-21munin-node23:49:121
13989830,1rtkit-daemon4109692-21munin-node23:14:111
13989830,1rtkit-daemon4109692-21munin-node21:34:491
13989830,1rtkit-daemon4109692-21munin-node00:09:361
13989830,1rtkit-daemon331-21plymouthd22:09:481
13989830,1rtkit-daemon331-21plymouthd21:25:231
13989830,1rtkit-daemon331-21plymouthd20:13:221
13989830,1rtkit-daemon331-21plymouthd19:10:161
13989830,1rtkit-daemon331-21plymouthd00:01:171
13989830,1rtkit-daemon14415-21ssh23:36:431
13989830,1rtkit-daemon1-21systemd23:30:051
13989830,1rtkit-daemon1-21systemd23:20:341
13989830,1rtkit-daemon1-21systemd23:08:581
13989830,1rtkit-daemon1-21systemd23:03:281
13989830,1rtkit-daemon1-21systemd22:49:491
13989830,1rtkit-daemon1-21systemd21:40:261
13989830,1rtkit-daemon1-21systemd00:30:491
13989830,1rtkit-daemon1-21systemd00:20:291
13989830,1rtkit-daemon1-21systemd00:10:141
13989830,0rtkit-daemon0-21swapper/119:25:251
7367220,1sleep20-21swapper/223:19:192
4185622220,0sleep04185823-21strings22:35:180
4178016220,0sleep00-21swapper/022:15:080
4168347220,1sleep24168438-21sed21:50:002
4161702220,1sleep04161791-21tail21:30:100
4156944220,1sleep04157175-21cut21:15:130
4145692220,1sleep04145776-21irqstats20:45:150
4142234220,1sleep04142383-21python320:35:190
4138104220,1sleep14138306-21ntpq20:25:141
4132913220,1sleep04133130-21users20:10:240
4114059220,1sleep00-21swapper/019:25:100
31693221,1sleep2417-21systemd-journal00:26:142
13989820,1rtkit-daemon762-21ntpd19:50:141
13989820,1rtkit-daemon762-21ntpd19:45:461
13989820,1rtkit-daemon760-21snmpd22:55:111
13989820,1rtkit-daemon760-21snmpd00:35:041
13989820,1rtkit-daemon6926-21packagekitd21:00:061
13989820,1rtkit-daemon331-21plymouthd19:55:181
13989820,1rtkit-daemon1-21systemd23:55:471
13989820,1rtkit-daemon1-21systemd22:15:151
13989820,1rtkit-daemon1-21systemd20:55:111
13989820,1rtkit-daemon1-21systemd20:15:291
13989820,1rtkit-daemon1-21systemd00:15:031
13989820,0rtkit-daemon331-21plymouthd22:20:071
13989820,0rtkit-daemon331-21plymouthd21:35:261
13989820,0rtkit-daemon331-21plymouthd19:20:211
13989820,0rtkit-daemon0-21swapper/123:15:261
13989820,0rtkit-daemon0-21swapper/122:41:051
13989820,0rtkit-daemon0-21swapper/121:55:181
13989820,0rtkit-daemon0-21swapper/120:40:181
13989820,0rtkit-daemon0-21swapper/120:05:171
13989820,0rtkit-daemon0-21swapper/119:40:061
13924220,1sleep214174-21grep23:35:192
9504210,0sleep20-21swapper/223:24:342
9171210,0sleep00-21swapper/023:21:360
4945210,1sleep20-21swapper/223:13:432
4192916210,0sleep20-21swapper/222:55:162
4192622210,0sleep00-21swapper/022:55:140
4191911210,1sleep00-21swapper/022:54:510
4190120210,0sleep20-21swapper/222:50:082
4189558210,1sleep00-21swapper/022:47:260
4188795210,1sleep00-21swapper/022:42:460
4185277210,0sleep20-21swapper/222:35:162
4184715210,0sleep20-21swapper/222:33:482
4182769210,1sleep00-21swapper/022:30:010
4182561210,0sleep20-21swapper/222:28:112
4182504210,0sleep00-21swapper/022:27:410
4180261210,1sleep00-21swapper/022:20:130
4180133210,0sleep20-21swapper/222:20:112
4178651210,0sleep20-21swapper/222:15:182
4175933210,0sleep00-21swapper/022:10:090
4175908210,0sleep20-21swapper/222:10:022
4175209210,1sleep00-21swapper/022:08:070
4175092210,0sleep20-21swapper/222:07:062
4174100210,0sleep20-21swapper/222:00:212
4173218210,0sleep00-21swapper/022:00:150
4171464210,0sleep20-21swapper/221:55:182
4170682210,0sleep00-21swapper/021:55:120
4170104210,1sleep00-21swapper/021:52:060
4170027210,0sleep20-21swapper/221:51:252
4167970210,1sleep00-21swapper/021:46:380
4167463210,1sleep00-21swapper/021:44:150
4166920210,0sleep20-21swapper/221:40:212
4164408210,1sleep00-21swapper/021:35:170
4164093210,0sleep20-21swapper/221:35:152
4163141210,0sleep20-21swapper/221:32:352
4159805210,0sleep20-21swapper/221:20:182
4158968210,0sleep00-21swapper/021:20:120
4155749210,0sleep20-21swapper/221:10:232
4154833210,1sleep00-21swapper/021:10:080
4154529210,0sleep00-21swapper/021:09:160
4149702210,0sleep00-21swapper/020:55:190
4148860210,0sleep20-21swapper/220:55:022
4147410210,0sleep20-21swapper/220:50:172
4147175210,0sleep00-21swapper/020:50:150
4145978210,0sleep20-21swapper/220:45:172
4143412210,0sleep00-21swapper/020:40:140
4143079210,0sleep20-21swapper/220:40:002
4139538210,0sleep20-21swapper/220:30:202
4138308210,0sleep20-21swapper/220:25:152
4138020210,0sleep00-21swapper/020:25:130
4137282210,0sleep20-21swapper/220:24:162
4135175210,0sleep00-21swapper/020:17:010
4134188210,0sleep20-21swapper/220:15:152
4130962210,0sleep00-21swapper/020:05:210
4130685210,0sleep20-21swapper/220:05:192
4128187210,0sleep00-21swapper/020:00:160
4127810210,0sleep20-21swapper/220:00:142
4125984210,0sleep00-21swapper/019:55:160
4125818210,0sleep20-21swapper/219:55:132
4124772210,0sleep00-21swapper/019:50:190
4124488210,0sleep20-21swapper/219:50:182
4120663210,0sleep20-21swapper/219:40:172
4120347210,0sleep00-21swapper/019:40:150
4119749210,0sleep00-21swapper/019:39:100
4118415210,0sleep20-21swapper/219:35:172
4117339210,1sleep00-21swapper/019:31:100
4115964210,1sleep20-21swapper/219:30:042
4114844210,0sleep20-21swapper/219:25:162
4113196210,0sleep20-21swapper/219:20:192
4112920210,0sleep00-21swapper/019:20:170
4110368210,0sleep20-21swapper/219:15:152
4109503210,0sleep00-21swapper/019:15:020
4108584210,0sleep00-21swapper/019:10:170
3699210,0sleep00-21swapper/023:10:110
34730210,0sleep00-21swapper/000:35:180
34445210,0sleep20-21swapper/200:35:082
33213210,0sleep20-21swapper/200:30:152
32118210,0sleep00-21swapper/000:30:010
31952210,0sleep00-21swapper/000:28:330
31033210,0sleep20-21swapper/200:22:272
28316210,0sleep00-21swapper/000:15:200
2614210,0sleep00-21swapper/023:06:310
26018210,0sleep20-21swapper/200:10:132
25282210,1sleep00-21swapper/000:10:080
2496210,0sleep20-21swapper/223:05:292
24728210,0sleep00-21swapper/000:07:150
24242210,0sleep20-21swapper/200:05:022
22412210,0sleep20-21swapper/200:00:132
21596210,0sleep00-21swapper/023:57:390
21422210,1sleep20-21swapper/223:56:092
19274210,0sleep00-21swapper/023:50:340
17934210,0sleep20-21swapper/223:50:082
16895210,0sleep00-21swapper/023:45:030
15885210,0sleep00-21swapper/023:40:180
15592210,0sleep20-21swapper/223:40:162
13675210,0sleep00-21swapper/023:35:170
1353210,0sleep00-21swapper/023:00:200
11652210,0sleep20-21swapper/223:30:152
10862210,0sleep00-21swapper/023:30:100
10171210,0sleep20-21swapper/223:26:072
10079210,0sleep00-21swapper/023:25:160
4194277200,0sleep20-21swapper/223:00:062
4189285200,0sleep20-21swapper/222:45:052
4187202200,0sleep20-21swapper/222:40:042
4160886200,0sleep20-21swapper/221:25:042
4160653200,0sleep00-21swapper/021:25:020
4156834200,0sleep20-21swapper/221:15:022
4152910200,0sleep20-21swapper/221:05:022
4151000200,0sleep20-21swapper/221:00:022
4141404200,0sleep20-21swapper/220:35:042
4139490200,0sleep00-21swapper/020:30:010
4131821200,0sleep20-21swapper/220:10:022
4121984200,0sleep20-21swapper/219:45:052
4121982200,0sleep00-21swapper/019:45:030
4107827200,0sleep20-21swapper/219:10:032
29475200,0sleep00-21swapper/000:20:050
27358200,0sleep20-21swapper/200:15:022
22394200,0sleep00-21swapper/000:00:030
17129200,0sleep20-21swapper/223:45:042
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional