You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-04-03 - 11:27
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot3.osadl.org (updated Thu Apr 03, 2025 00:43:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
232453899130,12cyclictest0-21swapper/320:15:123
232453899130,11cyclictest0-21swapper/319:40:133
2324538991211,0cyclictest0-21swapper/320:00:113
232453899120,11cyclictest0-21swapper/320:05:143
232453899120,11cyclictest0-21swapper/319:45:123
232453899120,10cyclictest0-21swapper/322:00:163
232453899110,10cyclictest0-21swapper/323:00:213
232453899110,10cyclictest0-21swapper/321:50:143
232453899110,10cyclictest0-21swapper/321:40:213
232453899110,0cyclictest0-21swapper/300:30:093
232453899109,0cyclictest0-21swapper/300:10:023
2324538991010,0cyclictest0-21swapper/322:50:133
2324538991010,0cyclictest0-21swapper/322:30:143
2324538991010,0cyclictest0-21swapper/322:10:123
2324538991010,0cyclictest0-21swapper/321:30:123
2324538991010,0cyclictest0-21swapper/319:50:203
2324538991010,0cyclictest0-21swapper/319:35:183
2324538991010,0cyclictest0-21swapper/300:15:203
2324538991010,0cyclictest0-21swapper/300:00:153
2324538991010,0cyclictest0-21swapper/300:00:003
232453899100,9cyclictest0-21swapper/321:05:193
232453899100,0cyclictest0-21swapper/321:20:143
232453899100,0cyclictest0-21swapper/320:30:163
23245389999,0cyclictest0-21swapper/323:35:123
23245389999,0cyclictest0-21swapper/321:56:213
23245389999,0cyclictest0-21swapper/320:25:193
23245389998,0cyclictest0-21swapper/323:30:143
23245389990,9cyclictest0-21swapper/322:10:013
23245389990,8cyclictest0-21swapper/322:35:123
2323204291,5sleep30-21swapper/319:05:213
23245389988,0cyclictest0-21swapper/322:16:273
23245389988,0cyclictest0-21swapper/320:35:143
23245389988,0cyclictest0-21swapper/319:20:013
23245389988,0cyclictest0-21swapper/300:10:153
23245389977,0cyclictest0-21swapper/323:50:143
23245389977,0cyclictest0-21swapper/323:40:163
23245389977,0cyclictest0-21swapper/322:55:123
23245389976,0cyclictest0-21swapper/319:20:193
23245389970,0cyclictest0-21swapper/319:13:313
23245389966,0cyclictest0-21swapper/322:40:193
23245389966,0cyclictest0-21swapper/322:20:213
23245389966,0cyclictest0-21swapper/321:49:153
23245389966,0cyclictest0-21swapper/300:24:123
23245389965,0cyclictest0-21swapper/321:10:163
23245389955,0cyclictest0-21swapper/323:26:333
23245389955,0cyclictest0-21swapper/321:36:273
23245389955,0cyclictest0-21swapper/321:00:173
23245389954,0cyclictest0-21swapper/320:53:293
23245389951,2cyclictest0-21swapper/320:55:123
23245389951,2cyclictest0-21swapper/320:40:133
23245389950,5cyclictest0-21swapper/321:29:563
23245389950,4cyclictest2349774-21chrt20:14:573
23245389950,4cyclictest0-21swapper/320:45:143
23245389950,3cyclictest0-21swapper/321:15:123
13989850,2rtkit-daemon417-21systemd-journal19:05:022
23245389944,0cyclictest0-21swapper/323:47:253
23245389944,0cyclictest0-21swapper/323:20:013
23245389944,0cyclictest0-21swapper/323:15:013
23245389944,0cyclictest0-21swapper/323:13:053
23245389944,0cyclictest0-21swapper/323:05:563
23245389944,0cyclictest0-21swapper/322:45:243
23245389944,0cyclictest0-21swapper/300:25:023
23245389943,0cyclictest0-21swapper/322:25:403
23245389943,0cyclictest0-21swapper/300:35:063
23245389941,1cyclictest0-21swapper/319:25:133
23245389940,3cyclictest2334103-21chrt19:30:313
23245389940,3cyclictest0-21swapper/320:20:133
23245389940,2cyclictest0-21swapper/319:55:113
2324045242,1sleep10-21swapper/119:06:121
13989840,2rtkit-daemon765-21lldpd00:37:302
13989840,2rtkit-daemon760-21snmpd22:07:502
13989840,2rtkit-daemon417-21systemd-journal21:09:552
13989840,2rtkit-daemon2397635-21ssh22:20:402
13989840,2rtkit-daemon1-21systemd23:46:102
13989840,2rtkit-daemon1-21systemd21:25:102
13989840,2rtkit-daemon1-21systemd21:15:212
13989840,2rtkit-daemon1-21systemd00:06:362
2399435230,1sleep12399461-21apt-get22:30:081
2397276230,0sleep12397550-21unixbench_singl22:20:241
2376192230,2sleep12376314-21sendmail_mailst21:20:201
2373369230,1sleep12373395-21apt-get21:15:121
2371385230,1sleep12371411-21apt-get21:10:151
2355888230,2sleep12356156-21expr20:30:161
2322493231,1sleep00-21swapper/019:05:030
13989830,2rtkit-daemon765-21lldpd22:43:232
13989830,2rtkit-daemon760-21snmpd22:51:002
13989830,2rtkit-daemon760-21snmpd22:11:592
13989830,2rtkit-daemon760-21snmpd20:38:352
13989830,2rtkit-daemon760-21snmpd00:32:202
13989830,2rtkit-daemon614-21wpa_supplicant21:51:312
13989830,2rtkit-daemon417-21systemd-journal21:56:512
13989830,2rtkit-daemon2401135-21ssh22:33:452
13989830,2rtkit-daemon1399-21sendmail-mta20:26:432
13989830,2rtkit-daemon1399-21sendmail-mta00:29:342
13989830,2rtkit-daemon1-21systemd23:26:222
13989830,2rtkit-daemon1-21systemd22:36:162
13989830,2rtkit-daemon1-21systemd21:22:282
13989830,2rtkit-daemon1-21systemd20:42:242
13989830,1rtkit-daemon762-21ntpd21:35:412
13989830,1rtkit-daemon762-21ntpd19:30:242
13989830,1rtkit-daemon762-21ntpd00:18:142
13989830,1rtkit-daemon684-21gmain19:50:362
13989830,1rtkit-daemon614-21wpa_supplicant23:43:172
13989830,1rtkit-daemon614-21wpa_supplicant23:20:052
13989830,1rtkit-daemon614-21wpa_supplicant23:12:162
13989830,1rtkit-daemon331-21plymouthd23:55:182
13989830,1rtkit-daemon331-21plymouthd23:16:432
13989830,1rtkit-daemon331-21plymouthd22:19:312
13989830,1rtkit-daemon331-21plymouthd22:04:362
13989830,1rtkit-daemon331-21plymouthd19:55:112
13989830,1rtkit-daemon2339935-21taskset19:46:312
13989830,1rtkit-daemon2326565-21munin-node20:31:332
13989830,1rtkit-daemon1399-21sendmail-mta23:03:102
13989830,1rtkit-daemon1-21systemd22:25:022
13989830,1rtkit-daemon1-21systemd21:12:112
13989830,1rtkit-daemon1-21systemd00:38:501
13989830,0rtkit-daemon331-21plymouthd19:23:202
2441147220,0sleep00-21swapper/000:22:550
2438521220,1sleep00-21swapper/000:15:220
2432477220,1sleep12432503-21apt-get00:00:141
2431938220,1sleep02431945-21latency_hist00:00:020
2424587220,1sleep12424601-21apt23:40:001
2424427220,1sleep00-21swapper/023:38:350
2420898220,1sleep02421096-21df_inode23:30:160
2418717220,1sleep12418907-21timerwakeupswit23:20:191
2417448220,0sleep00-21swapper/023:19:310
2409639220,1sleep22409890-21/usr/sbin/munin22:55:192
2378110220,0sleep00-21swapper/021:30:120
2334792220,1sleep22334978-21cat19:35:142
2333695220,1sleep12333880-21cat19:30:221
13989820,1rtkit-daemon765-21lldpd19:15:172
13989820,1rtkit-daemon762-21ntpd20:50:122
13989820,1rtkit-daemon762-21ntpd20:11:082
13989820,1rtkit-daemon417-21systemd-journal21:45:362
13989820,1rtkit-daemon417-21systemd-journal20:45:252
13989820,1rtkit-daemon1-21systemd21:00:032
13989820,1rtkit-daemon1-21systemd20:16:522
13989820,1rtkit-daemon1-21systemd19:11:132
13989820,0rtkit-daemon331-21plymouthd23:30:382
13989820,0rtkit-daemon0-21swapper/223:50:112
13989820,0rtkit-daemon0-21swapper/223:35:422
13989820,0rtkit-daemon0-21swapper/223:05:042
13989820,0rtkit-daemon0-21swapper/222:45:462
13989820,0rtkit-daemon0-21swapper/221:40:032
13989820,0rtkit-daemon0-21swapper/221:30:202
13989820,0rtkit-daemon0-21swapper/220:55:232
13989820,0rtkit-daemon0-21swapper/220:20:162
13989820,0rtkit-daemon0-21swapper/220:05:012
13989820,0rtkit-daemon0-21swapper/220:00:032
13989820,0rtkit-daemon0-21swapper/219:40:262
13989820,0rtkit-daemon0-21swapper/219:25:352
13989820,0rtkit-daemon0-21swapper/200:20:222
13989820,0rtkit-daemon0-21swapper/200:10:152
13989820,0rtkit-daemon0-21swapper/200:02:092
2444550210,0sleep00-21swapper/000:35:160
2443291210,0sleep00-21swapper/000:30:150
2442423210,0sleep10-21swapper/100:30:081
2441857210,0sleep00-21swapper/000:27:110
2441680210,0sleep10-21swapper/100:25:361
2440983210,0sleep10-21swapper/100:21:281
2439174210,0sleep10-21swapper/100:19:071
2436766210,0sleep10-21swapper/100:11:191
2435377210,0sleep00-21swapper/000:10:100
2434999210,0sleep10-21swapper/100:09:071
2434656210,0sleep00-21swapper/000:06:050
2432747210,0sleep00-21swapper/000:00:170
2430094210,0sleep10-21swapper/123:55:141
2428292210,0sleep00-21swapper/023:50:120
2427496210,0sleep10-21swapper/123:50:011
2427130210,0sleep10-21swapper/123:46:501
2426934210,1sleep00-21swapper/023:45:050
2425313210,0sleep10-21swapper/123:40:171
2425134210,0sleep00-21swapper/023:40:160
2420667210,0sleep12420693-21apt-get23:30:131
2420232210,1sleep02420234-21ssh23:28:270
2419409210,0sleep00-21swapper/023:23:140
2415693210,0sleep10-21swapper/123:15:121
2413734210,0sleep00-21swapper/023:10:100
2413569210,0sleep10-21swapper/123:10:031
2412538210,0sleep00-21swapper/023:05:020
2411140210,0sleep10-21swapper/123:00:191
2410867210,0sleep00-21swapper/023:00:180
2409935210,0sleep10-21swapper/122:55:381
2407295210,0sleep10-21swapper/122:50:141
2406063210,0sleep00-21swapper/022:48:160
2405147210,0sleep10-21swapper/122:42:131
2404460210,0sleep00-21swapper/022:40:200
2401554210,0sleep10-21swapper/122:35:131
2401525210,0sleep02401551-21apt-get22:35:120
2399671210,0sleep00-21swapper/022:30:110
2398702210,0sleep10-21swapper/122:28:051
2398622210,0sleep00-21swapper/022:27:240
2396587210,0sleep00-21swapper/022:20:190
2395968210,0sleep10-21swapper/122:19:351
2394215210,0sleep00-21swapper/022:15:140
2392275210,0sleep00-21swapper/022:10:110
2391286210,0sleep10-21swapper/122:05:071
2389314210,0sleep10-21swapper/122:00:181
2389224210,0sleep00-21swapper/022:00:180
2387528210,0sleep10-21swapper/121:55:151
2387260210,0sleep00-21swapper/021:55:140
2385696210,0sleep00-21swapper/021:50:120
2384689210,0sleep10-21swapper/121:49:221
2383969210,0sleep00-21swapper/021:45:010
2383845210,0sleep00-21swapper/021:43:560
2381907210,0sleep10-21swapper/121:40:021
2381541210,0sleep00-21swapper/021:36:520
2378729210,0sleep10-21swapper/121:30:171
2377703210,0sleep10-21swapper/121:28:201
2377512210,0sleep00-21swapper/021:26:270
2376710210,0sleep00-21swapper/021:20:240
2374168210,0sleep00-21swapper/021:15:190
2371370210,1sleep00-21swapper/021:10:060
2369613210,0sleep10-21swapper/121:05:161
2369549210,0sleep00-21swapper/021:05:150
2368860210,0sleep10-21swapper/121:00:311
2365801210,0sleep10-21swapper/120:55:141
2365370210,0sleep00-21swapper/020:55:010
2364563210,0sleep10-21swapper/120:50:231
2364455210,0sleep00-21swapper/020:50:220
2362759210,0sleep00-21swapper/020:45:200
2361797210,0sleep10-21swapper/120:45:141
2359889210,0sleep10-21swapper/120:40:131
2357719210,0sleep10-21swapper/120:35:141
2357690210,0sleep00-21swapper/020:35:130
2356762210,0sleep00-21swapper/020:30:230
2353869210,0sleep10-21swapper/120:25:131
2352928210,0sleep00-21swapper/020:20:200
2352476210,0sleep10-21swapper/120:20:171
2351482210,0sleep00-21swapper/020:17:190
2350959210,0sleep10-21swapper/120:15:201
2348119210,0sleep00-21swapper/020:10:150
2346233210,0sleep00-21swapper/020:05:140
2344714210,0sleep00-21swapper/020:00:150
2344293210,0sleep10-21swapper/120:00:111
2343337210,0sleep00-21swapper/019:55:180
2342970210,0sleep10-21swapper/119:55:151
2340901210,0sleep10-21swapper/119:50:181
2340742210,0sleep00-21swapper/019:50:170
2340164210,0sleep10-21swapper/119:49:311
2338295210,0sleep00-21swapper/019:45:020
2336767210,0sleep10-21swapper/119:40:141
2336364210,0sleep00-21swapper/019:40:010
2335672210,1sleep02335966-21head19:35:200
2334489210,0sleep10-21swapper/119:35:011
2333566210,0sleep00-21swapper/019:30:210
2332271210,1sleep00-21swapper/019:26:320
2329519210,0sleep10-21swapper/119:20:161
2329410210,0sleep00-21swapper/019:20:160
2327037210,1sleep00-21swapper/019:15:160
2325482210,0sleep00-21swapper/019:10:190
2325102210,0sleep10-21swapper/119:10:161
2419848200,0sleep10-21swapper/123:25:041
2412771200,0sleep10-21swapper/123:05:021
2408345200,0sleep00-21swapper/022:55:010
2406500200,0sleep00-21swapper/022:50:050
2405466200,0sleep10-21swapper/122:45:021
2392079200,0sleep10-21swapper/122:10:041
2391280200,0sleep00-21swapper/022:05:010
2385001200,0sleep10-21swapper/121:50:011
2379843200,0sleep10-21swapper/121:35:001
2367535200,0sleep00-21swapper/021:00:020
2359878200,0sleep00-21swapper/020:40:050
2353858200,0sleep00-21swapper/020:25:040
2348105200,0sleep10-21swapper/120:10:041
2346191200,0sleep10-21swapper/120:05:041
2330630200,0sleep10-21swapper/119:25:001
2327023200,0sleep10-21swapper/119:15:051
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional