You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-04-02 - 04:00
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5.osadl.org (updated Wed Apr 02, 2025 00:44:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
374799320,30cyclictest303-21systemd-journal19:20:020
374799300,29cyclictest27073-21sendmail-msp20:00:020
3760992927,1cyclictest10840-21sendmail-msp00:40:013
376099290,28cyclictest0-21swapper/321:20:123
376099290,28cyclictest0-21swapper/320:10:123
376099290,1cyclictest0-21swapper/321:00:133
3751992927,1cyclictest10842-21idleruntime-cro00:40:011
375199290,28cyclictest15412-21munin-run19:35:001
375199290,28cyclictest0-21swapper/121:00:121
375199290,28cyclictest0-21swapper/120:00:151
374799290,28cyclictest0-21swapper/023:35:150
376099280,28cyclictest15401-21perf19:35:013
376099280,0cyclictest0-21swapper/320:00:143
3756992827,1cyclictest14867-21cron20:50:012
375199280,27cyclictest0-21swapper/120:10:111
375199280,27cyclictest0-21swapper/100:30:131
3747992828,0cyclictest2589-21cron20:20:000
374799280,27cyclictest0-21swapper/020:20:130
374799280,0cyclictest0-21swapper/022:50:090
3760992727,0cyclictest2880-21apt-get20:20:143
3760992727,0cyclictest0-21swapper/321:15:113
3760992727,0cyclictest0-21swapper/319:15:123
376099270,0cyclictest0-21swapper/320:35:113
376099270,0cyclictest0-21swapper/300:30:143
3756992727,0cyclictest0-21swapper/221:30:132
3756992727,0cyclictest0-21swapper/221:30:132
3756992725,1cyclictest25579-21apt-get22:35:112
3756992725,1cyclictest14991-21cron22:10:002
375699270,0cyclictest0-21swapper/220:55:122
3751992727,0cyclictest0-21swapper/121:55:131
3751992727,0cyclictest0-21swapper/121:25:011
3751992727,0cyclictest0-21swapper/121:15:111
375199270,0cyclictest8171-21apt-get20:35:121
3747992727,0cyclictest32436-21apt-get21:30:120
3747992727,0cyclictest32436-21apt-get21:30:120
3747992727,0cyclictest0-21swapper/023:20:020
3747992727,0cyclictest0-21swapper/021:50:000
3747992727,0cyclictest0-21swapper/019:25:120
3760992626,0cyclictest0-21swapper/323:55:133
3760992626,0cyclictest0-21swapper/322:10:073
3760992626,0cyclictest0-21swapper/321:55:133
3760992626,0cyclictest0-21swapper/320:35:003
3760992624,1cyclictest15156-21apt-get20:50:193
3756992626,0cyclictest0-21swapper/222:00:102
3756992626,0cyclictest0-21swapper/219:35:142
3756992625,1cyclictest24744-21basename19:55:012
3756992625,0cyclictest20242-21apt-get22:20:132
3751992626,0cyclictest0-21swapper/120:20:131
3751992626,0cyclictest0-21swapper/119:15:121
3747992626,0cyclictest0-21swapper/019:30:150
3747992626,0cyclictest0-21swapper/019:14:540
3747992626,0cyclictest0-21swapper/019:14:530
3747992626,0cyclictest0-21swapper/000:30:140
3760992525,0cyclictest0-21swapper/323:50:083
3760992525,0cyclictest0-21swapper/321:35:133
3760992525,0cyclictest0-21swapper/319:50:183
3760992524,0cyclictest0-21swapper/323:15:033
3760992524,0cyclictest0-21swapper/319:14:543
3760992524,0cyclictest0-21swapper/319:14:533
3756992525,0cyclictest0-21swapper/200:20:132
3756992525,0cyclictest0-21swapper/200:00:042
3751992525,0cyclictest7913-21perf20:35:001
3751992525,0cyclictest0-21swapper/123:55:141
3751992525,0cyclictest0-21swapper/122:10:081
3751992524,1cyclictest0-21swapper/123:50:091
3747992525,0cyclictest27368-21apt-get20:00:140
3747992525,0cyclictest0-21swapper/021:00:120
3747992525,0cyclictest0-21swapper/020:35:120
3747992525,0cyclictest0-21swapper/020:10:100
3747992523,1cyclictest31541-21munin-run21:25:010
3760992424,0cyclictest0-21swapper/320:40:123
3756992424,0cyclictest0-21swapper/222:10:082
3756992424,0cyclictest0-21swapper/221:50:072
3756992424,0cyclictest0-21swapper/219:45:122
3756992422,1cyclictest852-21apt-get00:15:152
3751992424,0cyclictest8742-21apt-get23:15:021
3751992424,0cyclictest2344-21apt-get21:35:121
3751992424,0cyclictest22657-21apt-get19:50:181
3751992423,1cyclictest6021-21apt-get19:14:531
3751992423,1cyclictest6021-21apt-get19:14:531
3760992323,0cyclictest0-21swapper/323:35:143
3760992323,0cyclictest0-21swapper/322:55:123
3760992323,0cyclictest0-21swapper/321:10:003
3756992323,0cyclictest0-21swapper/220:30:072
3756992323,0cyclictest0-21swapper/220:15:012
3756992322,1cyclictest609-21dbus-daemon23:30:002
3751992323,0cyclictest0-21swapper/120:50:191
3751992323,0cyclictest0-21swapper/120:40:131
3747992322,1cyclictest27132-21apt-get21:15:120
3760992222,0cyclictest0-21swapper/320:45:123
3751992222,0cyclictest0-21swapper/123:35:141
3751992222,0cyclictest0-21swapper/122:55:131
3751992222,0cyclictest0-21swapper/121:09:591
3747992222,0cyclictest9975-21apt-get21:55:140
3747992220,1cyclictest7915-21munin-run20:35:010
3747992220,1cyclictest22850-21apt-get23:50:090
3756992121,0cyclictest0-21swapper/220:40:122
3756992120,0cyclictest4692-21apt-get21:40:122
3756992119,1cyclictest0-21swapper/200:00:022
3751992121,0cyclictest17475-21apt-get20:55:111
3751992121,0cyclictest0-21swapper/120:45:131
3747992120,0cyclictest0-21swapper/023:55:130
3760992020,0cyclictest8710-21apt-get19:20:133
3760992020,0cyclictest0-21swapper/319:55:203
3747992020,0cyclictest15268-21apt-get22:10:080
3747992019,0cyclictest0-21swapper/020:50:180
3747992018,1cyclictest24554-21munin-run21:10:000
3756991919,0cyclictest0-21swapper/222:40:012
3751991919,0cyclictest0-21swapper/119:55:211
3751991919,0cyclictest0-21swapper/119:20:141
3751991918,0cyclictest18014-21apt-get19:40:131
3747991919,0cyclictest0-21swapper/023:15:020
3747991919,0cyclictest0-21swapper/021:35:120
3747991919,0cyclictest0-21swapper/019:50:190
3747991918,1cyclictest10513-21apt-get20:40:130
3747991917,1cyclictest1384-21apt-get22:55:130
3760991818,0cyclictest0-21swapper/323:00:123
3760991818,0cyclictest0-21swapper/319:40:143
3760991816,1cyclictest9683-21cron21:55:013
3760991717,0cyclictest0-21swapper/321:10:153
3756991717,0cyclictest0-21swapper/223:30:082
3751991717,0cyclictest0-21swapper/123:00:131
3751991717,0cyclictest0-21swapper/121:10:141
3751991715,1cyclictest9678-21cron21:55:001
375199170,16cyclictest21824-21sed22:20:211
3747991717,0cyclictest0-21swapper/020:55:110
3747991717,0cyclictest0-21swapper/020:45:120
3760991616,0cyclictest0-21swapper/300:00:133
376099160,15cyclictest7380-21perf21:50:013
3756991616,0cyclictest0-21swapper/223:45:002
3756991614,1cyclictest19331-21munin-run23:40:002
375699160,15cyclictest3689-21cat21:35:212
3751991614,1cyclictest0-21swapper/122:10:011
374799160,15cyclictest29354-21awk22:40:200
374799160,15cyclictest0-21swapper/023:40:170
3760991513,1cyclictest3726-21tune2fs00:20:153
3760991513,1cyclictest17594-21apt-get22:15:113
3760991513,1cyclictest17594-21apt-get22:15:113
3760991513,1cyclictest0-21swapper/320:29:593
3760991513,1cyclictest0-21swapper/320:15:173
376099150,1cyclictest6856-21cut21:45:013
376099150,14cyclictest30287-21munin-run22:45:013
376099150,14cyclictest0-21swapper/322:30:143
375699151,5cyclictest0-21swapper/221:20:122
3756991515,0cyclictest22273-21apt-get23:50:002
3756991515,0cyclictest0-21swapper/222:15:122
3756991515,0cyclictest0-21swapper/222:15:122
3756991513,1cyclictest32144-21cron21:30:002
375699150,1cyclictest31806-21sed22:50:102
375699150,1cyclictest10601-21gltestperf21:55:162
3751991515,0cyclictest0-21swapper/100:00:141
3751991514,1cyclictest211rcuc/123:50:011
374799150,14cyclictest0-21swapper/019:40:140
374799150,14cyclictest0-21swapper/000:00:140
3760991414,0cyclictest0-21swapper/322:45:213
3760991414,0cyclictest0-21swapper/300:26:023
3760991414,0cyclictest0-21swapper/300:15:233
376099140,14cyclictest0-21swapper/323:47:403
376099140,14cyclictest0-21swapper/323:40:273
376099140,14cyclictest0-21swapper/323:25:573
376099140,14cyclictest0-21swapper/323:20:053
376099140,14cyclictest0-21swapper/323:10:093
376099140,14cyclictest0-21swapper/323:05:223
376099140,14cyclictest0-21swapper/322:51:163
376099140,14cyclictest0-21swapper/322:35:123
376099140,14cyclictest0-21swapper/322:26:313
376099140,14cyclictest0-21swapper/322:05:423
376099140,14cyclictest0-21swapper/322:02:493
376099140,14cyclictest0-21swapper/321:29:393
376099140,14cyclictest0-21swapper/320:05:333
376099140,14cyclictest0-21swapper/319:35:433
376099140,14cyclictest0-21swapper/300:10:103
376099140,14cyclictest0-21swapper/300:07:403
376099140,0cyclictest15917-21strings23:30:133
376099140,0cyclictest0-21swapper/322:21:173
376099140,0cyclictest0-21swapper/321:30:053
376099140,0cyclictest0-21swapper/321:30:043
376099140,0cyclictest0-21swapper/319:45:373
3756991414,0cyclictest0-21swapper/223:15:142
3756991414,0cyclictest0-21swapper/223:00:202
3756991413,1cyclictest0-21swapper/200:06:042
3756991412,1cyclictest0-21swapper/200:35:182
375699140,14cyclictest0-21swapper/223:53:562
375699140,14cyclictest0-21swapper/223:20:362
375699140,14cyclictest0-21swapper/223:05:432
375699140,14cyclictest0-21swapper/222:55:142
375699140,14cyclictest0-21swapper/222:47:112
375699140,14cyclictest0-21swapper/222:31:002
375699140,14cyclictest0-21swapper/222:25:122
375699140,14cyclictest0-21swapper/221:46:482
375699140,14cyclictest0-21swapper/220:51:192
375699140,14cyclictest0-21swapper/220:29:262
375699140,14cyclictest0-21swapper/220:20:122
375699140,14cyclictest0-21swapper/220:18:452
375699140,14cyclictest0-21swapper/220:06:582
375699140,14cyclictest0-21swapper/220:01:272
375699140,14cyclictest0-21swapper/219:55:282
375699140,14cyclictest0-21swapper/219:41:282
375699140,14cyclictest0-21swapper/219:31:272
375699140,14cyclictest0-21swapper/219:25:422
375699140,14cyclictest0-21swapper/219:20:012
375699140,14cyclictest0-21swapper/219:11:272
375699140,14cyclictest0-21swapper/219:11:272
375699140,14cyclictest0-21swapper/200:11:062
375699140,0cyclictest0-21swapper/221:12:212
375699140,0cyclictest0-21swapper/221:00:062
375699140,0cyclictest0-21swapper/220:39:322
375699140,0cyclictest0-21swapper/219:15:012
3751991414,0cyclictest25074-21kworker/1:223:10:091
3751991414,0cyclictest0-21swapper/121:46:241
3751991414,0cyclictest0-21swapper/121:40:191
3751991414,0cyclictest0-21swapper/120:26:321
3751991414,0cyclictest0-21swapper/100:10:051
375199140,14cyclictest0-21swapper/123:20:581
375199140,14cyclictest0-21swapper/123:05:321
375199140,14cyclictest0-21swapper/122:51:351
375199140,14cyclictest0-21swapper/122:35:201
375199140,14cyclictest0-21swapper/122:19:071
375199140,14cyclictest0-21swapper/122:19:071
375199140,14cyclictest0-21swapper/121:30:161
375199140,14cyclictest0-21swapper/121:30:151
375199140,14cyclictest0-21swapper/121:26:531
375199140,14cyclictest0-21swapper/120:05:101
375199140,14cyclictest0-21swapper/100:25:121
375199140,14cyclictest0-21swapper/100:20:091
375199140,14cyclictest0-21swapper/100:15:091
375199140,0cyclictest28850-21gltestperf22:40:151
375199140,0cyclictest0-21swapper/123:40:231
375199140,0cyclictest0-21swapper/123:30:101
375199140,0cyclictest0-21swapper/123:25:481
375199140,0cyclictest0-21swapper/122:33:181
375199140,0cyclictest0-21swapper/122:02:571
375199140,0cyclictest0-21swapper/120:17:181
375199140,0cyclictest0-21swapper/119:45:081
375199140,0cyclictest0-21swapper/119:36:021
375199140,0cyclictest0-21swapper/119:28:311
375199140,0cyclictest0-21swapper/100:05:061
3747991414,0cyclictest0-21swapper/023:10:550
3747991414,0cyclictest0-21swapper/022:27:330
3747991414,0cyclictest0-21swapper/019:20:140
3747991414,0cyclictest0-21swapper/000:21:100
3747991412,1cyclictest5736-21ntp_states21:40:170
3747991412,1cyclictest3734-21apt-get23:00:130
3747991412,1cyclictest21823-21tail22:20:210
3747991412,1cyclictest0-21swapper/023:30:110
374799140,14cyclictest0-21swapper/023:25:070
374799140,14cyclictest0-21swapper/023:05:070
374799140,14cyclictest0-21swapper/022:36:220
374799140,14cyclictest0-21swapper/022:16:340
374799140,14cyclictest0-21swapper/022:16:340
374799140,14cyclictest0-21swapper/022:07:370
374799140,14cyclictest0-21swapper/022:01:120
374799140,14cyclictest0-21swapper/021:50:530
374799140,14cyclictest0-21swapper/021:26:070
374799140,14cyclictest0-21swapper/021:11:390
374799140,14cyclictest0-21swapper/020:25:310
374799140,14cyclictest0-21swapper/020:05:040
374799140,14cyclictest0-21swapper/019:35:310
374799140,14cyclictest0-21swapper/000:25:340
374799140,14cyclictest0-21swapper/000:13:290
374799140,14cyclictest0-21swapper/000:06:120
374799140,0cyclictest0-21swapper/023:46:530
374799140,0cyclictest0-21swapper/022:33:400
374799140,0cyclictest0-21swapper/019:45:340
374799140,0cyclictest0-21swapper/000:17:490
3760991313,0cyclictest0-21swapper/319:25:123
3756991313,0cyclictest0-21swapper/221:06:052
3756991313,0cyclictest0-21swapper/200:25:592
375699130,13cyclictest0-21swapper/200:30:542
3751991313,0cyclictest0-21swapper/122:26:301
3747991313,0cyclictest0-21swapper/022:46:060
3756991212,0cyclictest0-21swapper/221:15:002
3751991212,0cyclictest0-21swapper/122:45:201
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional