You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-11-25 - 10:16
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5.osadl.org (updated Mon Nov 25, 2024 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1612899320,31cyclictest0-21swapper/222:35:002
1612899320,31cyclictest0-21swapper/222:35:002
16130993028,1cyclictest303-21systemd-journal23:15:013
16130992926,2cyclictest303-21systemd-journal20:55:003
16130992926,2cyclictest303-21systemd-journal00:35:013
1613099290,28cyclictest0-21swapper/323:55:123
1613099290,1cyclictest0-21swapper/323:40:013
16128992926,2cyclictest303-21systemd-journal00:05:012
1612899290,28cyclictest31232-21apt-get23:05:112
1612899290,28cyclictest17561-21apt-get20:20:122
1612899290,28cyclictest0-21swapper/223:35:112
1612899290,28cyclictest0-21swapper/222:55:002
16125992926,2cyclictest26634-21cron20:39:591
1612599290,28cyclictest32426-21apt-get22:00:121
1612599290,28cyclictest20415-21apt-get21:35:101
1612599290,28cyclictest13080-21apt-get23:35:121
1612199290,28cyclictest0-21swapper/020:20:020
16130992828,0cyclictest0-21swapper/322:15:123
16130992826,1cyclictest0-21swapper/320:25:013
1613099280,28cyclictest0-21swapper/323:20:113
1613099280,27cyclictest23647-21apt-get22:50:153
16128992827,1cyclictest11654-21cron22:25:012
1612899280,0cyclictest0-21swapper/223:40:112
16125992827,0cyclictest0-21swapper/119:30:141
16125992825,2cyclictest1657-21cron23:45:011
16121992828,0cyclictest0-21swapper/023:15:110
16121992828,0cyclictest0-21swapper/020:00:120
1612199280,0cyclictest0-21swapper/021:35:100
16130992727,0cyclictest0-21swapper/320:05:123
16130992727,0cyclictest0-21swapper/300:25:113
16130992725,1cyclictest30523-21cron00:15:013
1613099270,0cyclictest0-21swapper/323:00:133
16128992727,0cyclictest0-21swapper/221:35:102
16128992725,1cyclictest14009-21munin-run22:30:012
16125992727,0cyclictest18732-21apt-get19:15:131
16125992727,0cyclictest0-21swapper/122:50:151
16125992727,0cyclictest0-21swapper/122:25:111
16125992727,0cyclictest0-21swapper/120:20:121
16125992725,1cyclictest0-21swapper/121:45:011
16121992727,0cyclictest0-21swapper/023:35:130
16121992727,0cyclictest0-21swapper/020:10:030
16121992726,1cyclictest1-21systemd22:55:000
1612199270,0cyclictest0-21swapper/023:40:120
16130992626,0cyclictest0-21swapper/322:40:123
16130992626,0cyclictest0-21swapper/320:40:123
16130992624,1cyclictest15476-21awk21:25:003
16128992626,0cyclictest13438-21apt-get21:20:122
16128992625,1cyclictest21130-21apt-get19:20:122
16125992626,0cyclictest0-21swapper/121:15:101
16125992626,0cyclictest0-21swapper/120:40:111
16130992525,0cyclictest0-21swapper/320:15:133
16130992525,0cyclictest0-21swapper/319:50:023
16130992523,1cyclictest32134-21cron22:00:013
16130992523,1cyclictest27172-21cron21:50:003
16128992525,0cyclictest0-21swapper/221:45:112
16128992524,0cyclictest0-21swapper/219:15:132
16128992522,2cyclictest30651-21cron23:05:012
16121992525,0cyclictest0-21swapper/022:25:120
16121992525,0cyclictest0-21swapper/021:50:160
16121992524,1cyclictest21324-21apt-get22:45:120
16130992424,0cyclictest0-21swapper/320:10:113
16130992424,0cyclictest0-21swapper/300:20:123
16128992424,0cyclictest8129-21apt-get23:25:122
16128992424,0cyclictest0-21swapper/221:40:112
16128992424,0cyclictest0-21swapper/220:35:142
16125992424,0cyclictest28613-21apt-get23:00:121
16125992424,0cyclictest0-21swapper/123:10:151
16125992423,1cyclictest2976-21apt-get19:50:151
16125992423,1cyclictest23173-21awk19:25:011
16121992424,0cyclictest0-21swapper/021:40:100
16121992424,0cyclictest0-21swapper/020:45:110
16130992323,0cyclictest15723-21apt-get23:40:113
16130992323,0cyclictest0-21swapper/320:55:103
16130992322,1cyclictest28097-21apt-get19:35:133
16130992322,1cyclictest2637-21apt-get22:05:133
16130992321,1cyclictest20130-21awk21:35:003
16128992323,0cyclictest0-21swapper/223:50:112
16125992323,0cyclictest7712-21apt-get00:35:141
16125992323,0cyclictest0-21swapper/123:15:101
16125992323,0cyclictest0-21swapper/120:05:121
16125992323,0cyclictest0-21swapper/100:15:111
16121992323,0cyclictest0-21swapper/023:10:160
16121992323,0cyclictest0-21swapper/019:15:130
16121992321,1cyclictest28239-21munin-run00:10:000
16130992222,0cyclictest0-21swapper/322:35:103
16130992222,0cyclictest0-21swapper/300:15:123
16130992220,1cyclictest21998-21munin-run20:30:003
16130992220,1cyclictest13147-21cron21:20:003
16130992219,2cyclictest6995-21cron22:15:003
16125992222,0cyclictest3066-21apt-get00:25:111
16125992221,1cyclictest25134-21apt-get21:45:111
16125992219,2cyclictest12785-21cron23:35:011
16121992222,0cyclictest0-21swapper/023:25:130
16121992220,1cyclictest18409-21cron23:50:010
16130992121,0cyclictest0-21swapper/323:30:163
16130992121,0cyclictest0-21swapper/323:10:013
16130992121,0cyclictest0-21swapper/321:50:153
16130992121,0cyclictest0-21swapper/319:40:143
16128992121,0cyclictest9783-21perf00:40:002
16128992121,0cyclictest0-21swapper/222:45:122
16128992121,0cyclictest0-21swapper/221:00:102
16128992121,0cyclictest0-21swapper/219:55:132
16121992121,0cyclictest0-21swapper/021:20:120
16128992020,0cyclictest31568-21apt-get20:50:102
16128992020,0cyclictest0-21swapper/221:10:132
16125992020,0cyclictest8770-21apt-get21:10:131
16125992020,0cyclictest0-21swapper/122:55:121
16125992020,0cyclictest0-21swapper/122:45:121
16125992020,0cyclictest0-21swapper/122:05:011
16125992019,1cyclictest0-21swapper/122:45:011
16125992018,1cyclictest7379-21munin-run20:00:011
16121992020,0cyclictest0-21swapper/022:00:110
16121992018,1cyclictest2414-21munin-run19:50:010
16130991917,1cyclictest303-21systemd-journal20:50:003
16128991919,0cyclictest7637-21apt-get20:00:112
16128991919,0cyclictest0-21swapper/221:05:122
16125991919,0cyclictest3819-21apt-get21:00:101
16125991919,0cyclictest0-21swapper/119:25:121
16125991918,1cyclictest28208-21awk00:10:011
16121991919,0cyclictest0-21swapper/023:20:110
16130991816,1cyclictest5546-21munin-run23:20:013
16121991818,0cyclictest0-21swapper/023:30:020
16121991817,1cyclictest17561-21apt-get20:20:120
16130991717,0cyclictest0-21swapper/322:55:133
16130991717,0cyclictest0-21swapper/300:00:123
16130991715,1cyclictest21127-21munin-run23:55:003
16128991717,0cyclictest0-21swapper/221:55:022
16128991716,1cyclictest3459-21apt-get23:15:112
16125991717,0cyclictest0-21swapper/123:05:101
16121991717,0cyclictest0-21swapper/000:30:150
1613099160,2cyclictest5440-21sed21:00:193
16128991616,0cyclictest0-21swapper/220:30:122
16128991616,0cyclictest0-21swapper/219:45:132
16125991614,1cyclictest0-21swapper/123:50:161
16121991616,0cyclictest0-21swapper/019:50:020
16121991614,1cyclictest0-21swapper/021:00:160
16121991613,2cyclictest26608-21cron20:40:000
1613099150,15cyclictest17137-21switchtime21:25:203
1612899150,1cyclictest17321-21latency_hist20:20:022
1612899150,1cyclictest13006-21diskstats20:10:132
1612899150,1cyclictest11091-21apt-get21:15:102
1612899150,1cyclictest0-21swapper/222:00:182
1612899150,1cyclictest0-21swapper/200:15:142
1612899150,15cyclictest24838-21grep19:25:202
16125991515,0cyclictest0-21swapper/122:30:161
16125991515,0cyclictest0-21swapper/122:30:161
16125991513,1cyclictest0-21swapper/120:55:171
1612599150,14cyclictest0-21swapper/120:26:091
1612599150,14cyclictest0-21swapper/100:00:171
16121991515,0cyclictest23451-21apt-get19:25:120
16121991513,1cyclictest8512-21irqstats00:35:180
16121991513,1cyclictest31657-21diskstats23:05:130
16121991513,1cyclictest17826-21perf21:30:000
1612199150,1cyclictest32210-21hddtemp_smartct20:50:140
16130991414,0cyclictest0-21swapper/323:48:223
16130991414,0cyclictest0-21swapper/300:37:553
1613099140,14cyclictest0-21swapper/323:28:533
1613099140,14cyclictest0-21swapper/322:30:453
1613099140,14cyclictest0-21swapper/322:30:453
1613099140,14cyclictest0-21swapper/322:27:293
1613099140,14cyclictest0-21swapper/322:22:123
1613099140,14cyclictest0-21swapper/321:41:043
1613099140,14cyclictest0-21swapper/321:36:293
1613099140,14cyclictest0-21swapper/321:10:533
1613099140,14cyclictest0-21swapper/321:08:253
1613099140,14cyclictest0-21swapper/319:55:073
1613099140,14cyclictest0-21swapper/319:30:323
1613099140,14cyclictest0-21swapper/319:20:103
1613099140,14cyclictest0-21swapper/319:16:503
1613099140,14cyclictest0-21swapper/319:12:143
1613099140,0cyclictest0-21swapper/322:47:313
1613099140,0cyclictest0-21swapper/322:01:233
1613099140,0cyclictest0-21swapper/320:36:373
1613099140,0cyclictest0-21swapper/320:31:133
1613099140,0cyclictest0-21swapper/320:02:213
1613099140,0cyclictest0-21swapper/319:46:593
1613099140,0cyclictest0-21swapper/319:27:263
1613099140,0cyclictest0-21swapper/300:06:103
16128991414,0cyclictest0-21swapper/222:42:252
16128991414,0cyclictest0-21swapper/222:15:122
16128991414,0cyclictest0-21swapper/221:50:162
16128991414,0cyclictest0-21swapper/200:23:252
16128991413,1cyclictest16385-21expr21:25:132
1612899140,14cyclictest0-21swapper/223:59:082
1612899140,14cyclictest0-21swapper/223:23:012
1612899140,14cyclictest0-21swapper/222:55:032
1612899140,14cyclictest0-21swapper/222:36:492
1612899140,14cyclictest0-21swapper/222:13:422
1612899140,14cyclictest0-21swapper/222:08:362
1612899140,14cyclictest0-21swapper/221:30:232
1612899140,14cyclictest0-21swapper/220:45:592
1612899140,14cyclictest0-21swapper/220:42:382
1612899140,14cyclictest0-21swapper/220:07:342
1612899140,14cyclictest0-21swapper/219:53:062
1612899140,14cyclictest0-21swapper/219:40:102
1612899140,14cyclictest0-21swapper/219:35:502
1612899140,14cyclictest0-21swapper/219:34:422
1612899140,14cyclictest0-21swapper/219:12:282
1612899140,14cyclictest0-21swapper/200:32:262
1612899140,14cyclictest0-21swapper/200:10:512
1612899140,0cyclictest0-21swapper/223:46:022
1612899140,0cyclictest0-21swapper/223:30:132
1612899140,0cyclictest0-21swapper/220:55:182
1612899140,0cyclictest0-21swapper/200:27:162
16125991414,0cyclictest22260-21apt-get20:30:121
16125991414,0cyclictest14433-21strings21:20:161
16125991414,0cyclictest0-21swapper/123:25:131
16125991414,0cyclictest0-21swapper/122:10:381
16125991414,0cyclictest0-21swapper/121:30:031
16125991414,0cyclictest0-21swapper/100:11:071
1612599140,14cyclictest0-21swapper/122:35:271
1612599140,14cyclictest0-21swapper/122:24:031
1612599140,14cyclictest0-21swapper/122:17:111
1612599140,14cyclictest0-21swapper/121:55:401
1612599140,14cyclictest0-21swapper/120:45:081
1612599140,14cyclictest0-21swapper/120:15:431
1612599140,14cyclictest0-21swapper/120:00:141
1612599140,14cyclictest0-21swapper/119:11:591
1612599140,14cyclictest0-21swapper/100:31:301
1612599140,14cyclictest0-21swapper/100:24:331
1612599140,0cyclictest0-21swapper/123:55:121
1612599140,0cyclictest0-21swapper/123:45:161
1612599140,0cyclictest0-21swapper/123:22:091
1612599140,0cyclictest0-21swapper/121:50:321
1612599140,0cyclictest0-21swapper/121:25:131
1612599140,0cyclictest0-21swapper/121:05:371
1612599140,0cyclictest0-21swapper/120:50:081
1612599140,0cyclictest0-21swapper/120:10:581
1612599140,0cyclictest0-21swapper/119:46:531
1612599140,0cyclictest0-21swapper/119:40:161
1612599140,0cyclictest0-21swapper/119:35:181
16121991414,0cyclictest0-21swapper/023:55:030
16121991414,0cyclictest0-21swapper/022:31:060
16121991414,0cyclictest0-21swapper/022:31:060
16121991414,0cyclictest0-21swapper/022:20:140
16121991414,0cyclictest0-21swapper/021:57:200
16121991414,0cyclictest0-21swapper/021:31:490
16121991414,0cyclictest0-21swapper/021:10:430
16121991414,0cyclictest0-21swapper/020:27:200
16121991414,0cyclictest0-21swapper/019:30:140
16121991413,0cyclictest26923-21apt-get20:40:120
1612199140,14cyclictest0-21swapper/023:01:150
1612199140,14cyclictest0-21swapper/022:55:520
1612199140,14cyclictest0-21swapper/022:44:370
1612199140,14cyclictest0-21swapper/022:15:030
1612199140,14cyclictest0-21swapper/022:11:070
1612199140,14cyclictest0-21swapper/021:45:150
1612199140,14cyclictest0-21swapper/021:15:460
1612199140,14cyclictest0-21swapper/020:55:130
1612199140,14cyclictest0-21swapper/019:40:510
1612199140,14cyclictest0-21swapper/019:12:380
1612199140,14cyclictest0-21swapper/000:27:310
1612199140,14cyclictest0-21swapper/000:20:200
1612199140,14cyclictest0-21swapper/000:15:120
1612199140,14cyclictest0-21swapper/000:10:490
1612199140,14cyclictest0-21swapper/000:01:250
1612199140,0cyclictest0-21swapper/023:50:260
1612199140,0cyclictest0-21swapper/022:35:360
1612199140,0cyclictest0-21swapper/022:05:060
1612199140,0cyclictest0-21swapper/020:30:430
1612199140,0cyclictest0-21swapper/020:07:330
1612199140,0cyclictest0-21swapper/019:55:410
1612199140,0cyclictest0-21swapper/019:35:290
1612199140,0cyclictest0-21swapper/019:21:200
16128991313,0cyclictest0-21swapper/220:28:502
1612899130,13cyclictest0-21swapper/223:10:032
1612899130,0cyclictest0-21swapper/200:05:492
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional