You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-04-03 - 11:29
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack3slot6.osadl.org (updated Thu Apr 03, 2025 00:45:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2757129225,17sleep10-21swapper/119:06:511
28049998468,11cyclictest14-21ksoftirqd/022:40:140
28049997557,10cyclictest14-21ksoftirqd/022:35:110
2746127416,47sleep00-21swapper/019:05:390
28056997337,30cyclictest26-21ksoftirqd/121:20:251
28049997152,12cyclictest0-21swapper/021:30:120
28049997152,10cyclictest14-21ksoftirqd/019:45:130
28049997152,10cyclictest14-21ksoftirqd/000:00:160
2804999708,19cyclictest3202-21apt-get19:30:160
28049996944,19cyclictest14-21ksoftirqd/023:55:230
28049996742,15cyclictest0-21swapper/022:15:130
9872660,4chrt0-21swapper/122:40:021
28056996633,27cyclictest26-21ksoftirqd/120:35:011
28049996641,20cyclictest14-21ksoftirqd/020:45:170
28056996535,24cyclictest26-21ksoftirqd/100:30:291
28056996523,23cyclictest26-21ksoftirqd/122:15:011
28056996519,40cyclictest26-21ksoftirqd/119:30:261
28049996525,34cyclictest17393-21aten2.4-expect20:10:200
28049996442,17cyclictest15036-21sshd21:37:300
28049996435,20cyclictest14-21ksoftirqd/023:40:140
28049996415,45cyclictest0-21swapper/000:10:100
28056996343,15cyclictest26-21ksoftirqd/120:05:301
28056996333,17cyclictest4431-21telnet21:05:171
28056996321,11cyclictest441-21dbus-daemon21:20:001
28049996338,19cyclictest14-21ksoftirqd/022:30:100
28049996335,15cyclictest0-21swapper/023:15:100
28049996334,19cyclictest14-21ksoftirqd/020:25:160
28056996236,20cyclictest26-21ksoftirqd/122:30:271
28049996239,14cyclictest14-21ksoftirqd/019:55:110
28049996236,13cyclictest0-21swapper/019:20:140
28049996234,17cyclictest0-21swapper/000:20:130
28049996232,18cyclictest0-21swapper/021:05:160
28049996230,26cyclictest14-21ksoftirqd/021:20:130
28049996220,16cyclictest15604-21aten2.4-expect20:05:180
93512610,5chrt9354-21switchtime19:45:341
28056996138,8cyclictest26-21ksoftirqd/123:30:341
28056996137,9cyclictest26-21ksoftirqd/119:25:181
28056996136,9cyclictest26-21ksoftirqd/119:20:011
28056996130,25cyclictest26-21ksoftirqd/123:20:151
28049996145,10cyclictest572-21snmpd20:15:320
28049996134,15cyclictest0-21swapper/021:00:150
71422600,5sleep07140-21ethtool19:40:230
28056996038,8cyclictest26-21ksoftirqd/120:25:391
28049996033,15cyclictest0-21swapper/023:00:170
2805699595,27cyclictest0-21swapper/121:36:411
28056995937,8cyclictest26-21ksoftirqd/120:00:321
28056995937,8cyclictest26-21ksoftirqd/100:00:201
28056995937,17cyclictest26-21ksoftirqd/120:35:361
28056995936,9cyclictest26-21ksoftirqd/120:55:171
28056995936,9cyclictest26-21ksoftirqd/119:55:011
28056995936,9cyclictest26-21ksoftirqd/100:35:351
28056995936,8cyclictest26-21ksoftirqd/123:50:121
28056995936,8cyclictest26-21ksoftirqd/122:40:181
28056995936,8cyclictest26-21ksoftirqd/100:20:211
28056995935,9cyclictest26-21ksoftirqd/122:20:391
28056995935,9cyclictest26-21ksoftirqd/122:00:331
28056995929,23cyclictest26-21ksoftirqd/119:45:021
28056995926,22cyclictest26-21ksoftirqd/123:55:131
28056995922,17cyclictest26-21ksoftirqd/120:13:431
28056995916,28cyclictest7510-21ls23:00:221
2804999594,50cyclictest23908-21cron22:10:010
28049995933,18cyclictest0-21swapper/019:15:150
28049995933,15cyclictest0-21swapper/022:00:170
28049995932,15cyclictest0-21swapper/023:35:120
28049995932,14cyclictest0-21swapper/000:30:080
28049995931,16cyclictest0-21swapper/020:55:140
28049995925,8cyclictest14-21ksoftirqd/023:24:330
28056995842,10cyclictest26-21ksoftirqd/122:50:221
28056995837,8cyclictest26-21ksoftirqd/120:19:411
28056995836,8cyclictest26-21ksoftirqd/120:40:161
28056995836,8cyclictest26-21ksoftirqd/100:15:221
28056995836,8cyclictest26-21ksoftirqd/100:10:131
28056995836,7cyclictest26-21ksoftirqd/119:20:191
28056995836,17cyclictest26-21ksoftirqd/122:55:331
28056995836,17cyclictest26-21ksoftirqd/122:55:331
28056995836,16cyclictest26-21ksoftirqd/123:30:011
28056995835,8cyclictest26-21ksoftirqd/123:10:211
28056995835,8cyclictest26-21ksoftirqd/121:30:171
28056995835,8cyclictest26-21ksoftirqd/121:00:261
28056995835,8cyclictest26-21ksoftirqd/119:40:001
28056995835,17cyclictest26-21ksoftirqd/121:55:041
28056995835,17cyclictest26-21ksoftirqd/121:50:211
28056995835,17cyclictest26-21ksoftirqd/121:50:211
28056995835,17cyclictest26-21ksoftirqd/120:00:011
28056995817,36cyclictest26-21ksoftirqd/121:45:061
2804999583,50cyclictest20960-21grep21:55:450
28049995833,14cyclictest0-21swapper/020:40:150
28049995832,21cyclictest14-21ksoftirqd/023:51:060
28049995832,21cyclictest14-21ksoftirqd/019:25:150
28049995831,16cyclictest0-21swapper/023:30:160
28049995828,21cyclictest27137-21cron00:09:590
28056995735,9cyclictest26-21ksoftirqd/122:15:341
28056995735,8cyclictest26-21ksoftirqd/122:10:001
28056995735,7cyclictest26-21ksoftirqd/123:45:011
28056995735,16cyclictest26-21ksoftirqd/120:45:261
28056995734,9cyclictest26-21ksoftirqd/123:39:001
28056995734,8cyclictest26-21ksoftirqd/123:15:141
28056995733,18cyclictest26-21ksoftirqd/119:10:171
28049995743,9cyclictest14-21ksoftirqd/023:10:090
28049995732,20cyclictest14-21ksoftirqd/020:35:130
28049995730,18cyclictest14-21ksoftirqd/019:50:170
28049995728,16cyclictest0-21swapper/000:35:150
28056995635,8cyclictest26-21ksoftirqd/121:29:461
28056995634,7cyclictest26-21ksoftirqd/120:50:201
28056995634,7cyclictest26-21ksoftirqd/120:50:191
28056995624,25cyclictest26-21ksoftirqd/121:10:411
2804999567,11cyclictest0-21swapper/019:10:220
2804999563,9cyclictest151rcu_preempt23:29:590
28049995632,19cyclictest14-21ksoftirqd/020:00:120
28049995629,19cyclictest261-21systemd-journal21:15:010
28049995627,20cyclictest441-21dbus-daemon21:55:000
28049995627,20cyclictest441-21dbus-daemon21:55:000
28049995617,32cyclictest0-21swapper/020:50:190
28049995617,32cyclictest0-21swapper/020:50:190
28056995539,10cyclictest26-21ksoftirqd/121:40:321
28056995534,7cyclictest26-21ksoftirqd/120:20:351
28056995520,22cyclictest26-21ksoftirqd/100:25:551
28049995532,15cyclictest0-21swapper/022:10:080
28049995530,21cyclictest14-21ksoftirqd/022:55:130
28049995530,21cyclictest14-21ksoftirqd/022:55:130
28049995529,16cyclictest0-21swapper/021:15:130
28049995525,17cyclictest0-21swapper/020:20:150
28056995439,9cyclictest26-21ksoftirqd/122:48:161
28056995337,10cyclictest26-21ksoftirqd/123:05:431
28056995330,17cyclictest26-21ksoftirqd/100:05:411
28049995331,15cyclictest5491-21sshd19:35:270
28049995329,17cyclictest14-21ksoftirqd/022:20:170
28056995238,9cyclictest26-21ksoftirqd/123:49:061
28056995237,9cyclictest26-21ksoftirqd/122:25:111
2804999523,44cyclictest3481-21head22:50:110
28049995227,18cyclictest29154-21head00:15:180
28049995225,18cyclictest14-21ksoftirqd/020:30:180
28049995212,33cyclictest0-21swapper/021:40:150
2804999515,10cyclictest0-21swapper/022:48:070
28049995137,9cyclictest14-21ksoftirqd/022:30:000
28049995033,8cyclictest14-21ksoftirqd/021:29:050
28049995027,19cyclictest14-21ksoftirqd/000:26:320
2804999502,18cyclictest17344-21taskset21:46:120
28049994933,9cyclictest14-21ksoftirqd/023:48:090
2804999485,38cyclictest0-21swapper/023:08:120
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional