You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-04-02 - 08:12
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot6.osadl.org (updated Wed Apr 02, 2025 00:45:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
202329529,18sleep10-21swapper/119:09:091
98002920,6chrt9803-21wc22:55:010
2246997256,9cyclictest26-21ksoftirqd/121:50:161
96627133,23sleep00-21swapper/019:05:230
2242997014,51cyclictest0-21swapper/022:35:250
105662700,6sleep00-21swapper/021:10:150
102142690,5sleep126-21ksoftirqd/119:30:241
2246996836,26cyclictest26-21ksoftirqd/123:20:191
2246996736,24cyclictest26-21ksoftirqd/122:55:261
2246996735,26cyclictest26-21ksoftirqd/123:40:191
2246996735,26cyclictest26-21ksoftirqd/121:05:201
2246996735,26cyclictest26-21ksoftirqd/100:20:231
2246996735,25cyclictest26-21ksoftirqd/121:20:311
2246996735,25cyclictest26-21ksoftirqd/120:50:331
2246996731,29cyclictest26-21ksoftirqd/100:40:021
2246996729,26cyclictest26-21ksoftirqd/123:50:341
224299676,22cyclictest9901-21apt-get22:55:120
2242996750,12cyclictest0-21swapper/023:55:140
2246996650,11cyclictest2235-21cyclictest21:31:481
2246996636,24cyclictest26-21ksoftirqd/119:50:361
2246996636,24cyclictest26-21ksoftirqd/119:50:351
2246996634,26cyclictest26-21ksoftirqd/120:20:301
2246996634,25cyclictest26-21ksoftirqd/122:10:081
2246996634,25cyclictest26-21ksoftirqd/122:10:071
2246996633,11cyclictest26-21ksoftirqd/121:35:241
2246996632,12cyclictest26-21ksoftirqd/121:50:011
2246996631,8cyclictest26-21ksoftirqd/100:00:031
2246996623,16cyclictest26-21ksoftirqd/120:50:011
2242996645,14cyclictest2324-21apt-get19:10:160
2246996535,24cyclictest26-21ksoftirqd/119:35:271
2246996533,25cyclictest26-21ksoftirqd/120:30:421
2246996533,25cyclictest26-21ksoftirqd/100:15:341
2246996532,27cyclictest26-21ksoftirqd/123:15:231
2246996532,27cyclictest26-21ksoftirqd/119:40:181
2246996532,11cyclictest26-21ksoftirqd/119:20:361
2246996530,12cyclictest26-21ksoftirqd/119:15:011
2246996436,21cyclictest26-21ksoftirqd/122:35:121
2246996435,22cyclictest26-21ksoftirqd/122:40:121
2246996434,23cyclictest26-21ksoftirqd/121:00:211
2246996433,25cyclictest26-21ksoftirqd/120:35:311
2246996433,25cyclictest26-21ksoftirqd/119:55:341
2246996433,25cyclictest26-21ksoftirqd/100:00:181
2246996431,11cyclictest26-21ksoftirqd/122:35:021
2246996431,11cyclictest26-21ksoftirqd/120:40:191
2246996334,23cyclictest26-21ksoftirqd/122:15:201
2246996333,24cyclictest26-21ksoftirqd/123:30:141
2246996333,23cyclictest26-21ksoftirqd/123:00:351
2246996331,11cyclictest26-21ksoftirqd/120:10:241
2246996330,11cyclictest26-21ksoftirqd/122:00:181
2246996330,11cyclictest26-21ksoftirqd/120:00:261
2246996330,11cyclictest26-21ksoftirqd/100:30:241
2246996330,11cyclictest26-21ksoftirqd/100:30:241
2242996341,18cyclictest14-21ksoftirqd/000:05:010
224299633,24cyclictest23941-21latency_hist21:55:010
2246996239,17cyclictest26-21ksoftirqd/122:50:291
2246996234,23cyclictest26-21ksoftirqd/119:45:331
2246996233,8cyclictest26-21ksoftirqd/122:10:001
2246996231,25cyclictest26-21ksoftirqd/122:20:211
2246996231,24cyclictest26-21ksoftirqd/123:10:311
2246996230,11cyclictest26-21ksoftirqd/119:20:011
224299624,25cyclictest17881-21apt-key23:20:020
2246996138,18cyclictest26-21ksoftirqd/123:35:221
2246996132,23cyclictest26-21ksoftirqd/121:10:291
2246996130,24cyclictest26-21ksoftirqd/121:15:171
2242996120,35cyclictest24229-21aten2.4-expect23:40:160
2246996037,17cyclictest26-21ksoftirqd/121:55:351
2246996037,17cyclictest26-21ksoftirqd/119:25:111
2246996036,18cyclictest26-21ksoftirqd/123:10:011
2246996036,18cyclictest26-21ksoftirqd/120:55:151
2246996029,11cyclictest26-21ksoftirqd/120:15:331
2246996022,16cyclictest26-21ksoftirqd/100:10:101
224299606,46cyclictest5272-21apt-get20:55:140
2242996035,14cyclictest0-21swapper/023:30:090
2246995936,17cyclictest26-21ksoftirqd/121:40:151
2246995935,18cyclictest26-21ksoftirqd/100:05:071
2246995934,19cyclictest26-21ksoftirqd/123:50:011
224299594,17cyclictest27393-21cat22:05:010
2242995934,15cyclictest0-21swapper/023:20:150
2242995931,15cyclictest0-21swapper/023:00:120
2242995919,35cyclictest22329-21aten2.4-expect23:35:180
2242995913,19cyclictest22989-21/usr/sbin/munin20:10:160
2246995835,17cyclictest26-21ksoftirqd/122:25:231
2246995835,17cyclictest26-21ksoftirqd/120:28:151
2246995834,9cyclictest26-21ksoftirqd/122:50:001
2246995834,9cyclictest26-21ksoftirqd/120:09:011
2246995833,18cyclictest26-21ksoftirqd/121:30:001
2246995822,31cyclictest26-21ksoftirqd/100:26:321
2242995832,16cyclictest0-21swapper/023:50:090
2242995826,23cyclictest14-21ksoftirqd/000:30:140
2242995826,23cyclictest14-21ksoftirqd/000:30:140
2242995815,37cyclictest16959-21tail19:50:230
2242995815,37cyclictest16959-21tail19:50:220
224299574,47cyclictest4052-21munin-node19:15:040
2242995742,10cyclictest575-21ntpd00:20:320
2242995732,19cyclictest441-21dbus-daemon22:00:010
2242995732,13cyclictest0-21swapper/020:45:120
224299573,19cyclictest10218-21diskstats19:30:230
2242995731,19cyclictest14-21ksoftirqd/000:35:130
2242995714,36cyclictest0-21swapper/019:40:150
2246995633,8cyclictest26-21ksoftirqd/123:30:011
224299565,47cyclictest0-21swapper/023:29:030
2242995639,12cyclictest13897-21apt-get23:10:120
2242995634,17cyclictest14-21ksoftirqd/023:09:010
2242995630,17cyclictest546-21gdbus21:25:010
2242995629,21cyclictest441-21dbus-daemon20:08:590
224299562,18cyclictest7966-21taskset22:49:490
224299555,13cyclictest0-21swapper/021:05:350
224299554,45cyclictest16754-21df_inode21:30:210
2242995540,10cyclictest3560-21turbostat00:20:000
2242995539,10cyclictest19957-21/usr/sbin/munin21:40:240
2242995538,12cyclictest31013-21df_inode20:35:200
224299553,35cyclictest22140-21latency_hist21:50:010
224299553,18cyclictest20723-21diskstats20:00:220
2242995439,10cyclictest572-21snmpd21:35:350
2242995434,12cyclictest11639-21telnet19:35:160
2242995433,16cyclictest14-21ksoftirqd/020:40:170
2242995412,8cyclictest151rcu_preempt20:52:260
2242995411,37cyclictest26312-21tail20:20:160
224299535,43cyclictest0-21swapper/022:15:330
224299533,44cyclictest6645-21users22:40:390
224299533,23cyclictest3244-21apt-get22:35:010
2242995328,16cyclictest7292-21sort19:20:350
2242995327,8cyclictest14-21ksoftirqd/019:48:160
2242995322,26cyclictest24516-21/usr/sbin/munin20:15:270
2242995319,29cyclictest18750-21aten2.4-expect19:55:180
2242995316,30cyclictest0-21swapper/019:25:150
224299526,41cyclictest0-21swapper/020:30:280
2242995230,13cyclictest32659-21apt-get00:10:110
2242995228,18cyclictest12346-21aten2.4_r3power21:15:160
2242995221,24cyclictest441-21dbus-daemon20:30:000
2242995134,12cyclictest1110-21chrt22:26:120
2242995131,16cyclictest14-21ksoftirqd/022:10:240
2242995131,16cyclictest14-21ksoftirqd/022:10:240
2242995131,13cyclictest16246-21munin-run21:29:590
2242995130,17cyclictest14-21ksoftirqd/022:20:190
2242995127,19cyclictest546-21gdbus23:50:010
2242995027,17cyclictest14-21ksoftirqd/021:00:160
224299495,40cyclictest0-21swapper/022:06:050
2242994821,20cyclictest261-21systemd-journal00:25:020
2242994729,14cyclictest14-21ksoftirqd/000:08:130
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:243
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
none10:54:242
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional