You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-04-02 - 06:27
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackbslot7.osadl.org (updated Wed Apr 02, 2025 00:44:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
232049912757,58cyclictest0-21swapper/019:42:180
232339911053,50cyclictest28585-21latency_hist23:02:203
2321299952,47cyclictest6980-21apt-get23:22:331
2322499943,56cyclictest15257-21df_inode22:38:232
216982926,14sleep30-21swapper/319:02:283
23224999017,41cyclictest26293-21munin-run23:57:192
2322499893,58cyclictest16055-21apt-get20:27:332
2322499893,58cyclictest16055-21apt-get20:27:332
23212998729,10cyclictest23042-21fschecks_count22:52:401
23212998322,14cyclictest15768-21fschecks_count23:37:381
23224998121,30cyclictest402-21runrttasks00:07:172
23212998121,12cyclictest0-21swapper/119:12:421
23212998022,10cyclictest0-21swapper/119:37:371
23212998017,11cyclictest0-21swapper/122:02:221
23224997925,24cyclictest0-21swapper/223:39:502
23212997923,50cyclictest0-21swapper/120:53:321
23212997914,19cyclictest5079-21latency_hist00:17:221
23212997914,13cyclictest0-21swapper/121:17:421
23212997816,11cyclictest0-21swapper/123:07:211
23212997816,11cyclictest0-21swapper/123:07:211
23204997857,13cyclictest5837-21latency_hist21:22:210
23212997753,14cyclictest15385-21ssh22:38:291
2321299763,31cyclictest11007-21grep20:08:211
23212997628,40cyclictest0-21swapper/121:52:501
23212997626,45cyclictest8066-1kworker/1:1H22:07:221
23204997640,8cyclictest0-21swapper/023:57:200
42282750,5sleep20-21swapper/200:15:342
23233997555,12cyclictest0-21swapper/323:27:183
23224997524,27cyclictest21941-21cut21:52:232
23224997524,27cyclictest21941-21cut21:52:232
23212997521,11cyclictest0-21swapper/123:17:431
23224997454,8cyclictest9552-21kworker/u8:220:22:332
23224997428,18cyclictest1897-21sh00:12:082
23212997429,8cyclictest0-21swapper/123:52:461
23224997346,17cyclictest25702-21latency_hist22:57:212
23224997342,21cyclictest20105-21/usr/sbin/munin22:47:372
23212997352,13cyclictest29340-21sh21:07:221
23212997316,12cyclictest0-21swapper/121:24:541
23212997316,12cyclictest0-21swapper/121:24:541
2195027326,23sleep20-21swapper/219:02:472
23233997226,14cyclictest41-21ksoftirqd/322:07:533
23233997226,14cyclictest41-21ksoftirqd/322:07:533
23224997247,17cyclictest8574-21ssh23:25:302
23212997222,7cyclictest0-21swapper/123:15:181
23212997217,11cyclictest0-21swapper/123:44:331
23212997216,11cyclictest0-21swapper/100:07:371
23233997154,10cyclictest14660-21gpgv22:37:223
23233997125,13cyclictest41-21ksoftirqd/300:12:423
23224997146,18cyclictest15128-21date00:37:332
23224997140,23cyclictest28951-21fschecks_time19:22:412
23224997140,23cyclictest28951-21fschecks_time19:22:412
23212997138,18cyclictest420-21snmpd22:21:011
23212997138,18cyclictest420-21snmpd22:21:011
23212997120,12cyclictest0-21swapper/121:12:401
2321299702,14cyclictest14391-21apt-config22:37:201
23212997017,12cyclictest0-21swapper/119:52:581
2320499703,33cyclictest2815-21idleruntime-cro21:17:180
23224996940,21cyclictest27922-21/usr/sbin/munin23:58:252
23224996937,25cyclictest22816-21sort20:47:532
23224996937,25cyclictest22816-21sort20:47:532
23212996925,10cyclictest3300-21awk22:17:191
23212996925,10cyclictest3300-21awk22:17:191
23212996919,11cyclictest0-21swapper/122:50:401
23212996917,11cyclictest0-21swapper/119:28:271
23204996951,12cyclictest7262-21latency_hist23:22:210
23224996841,16cyclictest12274-21munin-plugin-st00:32:182
23224996840,18cyclictest30027-21/usr/sbin/munin22:07:502
23224996840,18cyclictest30027-21/usr/sbin/munin22:07:502
23224996821,19cyclictest29251-21diskmemload00:19:432
23224996821,17cyclictest29251-21diskmemload23:21:192
23224996819,20cyclictest30965-21diskstats23:07:352
23212996848,12cyclictest15211-21sendmail23:37:181
2321299683,26cyclictest16354-21fschecks_time20:28:111
2321299683,26cyclictest16354-21fschecks_time20:28:111
23212996822,8cyclictest0-21swapper/122:27:281
23212996820,11cyclictest0-21swapper/123:08:451
23212996812,13cyclictest0-21swapper/122:12:211
23212996812,13cyclictest0-21swapper/122:12:211
23204996844,14cyclictest26768-21cron19:17:190
23233996752,9cyclictest27642-21munin-plugin-st21:02:183
23233996752,7cyclictest0-21swapper/323:57:563
23233996729,8cyclictest41-21ksoftirqd/323:52:203
23224996747,10cyclictest3139-21ssh21:17:312
23224996746,13cyclictest0-21swapper/220:07:212
23224996742,17cyclictest17822-21/usr/sbin/munin20:32:372
23224996734,24cyclictest4595-21sort19:47:472
23224996733,23cyclictest32557-21apt-get21:12:332
23224996732,23cyclictest11689-21apt-get20:12:362
23224996729,26cyclictest29684-21ssh23:05:062
23224996729,26cyclictest29684-21ssh23:05:062
23224996727,30cyclictest30100-21sed21:07:472
23224996727,30cyclictest30100-21sed21:07:472
23212996715,12cyclictest0-21swapper/119:09:011
23212996714,25cyclictest25-21ksoftirqd/100:37:171
23204996752,8cyclictest8250irq/69-2188000.00:02:470
47512660,13sleep0161rcuc/000:17:100
23233996649,10cyclictest0-21swapper/323:27:363
23224996643,15cyclictest16197-21ssh21:40:462
23224996643,15cyclictest16197-21ssh21:40:462
23224996639,18cyclictest9627-21/usr/sbin/munin23:27:312
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional