You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-04-03 - 11:41
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot4.osadl.org (updated Thu Apr 03, 2025 00:43:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
31401996723,38cyclictest28720-21tr19:10:231
31401996520,39cyclictest16422-21needreboot17:10:381
31401996518,41cyclictest18617-21/usr/sbin/munin19:45:271
3141299643,55cyclictest0-21swapper/319:05:153
31401996422,36cyclictest667-21runrttasks18:45:371
31401996422,15cyclictest6570-21df18:35:291
31401996321,36cyclictest4668-21ssh17:43:261
31401996320,37cyclictest24704-21ssh17:25:051
31401996320,37cyclictest24704-21ssh17:25:051
302292638,18sleep20-21swapper/215:00:392
3141299624,52cyclictest0-21swapper/318:05:263
3141299622,55cyclictest667-21runrttasks18:44:503
31401996222,35cyclictest10434-21timerandwakeup17:50:441
31401996220,37cyclictest31366-21ssh18:25:081
31401996219,38cyclictest28074-21ssh19:58:091
31401996217,39cyclictest19231-21/usr/sbin/munin17:15:501
31401996216,41cyclictest11369-21ssh20:25:251
3141299612,53cyclictest556-21latency_hist16:35:183
3140799618,47cyclictest0-21swapper/218:34:552
31407996118,38cyclictest20752-21sh18:07:212
31401996118,38cyclictest27851-21ssh19:08:561
31401996118,38cyclictest10944-21taskset18:42:491
31401996118,37cyclictest25119-21basename17:25:271
31401996116,39cyclictest12767-21/usr/sbin/munin19:35:271
31401996116,39cyclictest11828-21diskmemload18:01:031
31401996115,40cyclictest16519-21ssh19:40:481
31401996115,40cyclictest0-21swapper/120:05:461
31401996113,42cyclictest7364-21ssh20:16:111
31401996112,44cyclictest11785-21ssh19:33:361
3095126111,18sleep00-21swapper/015:02:500
3141299603,52cyclictest0-21swapper/315:18:463
3140199604,7cyclictest0-21swapper/119:15:441
31401996021,33cyclictest20243-21/usr/sbin/munin18:55:421
31401996020,35cyclictest17799-21ssh18:52:121
31401996019,35cyclictest32098-21perl18:25:271
31401996019,35cyclictest32098-21perl18:25:271
31401996018,37cyclictest31037-21chrt20:04:441
31401996017,38cyclictest2372-21ssh17:38:301
31401996017,38cyclictest21981-21idleruntime-cro18:10:161
31401996015,39cyclictest0-21swapper/117:32:161
31401996012,42cyclictest0-21swapper/118:19:141
3141299596,47cyclictest0-21swapper/319:10:143
3141299596,47cyclictest0-21swapper/317:39:063
3141299594,49cyclictest0-21swapper/318:46:563
3141299592,7cyclictest30246-21sshd16:25:453
31407995913,40cyclictest0-21swapper/218:56:372
31401995918,36cyclictest13618-21ls17:55:411
31401995917,36cyclictest3950-21ssh19:21:501
31401995917,36cyclictest23443-21ssh19:01:511
31401995916,38cyclictest0-21swapper/119:55:041
31401995913,40cyclictest0-21swapper/120:31:231
31401995912,41cyclictest0-21swapper/117:47:221
31397995911,5cyclictest0-21swapper/018:46:350
3141299583,11cyclictest0-21swapper/320:05:183
31401995817,35cyclictest7731-21ssh19:27:251
31401995814,39cyclictest3688-21ntpq18:30:391
31401995812,13cyclictest0-21swapper/120:21:361
3141299575,47cyclictest0-21swapper/318:57:553
3141299574,7cyclictest0-21swapper/317:30:573
3141299574,47cyclictest0-21swapper/320:18:223
3140799579,42cyclictest0-21swapper/219:25:352
31407995716,35cyclictest25073-21/usr/sbin/munin17:25:482
31407995714,37cyclictest24235-21ssh18:12:102
31407995711,40cyclictest23157-21ssh19:01:112
31407995710,39cyclictest13598-21ntp_states19:35:382
31401995719,32cyclictest14221-21ssh17:07:281
31401995712,39cyclictest0-21swapper/120:10:181
31401995710,41cyclictest0-21swapper/118:11:251
3141299567,43cyclictest0-21swapper/317:12:553
31412995611,39cyclictest0-21swapper/315:35:373
31407995612,37cyclictest1911-21ssh19:17:282
3141299557,42cyclictest0-21swapper/317:15:223
3141299554,45cyclictest0-21swapper/319:32:053
3141299554,44cyclictest0-21swapper/317:06:253
31412995510,39cyclictest0-21swapper/320:24:513
31412995510,39cyclictest0-21swapper/319:17:223
3140799559,40cyclictest0-21swapper/217:41:152
3140799558,41cyclictest0-21swapper/220:00:512
3140799558,41cyclictest0-21swapper/218:45:482
31407995513,37cyclictest19900-21tail19:45:392
31407995513,36cyclictest978-21sed17:35:472
3139799555,7cyclictest0-21swapper/020:28:130
3139799555,44cyclictest0-21swapper/017:54:260
3141299549,40cyclictest0-21swapper/317:24:213
3141299549,40cyclictest0-21swapper/317:24:213
3141299546,42cyclictest0-21swapper/317:49:423
3141299544,44cyclictest0-21swapper/318:18:353
3141299544,44cyclictest0-21swapper/317:40:313
3141299544,43cyclictest0-21swapper/319:29:523
31412995412,36cyclictest0-21swapper/318:53:023
3140799548,40cyclictest0-21swapper/219:54:252
31407995415,34cyclictest27316-21ssh18:16:032
31407995414,34cyclictest14763-21ssh17:57:002
31407995413,36cyclictest12257-21awk20:25:402
31407995412,36cyclictest4830-21ssh20:13:082
3141299538,39cyclictest0-21swapper/320:27:563
3141299535,42cyclictest0-21swapper/318:04:083
3141299534,43cyclictest0-21swapper/319:57:563
3141299534,43cyclictest0-21swapper/319:52:023
3141299534,43cyclictest0-21swapper/319:12:083
3141299534,43cyclictest0-21swapper/318:38:343
3141299534,43cyclictest0-21swapper/318:35:033
3141299534,43cyclictest0-21swapper/318:29:193
3141299534,43cyclictest0-21swapper/318:29:193
3141299534,43cyclictest0-21swapper/317:53:503
3141299532,45cyclictest25446-21ssh18:15:033
31412995310,37cyclictest0-21swapper/319:40:583
3140799538,40cyclictest0-21swapper/217:24:152
3140799538,40cyclictest0-21swapper/217:24:152
31407995312,11cyclictest0-21swapper/219:40:212
31407995311,36cyclictest16401-21ssh18:00:222
31401995319,28cyclictest7386-21sshd16:50:451
3139799536,41cyclictest22685-21cut18:10:320
3141299529,37cyclictest26661-21sshd16:15:453
3141299527,39cyclictest0-21swapper/319:35:513
3141299527,39cyclictest0-21swapper/317:29:103
3141299526,40cyclictest0-21swapper/316:20:443
3141299526,40cyclictest0-21swapper/315:10:463
3141299524,43cyclictest0-21swapper/320:01:023
3141299524,42cyclictest0-21swapper/320:32:243
3141299524,42cyclictest0-21swapper/320:11:443
3141299524,42cyclictest0-21swapper/319:21:053
3141299524,42cyclictest0-21swapper/316:45:173
3141299522,44cyclictest4569-21/usr/sbin/munin16:45:373
31412995213,33cyclictest0-21swapper/317:56:333
3140799528,39cyclictest0-21swapper/217:32:522
3140799528,38cyclictest0-21swapper/217:51:582
3140799527,40cyclictest0-21swapper/220:09:162
31407995213,34cyclictest27104-21ssh19:07:072
31407995212,14cyclictest10565-21ssh19:30:452
31401995218,29cyclictest16918-21tr15:50:351
3139799524,42cyclictest0-21swapper/020:18:330
3141299514,41cyclictest0-21swapper/319:47:133
3141299514,41cyclictest0-21swapper/318:20:403
3141299512,43cyclictest9338-21cat16:55:453
31407995111,35cyclictest4364-21ssh19:22:502
31407995111,34cyclictest7502-21ssh17:46:422
31407995111,34cyclictest20662-21ssh17:15:572
3139799514,42cyclictest0-21swapper/018:29:150
3139799514,42cyclictest0-21swapper/018:29:150
3139799514,41cyclictest0-21swapper/020:03:530
3139799513,6cyclictest27793-21ssh17:28:570
3141299505,10cyclictest0-21swapper/315:05:373
3141299503,42cyclictest0-21swapper/317:00:343
3141299502,42cyclictest5213-21/usr/sbin/munin15:20:473
3140799504,40cyclictest0-21swapper/218:42:102
31407995012,13cyclictest10349-21ssh20:24:202
31407995011,34cyclictest853-21ssh18:26:072
31407995011,34cyclictest853-21ssh18:26:072
31407995011,34cyclictest7485-21ssh20:16:292
3139799509,7cyclictest12925-21aten_rbpower_en17:55:310
3139799504,40cyclictest0-21swapper/018:21:550
3139799504,40cyclictest0-21swapper/017:49:360
310582507,15sleep30-21swapper/315:04:063
3141299492,41cyclictest6428-21/usr/sbin/munin16:50:343
3139799495,39cyclictest0-21swapper/018:54:510
3139799494,39cyclictest0-21swapper/019:12:350
3139799494,39cyclictest0-21swapper/017:17:420
3139799492,42cyclictest32116-21date17:35:170
3141299485,38cyclictest0-21swapper/315:50:273
3141299485,38cyclictest0-21swapper/315:42:063
3141299482,41cyclictest7083-21/usr/sbin/munin15:25:523
3139799487,35cyclictest16928-21ssh19:41:470
3139799486,36cyclictest0-21swapper/019:29:570
3141299475,37cyclictest252332chrt16:11:453
3141299475,37cyclictest0-21swapper/315:30:523
3141299473,40cyclictest0-21swapper/316:04:283
3141299473,38cyclictest0-21swapper/316:35:303
3141299472,40cyclictest0-21swapper/315:45:493
3141299472,39cyclictest22021-21/usr/sbin/munin16:05:423
3141299472,39cyclictest18654-21perl15:55:333
3139799479,33cyclictest25855-21aten_rbpower_vo19:55:270
3139799475,36cyclictest0-21swapper/020:23:020
3139799474,38cyclictest0-21swapper/019:45:540
3139799474,38cyclictest0-21swapper/019:31:420
3139799474,37cyclictest0-21swapper/020:06:280
3139799474,37cyclictest0-21swapper/019:22:060
3139799474,37cyclictest0-21swapper/019:06:130
3139799474,37cyclictest0-21swapper/018:41:290
3139799474,37cyclictest0-21swapper/018:37:300
3139799474,37cyclictest0-21swapper/018:17:380
3139799474,37cyclictest0-21swapper/017:05:280
3139799473,40cyclictest0-21swapper/017:11:450
3139799473,39cyclictest0-21swapper/020:33:230
3139799473,38cyclictest0-21swapper/019:20:030
3139799468,32cyclictest0-21swapper/019:52:110
3139799465,35cyclictest0-21swapper/017:44:560
3139799464,36cyclictest0-21swapper/020:11:160
3139799464,36cyclictest0-21swapper/019:36:520
3139799464,36cyclictest0-21swapper/018:55:250
3139799464,36cyclictest0-21swapper/018:31:370
3139799464,36cyclictest0-21swapper/018:02:370
3139799464,36cyclictest0-21swapper/017:21:470
3139799464,36cyclictest0-21swapper/017:21:470
31401994530,11cyclictest3935-21grep16:40:491
31401994515,24cyclictest1177-21tune2fs16:35:341
3139799454,36cyclictest0-21swapper/019:01:260
3139799454,36cyclictest0-21swapper/017:36:080
31401994425,14cyclictest30058-21ls16:25:411
31401994424,15cyclictest9296-21timerandwakeup16:55:441
31401994416,22cyclictest5072-21kernelversion16:45:401
31401994413,25cyclictest24605-21ntp_kernel_err16:10:401
3139799445,34cyclictest0-21swapper/018:08:050
295432443,32sleep129673-21df15:00:301
3140799433,35cyclictest0-21swapper/215:05:472
31407994314,23cyclictest6858-21crond15:25:192
31401994328,11cyclictest18652-21grep15:55:331
31401994328,10cyclictest598-21gdbus15:50:191
31401994326,11cyclictest26174-21ls16:15:341
31401994324,13cyclictest23252-21head16:05:511
31401994323,15cyclictest31632-21munin-node15:05:241
31401994322,14cyclictest3930-21sed15:15:391
31401994322,14cyclictest11156-21sed17:00:461
31401994319,19cyclictest11190-21grep15:35:341
31407994217,18cyclictest378-21systemd-journal17:10:172
31401994226,10cyclictest31527-21diskstats16:30:311
31401994223,14cyclictest8202-21sed15:25:511
31401994222,14cyclictest2104-21ls15:10:421
31401994220,16cyclictest5935-21ntp_kernel_err15:20:411
31401994220,15cyclictest571-21rs:main1
31401994218,18cyclictest9443-21iostat_ios15:30:381
31401994218,18cyclictest27803-21forks16:20:321
31401994218,18cyclictest20312-21df16:00:321
31407994117,18cyclictest8477-21/usr/sbin/munin16:55:302
31407994117,18cyclictest30235-21ntp_offset16:25:442
31407994115,20cyclictest30273-21sh18:22:342
31407994114,20cyclictest25870-21cpu19:55:272
227012413,6sleep00-21swapper/016:05:430
31407994023,11cyclictest21308-21unixbench_multi16:00:502
31407994022,13cyclictest14435-21/usr/sbin/munin20:30:282
31407994021,14cyclictest11314-21kernelversion15:35:372
31407994020,14cyclictest2373-21ksmtuned16:39:042
31407994018,15cyclictest6859-21idleruntime16:50:342
31407994016,19cyclictest32308-21switchtime16:30:452
31407994013,22cyclictest17755-21sh18:52:072
31407994013,21cyclictest17421-21ssh17:11:412
43652393,6sleep00-21swapper/016:45:180
31407993924,9cyclictest7351-21/usr/sbin/munin18:35:422
31407993919,15cyclictest28434-21processes16:20:432
31407993919,14cyclictest2181-21netstat15:10:432
31407993919,14cyclictest10911-21grep17:00:412
31407993918,15cyclictest13118-21if_err_eth215:40:362
31407993917,16cyclictest9642-21netstat15:30:422
31407993915,18cyclictest4291-21sshd16:44:442
77592383,6sleep00-21swapper/015:25:430
31407993819,14cyclictest7996-21swap15:25:492
31407993819,14cyclictest16882-21interrupts15:50:332
31407993818,15cyclictest18511-21cut15:55:322
31407993818,15cyclictest14931-21fschecks_time15:45:372
31407993818,14cyclictest22479-21if_eth216:05:372
31407993817,16cyclictest24079-21sort16:10:332
31407993816,17cyclictest4989-21idleruntime16:45:372
31407993816,15cyclictest28707-21aten_rbpower_en19:10:232
31407993815,18cyclictest3976-21missed_timers15:15:402
31407993715,18cyclictest27022-21taskset16:15:502
195442363,6sleep00-21swapper/015:55:530
142422363,6sleep00-21swapper/015:44:270
67242353,6sleep00-21swapper/015:23:460
10442343,6sleep00-21swapper/015:07:450
3292313,6sleep00-21swapper/016:32:510
31397993119,7cyclictest30258-21awk16:25:460
3139799303,24cyclictest0-21swapper/016:03:250
3139799303,23cyclictest0-21swapper/016:10:250
31397993020,6cyclictest4158-21awk16:43:050
31397993018,7cyclictest27937-21cut16:20:330
31397993012,13cyclictest25834-21aten_rbpower_po16:15:290
3139799294,19cyclictest0-21swapper/015:10:350
3139799293,23cyclictest0-21swapper/015:31:540
31397992920,6cyclictest14871-21fschecks_time15:45:370
31397992918,7cyclictest17064-21cat15:50:370
3139799284,19cyclictest0-21swapper/016:35:460
3139799283,21cyclictest0-21swapper/017:00:130
3139799283,20cyclictest0-21swapper/017:00:360
3139799283,20cyclictest0-21swapper/015:35:350
31397992816,7cyclictest4174-21processes15:15:460
31397992810,14cyclictest7628-21tail16:50:480
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional