You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-03-13 - 21:04
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot6.osadl.org (updated Thu Mar 13, 2025 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3257225690,6sleep10-21swapper/108:53:571
378421690,5sleep1101699cyclictest12:43:561
1518911030,3ptp4l401ktimersoftd/308:53:483
83042670,2sleep20-21swapper/212:05:182
1031995949,6cyclictest41-21ksoftirqd/309:08:413
6022584,42sleep00-21swapper/008:54:460
74132550,2sleep20-21swapper/211:18:492
45172550,2sleep30-21swapper/309:03:453
45172550,2sleep30-21swapper/309:03:453
307982550,2sleep3391rcuc/309:58:333
1031995434,10cyclictest41-21ksoftirqd/309:18:493
1031995425,5cyclictest41-21ksoftirqd/313:19:023
1031995424,10cyclictest41-21ksoftirqd/311:29:063
1031995423,11cyclictest41-21ksoftirqd/314:09:083
1031995423,11cyclictest41-21ksoftirqd/314:09:083
236522530,2sleep30-21swapper/309:43:433
18072530,2sleep20-21swapper/212:42:202
1031995224,4cyclictest41-21ksoftirqd/313:58:483
1031995223,7cyclictest41-21ksoftirqd/309:33:513
1031995223,10cyclictest41-21ksoftirqd/311:38:533
103199514,8cyclictest21052-21apt-get09:38:413
1031995124,5cyclictest41-21ksoftirqd/310:33:503
1031995123,7cyclictest41-21ksoftirqd/310:28:493
1031995122,7cyclictest41-21ksoftirqd/312:06:173
1031995121,7cyclictest41-21ksoftirqd/313:00:363
1031995120,8cyclictest41-21ksoftirqd/314:19:563
1031995022,9cyclictest41-21ksoftirqd/311:44:013
1031995021,7cyclictest41-21ksoftirqd/313:39:223
1031995021,7cyclictest41-21ksoftirqd/312:33:443
1031995021,7cyclictest41-21ksoftirqd/312:33:443
1031994923,8cyclictest41-21ksoftirqd/312:03:353
1031994922,9cyclictest41-21ksoftirqd/313:48:533
1031994921,4cyclictest41-21ksoftirqd/312:51:163
1031994919,8cyclictest41-21ksoftirqd/313:10:273
1031994918,9cyclictest41-21ksoftirqd/310:54:033
103199487,9cyclictest41-21ksoftirqd/309:03:313
103199487,9cyclictest41-21ksoftirqd/309:03:313
1031994822,4cyclictest41-21ksoftirqd/311:48:493
1031994821,4cyclictest41-21ksoftirqd/311:20:253
1031994820,4cyclictest41-21ksoftirqd/313:31:443
1031994820,10cyclictest41-21ksoftirqd/314:23:473
1031994819,8cyclictest41-21ksoftirqd/312:23:233
1031994819,8cyclictest41-21ksoftirqd/311:36:333
1031994818,8cyclictest41-21ksoftirqd/313:15:503
1021994833,9cyclictest33-21ksoftirqd/212:23:512
103199476,10cyclictest41-21ksoftirqd/314:04:073
103199476,10cyclictest41-21ksoftirqd/314:04:073
1031994740,4cyclictest41-21ksoftirqd/309:23:433
1031994721,9cyclictest41-21ksoftirqd/314:14:053
1031994719,7cyclictest41-21ksoftirqd/313:43:413
1031994718,5cyclictest41-21ksoftirqd/309:29:113
1031994718,4cyclictest41-21ksoftirqd/311:11:253
1031994717,8cyclictest41-21ksoftirqd/313:35:153
1031994717,10cyclictest41-21ksoftirqd/311:06:483
103199465,8cyclictest41-21ksoftirqd/312:08:593
1031994620,7cyclictest41-21ksoftirqd/310:09:123
1031994619,4cyclictest41-21ksoftirqd/313:54:393
1031994618,10cyclictest41-21ksoftirqd/311:03:133
103199454,10cyclictest41-21ksoftirqd/313:23:503
1031994535,3cyclictest41-21ksoftirqd/310:23:593
1031994518,9cyclictest41-21ksoftirqd/313:05:053
1031994518,9cyclictest41-21ksoftirqd/312:55:463
1031994518,7cyclictest41-21ksoftirqd/312:26:503
103199451,7cyclictest41-21ksoftirqd/310:53:343
103199451,7cyclictest41-21ksoftirqd/310:53:343
1031994517,8cyclictest41-21ksoftirqd/309:59:393
1031994516,9cyclictest41-21ksoftirqd/311:54:023
1031994516,8cyclictest41-21ksoftirqd/311:28:333
103199447,7cyclictest41-21ksoftirqd/312:39:023
103199444,8cyclictest41-21ksoftirqd/311:15:183
103199444,7cyclictest41-21ksoftirqd/310:43:543
103199444,7cyclictest41-21ksoftirqd/310:43:543
103199443,8cyclictest41-21ksoftirqd/310:18:473
103199441,9cyclictest41-21ksoftirqd/310:03:553
276902430,1sleep10-21swapper/112:32:111
276902430,1sleep10-21swapper/112:32:111
1031994337,3cyclictest401ktimersoftd/312:44:563
103199424,7cyclictest41-21ksoftirqd/312:28:553
103199424,7cyclictest41-21ksoftirqd/312:28:553
1031994229,3cyclictest41-21ksoftirqd/310:16:553
1010994219,3cyclictest9-21ksoftirqd/010:38:490
103199415,10cyclictest41-21ksoftirqd/309:48:443
103199413,3cyclictest121rcu_preempt09:14:013
103199412,6cyclictest0-21swapper/312:18:363
103199395,3cyclictest41-21ksoftirqd/310:43:333
1021993828,6cyclictest33-21ksoftirqd/214:23:542
89123111,9sleep20-21swapper/208:58:192
1021993124,4cyclictest33-21ksoftirqd/210:23:322
1021993024,3cyclictest33-21ksoftirqd/213:10:112
1021993023,4cyclictest33-21ksoftirqd/209:05:312
1021993023,4cyclictest33-21ksoftirqd/209:05:312
1016993022,5cyclictest26766-21cut09:48:491
1010992923,3cyclictest9-21ksoftirqd/013:04:030
102199284,3cyclictest121rcu_preempt09:13:492
1021992822,3cyclictest33-21ksoftirqd/213:25:362
1021992822,3cyclictest33-21ksoftirqd/213:18:582
1016992823,3cyclictest25-21ksoftirqd/109:48:321
1016992822,4cyclictest25-21ksoftirqd/112:35:211
1016992822,4cyclictest25-21ksoftirqd/112:35:211
324302270,2sleep00-21swapper/012:39:020
1021992721,3cyclictest33-21ksoftirqd/212:16:102
1021992721,3cyclictest33-21ksoftirqd/209:41:522
1021992720,4cyclictest33-21ksoftirqd/210:00:452
102199271,23cyclictest30334-21unixbench_singl09:54:082
1016992719,5cyclictest13949-21cut09:23:441
1010992721,3cyclictest9-21ksoftirqd/010:24:230
1021992621,3cyclictest33-21ksoftirqd/213:00:592
1021992620,4cyclictest33-21ksoftirqd/212:35:302
1021992620,4cyclictest33-21ksoftirqd/212:35:302
1021992620,3cyclictest33-21ksoftirqd/211:44:172
1021992619,4cyclictest33-21ksoftirqd/213:43:192
1021992619,4cyclictest33-21ksoftirqd/213:05:572
1021992619,4cyclictest33-21ksoftirqd/211:23:392
102199261,21cyclictest25033-21diskmemload12:18:372
1016992621,3cyclictest25-21ksoftirqd/113:18:511
1016992620,4cyclictest25-21ksoftirqd/113:09:091
1016992620,3cyclictest25-21ksoftirqd/109:38:371
1010992620,3cyclictest9-21ksoftirqd/013:18:020
1010992620,3cyclictest9-21ksoftirqd/009:26:030
1010992619,4cyclictest9-21ksoftirqd/010:22:390
102199255,2cyclictest0-21swapper/213:44:392
102199254,2cyclictest0-21swapper/214:16:102
1021992520,3cyclictest33-21ksoftirqd/212:32:302
1021992520,3cyclictest33-21ksoftirqd/212:32:302
1021992518,4cyclictest33-21ksoftirqd/210:54:482
1021992518,4cyclictest33-21ksoftirqd/209:37:322
102199251,5cyclictest2974-21seq10:07:292
102199251,2cyclictest121rcu_preempt13:58:172
102199251,21cyclictest12148-21ssh13:34:142
1016992519,3cyclictest25-21ksoftirqd/113:38:481
1016992519,3cyclictest25-21ksoftirqd/111:09:331
1016992518,4cyclictest25-21ksoftirqd/113:57:471
1016992518,4cyclictest25-21ksoftirqd/110:10:391
1016992518,4cyclictest25-21ksoftirqd/110:08:261
1016992518,4cyclictest25-21ksoftirqd/109:31:411
1010992519,4cyclictest9-21ksoftirqd/014:01:520
1010992519,3cyclictest9-21ksoftirqd/012:27:530
1010992519,3cyclictest9-21ksoftirqd/010:55:510
1010992519,3cyclictest9-21ksoftirqd/010:45:030
1010992519,3cyclictest9-21ksoftirqd/010:45:030
1010992518,4cyclictest9-21ksoftirqd/012:32:220
1010992518,4cyclictest9-21ksoftirqd/012:32:220
1010992518,4cyclictest9-21ksoftirqd/011:29:430
1010992518,4cyclictest9-21ksoftirqd/009:37:580
102199244,3cyclictest121rcu_preempt13:48:582
1021992418,3cyclictest33-21ksoftirqd/214:08:462
1021992418,3cyclictest33-21ksoftirqd/214:08:462
1021992417,4cyclictest33-21ksoftirqd/211:41:182
1021992417,4cyclictest33-21ksoftirqd/210:08:362
102199241,4cyclictest29291-21diskstats11:03:492
102199241,21cyclictest25033-21diskmemload11:10:152
102199241,20cyclictest31380-21ssh11:51:542
102199241,20cyclictest28812-21ssh13:15:102
102199241,20cyclictest25033-21diskmemload12:02:492
102199241,20cyclictest18581-21snmp_o5powerctl14:18:592
102199241,20cyclictest14759-21fschecks_time11:28:522
1021992411,10cyclictest7471-21diskstats12:48:522
1016992419,3cyclictest25-21ksoftirqd/112:38:451
1016992418,4cyclictest25-21ksoftirqd/111:48:501
1016992418,3cyclictest25-21ksoftirqd/110:58:341
1016992418,3cyclictest25-21ksoftirqd/109:57:241
1016992417,4cyclictest25-21ksoftirqd/110:34:441
1016992417,4cyclictest25-21ksoftirqd/109:33:461
1016992416,5cyclictest26747-21find10:59:001
101699241,4cyclictest5892-21snmp_o5powerctl14:04:051
101699241,4cyclictest5892-21snmp_o5powerctl14:04:051
101699241,4cyclictest10074-21snmp_o5powerctl10:24:001
101699241,3cyclictest27043-21ssh13:50:371
101699241,3cyclictest20469-21ssh14:21:451
101699241,20cyclictest23404-21snmp_o5powerctl14:24:071
101699241,20cyclictest17203-21snmp_o5powerctl10:39:041
1010992418,3cyclictest2763-21tr11:58:500
1010992417,4cyclictest9-21ksoftirqd/010:10:420
1010992417,4cyclictest9-21ksoftirqd/009:18:110
1021992317,4cyclictest33-21ksoftirqd/210:36:502
1021992317,3cyclictest33-21ksoftirqd/213:30:522
1021992317,3cyclictest33-21ksoftirqd/211:01:032
1021992317,3cyclictest33-21ksoftirqd/210:49:302
1021992317,3cyclictest33-21ksoftirqd/210:49:302
1021992316,4cyclictest4257-21ssh14:03:392
1021992316,4cyclictest4257-21ssh14:03:392
1021992316,4cyclictest33-21ksoftirqd/209:44:352
1021992316,4cyclictest33-21ksoftirqd/209:29:492
1021992316,4cyclictest33-21ksoftirqd/208:59:142
1021992316,4cyclictest33-21ksoftirqd/208:59:142
102199231,4cyclictest26163-21dpkg09:48:362
102199231,20cyclictest0-21swapper/212:13:062
102199230,21cyclictest0-21swapper/209:23:482
1016992317,3cyclictest25-21ksoftirqd/111:46:481
1016992316,4cyclictest25-21ksoftirqd/114:00:321
1016992316,4cyclictest25-21ksoftirqd/111:18:361
1016992316,4cyclictest23734-21sh13:48:371
1016992316,4cyclictest14750-21grep11:28:521
1016992315,5cyclictest12745-21sh12:11:051
101699231,4cyclictest3454-21sensors_temp11:58:541
1010992318,3cyclictest9-21ksoftirqd/010:53:060
1010992318,3cyclictest9-21ksoftirqd/010:53:060
1010992317,3cyclictest9-21ksoftirqd/009:59:410
1010992317,3cyclictest9-21ksoftirqd/008:59:170
1010992317,3cyclictest9-21ksoftirqd/008:59:170
1010992316,4cyclictest9-21ksoftirqd/013:26:020
1010992316,4cyclictest9-21ksoftirqd/010:15:280
1010992316,4cyclictest32735-21idleruntime-cro11:08:340
101099231,19cyclictest0-21swapper/013:45:110
102199224,16cyclictest11811-21fschecks_time09:18:522
102199221,3cyclictest200822sleep210:46:092
102199221,3cyclictest200822sleep210:46:092
102199220,4cyclictest6096-21ssh11:18:212
102199220,19cyclictest25033-21diskmemload12:43:422
101699223,16cyclictest29708-21sed11:03:521
1016992216,4cyclictest25-21ksoftirqd/111:18:281
1016992216,3cyclictest25-21ksoftirqd/113:29:011
1016992216,3cyclictest25-21ksoftirqd/111:28:261
1016992216,3cyclictest25-21ksoftirqd/109:20:111
1016992215,4cyclictest7998-21sh12:48:561
1016992215,4cyclictest20429-21sendmail_mailtr13:04:011
101699221,18cyclictest0-21swapper/110:48:501
101699221,18cyclictest0-21swapper/110:48:501
101699220,19cyclictest11714-21sh12:54:071
1010992217,3cyclictest9-21ksoftirqd/011:18:470
1010992216,3cyclictest9-21ksoftirqd/011:36:420
1010992216,3cyclictest9-21ksoftirqd/010:35:060
1010992216,3cyclictest9-21ksoftirqd/010:28:410
1010992216,3cyclictest9-21ksoftirqd/010:08:330
1010992216,3cyclictest9-21ksoftirqd/009:09:110
1010992216,3cyclictest9-21ksoftirqd/009:05:310
1010992216,3cyclictest9-21ksoftirqd/009:05:310
1010992215,4cyclictest9-21ksoftirqd/009:49:590
1010992215,4cyclictest32635-21ssh11:54:320
101099221,18cyclictest25033-21diskmemload14:03:410
101099221,18cyclictest25033-21diskmemload14:03:410
101099221,18cyclictest12264-21chrt14:10:550
101099221,18cyclictest12264-21chrt14:10:550
101099220,19cyclictest15601-21ssh14:16:310
102199219,9cyclictest18067-21ssh11:33:412
1021992115,3cyclictest6627-21/usr/sbin/munin09:08:512
1021992115,3cyclictest33-21ksoftirqd/210:15:362
1021992115,3cyclictest1735-21ssh13:59:292
1021992114,4cyclictest33-21ksoftirqd/211:58:242
1021992114,4cyclictest33-21ksoftirqd/210:30:272
102199210,4cyclictest12072-21ssh12:54:532
101699212,16cyclictest16834-21fschecks_count12:18:481
1016992116,3cyclictest25-21ksoftirqd/109:16:151
1016992115,3cyclictest25-21ksoftirqd/110:45:261
1016992115,3cyclictest25-21ksoftirqd/110:45:261
101699211,4cyclictest6240-21df12:03:501
1016992114,4cyclictest25-21ksoftirqd/110:32:231
1016992114,4cyclictest25-21ksoftirqd/110:15:451
1016992114,4cyclictest25-21ksoftirqd/109:13:181
1016992114,4cyclictest15633-21sh12:17:241
1016992114,4cyclictest15325-21sh14:16:021
1016992114,4cyclictest13122-21sh13:36:261
101699211,18cyclictest0-21swapper/114:08:411
101699211,18cyclictest0-21swapper/114:08:411
101699211,17cyclictest6367-21apt-get10:18:441
101699211,17cyclictest17243-21ssh13:00:451
101699210,18cyclictest3150-21taskset09:01:061
101699210,18cyclictest3150-21taskset09:01:061
1010992116,3cyclictest9-21ksoftirqd/009:20:170
1010992114,4cyclictest7440-21expr12:48:510
1010992114,4cyclictest47350irq/99-ens3-TxR13:29:010
1010992114,4cyclictest3541-21sh11:12:220
1010992114,4cyclictest29092-21grep09:53:500
1010992114,4cyclictest26950-21ssh13:50:270
1010992114,4cyclictest2668-21/usr/sbin/munin12:44:050
1010992114,4cyclictest21374-21expr09:38:490
1010992114,4cyclictest12080-21sh12:54:550
101099211,18cyclictest0-21swapper/013:33:500
101099210,18cyclictest17697-21sh13:01:420
1021992012,4cyclictest16697-21cut10:38:562
1016992014,3cyclictest3803-21cat09:03:341
1016992014,3cyclictest3803-21cat09:03:341
101699201,3cyclictest5717-21ssh13:25:301
1016992013,4cyclictest20736-21cat12:23:521
1016992013,4cyclictest18166-21sh11:34:021
1016992013,3cyclictest22250-21sh11:39:151
101699200,18cyclictest0-21swapper/110:00:171
1010992015,2cyclictest9-21ksoftirqd/011:25:100
1010992014,4cyclictest9-21ksoftirqd/012:35:360
1010992014,4cyclictest9-21ksoftirqd/012:35:360
1010992014,3cyclictest28022-21sh11:01:200
1010992014,3cyclictest23633-21/usr/sbin/munin09:43:480
1010992014,3cyclictest22120-21sh14:23:550
1010992014,3cyclictest16620-21cpuspeed_turbos12:18:460
1010992014,3cyclictest10009-21/usr/sbin/munin12:08:470
1010992013,4cyclictest19687-21sh14:20:200
1010992013,4cyclictest15110-21sed13:38:500
1010992013,4cyclictest14945-21sh12:15:490
101099201,16cyclictest26089-21grep11:44:080
101099201,16cyclictest21804-21snmp_o5powerctl11:39:000
101099200,18cyclictest0-21swapper/009:33:250
101099200,17cyclictest79992chrt12:04:360
1021991915,2cyclictest0-21swapper/210:25:062
1016991913,3cyclictest28026-21sh13:13:381
1016991912,4cyclictest543-21sh11:55:231
1010991913,3cyclictest1378-21sh13:21:080
1010991912,4cyclictest6014-21sh11:18:100
101099191,16cyclictest0-21swapper/013:09:260
101099190,3cyclictest29896-21gzip11:48:580
101099190,18cyclictest0-21swapper/013:53:410
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional