You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-17 - 00:34

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackcslot8s.osadl.org (updated Sun Aug 16, 2026 12:46:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2972226151,6sleep20-21swapper/207:05:582
282052610,1sleep341-21ksoftirqd/312:23:363
111391610,5ptp4l0-21swapper/407:08:514
111391600,6ptp4l0-21swapper/007:08:570
247392590,0sleep60-21swapper/611:30:436
15212580,0sleep60-21swapper/612:30:186
266262550,0sleep00-21swapper/010:01:370
1881915532,7phc2sys0-21swapper/107:05:021
2994725432,7sleep30-21swapper/307:08:483
169322540,0sleep40-21swapper/409:00:134
2982624938,6sleep70-21swapper/707:07:167
2970724737,6sleep50-21swapper/507:05:455
2987224635,7sleep60-21swapper/607:07:556
111391350,6ptp4l0-21swapper/411:43:594
111391350,0ptp4l0-21swapper/011:30:130
111391340,5ptp4l0-21swapper/011:17:570
111391340,0ptp4l0-21swapper/511:34:325
111391330,2ptp4l0-21swapper/011:28:010
111391330,0ptp4l0-21swapper/010:19:520
111391320,0ptp4l0-21swapper/510:50:545
111391320,0ptp4l0-21swapper/510:14:105
111391320,0ptp4l0-21swapper/412:22:334
111391320,0ptp4l0-21swapper/410:12:014
111391320,0ptp4l0-21swapper/310:33:483
111391320,0ptp4l0-21swapper/010:39:020
111391310,0ptp4l0-21swapper/510:44:255
111391310,0ptp4l0-21swapper/412:37:254
111391310,0ptp4l0-21swapper/410:52:424
111391310,0ptp4l0-21swapper/409:33:374
111391310,0ptp4l0-21swapper/409:14:264
111391310,0ptp4l0-21swapper/011:52:010
111391310,0ptp4l0-21swapper/010:55:090
111391310,0ptp4l0-21swapper/010:45:220
111391310,0ptp4l0-21swapper/008:35:200
111391300,2ptp4l0-21swapper/411:36:214
111391300,0ptp4l0-21swapper/412:04:344
111391300,0ptp4l0-21swapper/409:43:084
111391300,0ptp4l0-21swapper/209:40:232
111391300,0ptp4l0-21swapper/111:52:341
111391300,0ptp4l0-21swapper/011:36:400
111391290,0ptp4l0-21swapper/512:18:475
111391290,0ptp4l0-21swapper/511:36:585
111391290,0ptp4l0-21swapper/510:27:495
111391290,0ptp4l0-21swapper/510:00:475
111391290,0ptp4l0-21swapper/412:25:544
111391290,0ptp4l0-21swapper/410:59:524
111391290,0ptp4l0-21swapper/410:48:194
111391290,0ptp4l0-21swapper/410:41:304
111391290,0ptp4l0-21swapper/409:47:224
111391290,0ptp4l0-21swapper/112:05:131
111391290,0ptp4l0-21swapper/110:13:121
111391290,0ptp4l0-21swapper/011:07:580
111391290,0ptp4l0-21swapper/009:47:320
111391290,0ptp4l0-21swapper/009:36:130
111391280,0ptp4l481ktimersoftd/410:30:224
111391280,0ptp4l0-21swapper/411:31:454
111391280,0ptp4l0-21swapper/411:14:534
111391280,0ptp4l0-21swapper/411:01:044
111391280,0ptp4l0-21swapper/410:35:584
111391280,0ptp4l0-21swapper/410:02:574
111391280,0ptp4l0-21swapper/309:21:483
111391280,0ptp4l0-21swapper/012:30:510
111391280,0ptp4l0-21swapper/010:53:180
111391280,0ptp4l0-21swapper/010:08:370
111391270,0ptp4l0-21swapper/512:09:015
111391270,0ptp4l0-21swapper/509:19:145
111391270,0ptp4l0-21swapper/509:19:145
111391270,0ptp4l0-21swapper/411:59:234
111391270,0ptp4l0-21swapper/411:59:224
111391270,0ptp4l0-21swapper/409:15:404
111391270,0ptp4l0-21swapper/409:15:394
111391270,0ptp4l0-21swapper/310:57:143
111391270,0ptp4l0-21swapper/012:27:030
111391270,0ptp4l0-21swapper/011:57:340
111391270,0ptp4l0-21swapper/011:57:340
111391270,0ptp4l0-21swapper/009:15:170
111391270,0ptp4l0-21swapper/009:15:170
111391260,3ptp4l0-21swapper/009:30:320
111391260,1ptp4l30486-21sadc08:20:004
111391260,1ptp4l0-21swapper/009:25:510
111391260,1ptp4l0-21swapper/007:40:120
111391260,0ptp4l0-21swapper/612:00:306
111391260,0ptp4l0-21swapper/510:49:285
111391260,0ptp4l0-21swapper/510:09:295
111391260,0ptp4l0-21swapper/411:46:384
111391260,0ptp4l0-21swapper/411:08:354
111391260,0ptp4l0-21swapper/410:07:254
111391260,0ptp4l0-21swapper/409:59:094
111391260,0ptp4l0-21swapper/407:50:114
111391260,0ptp4l0-21swapper/012:17:310
111391260,0ptp4l0-21swapper/012:07:290
111391260,0ptp4l0-21swapper/012:04:440
111391260,0ptp4l0-21swapper/010:41:340
111391260,0ptp4l0-21swapper/009:42:340
111391260,0ptp4l0-21swapper/009:10:550
111391260,0ptp4l0-21swapper/007:25:160
111391250,1ptp4l14647-21cut07:45:005
111391250,0ptp4l0-21swapper/611:02:366
111391250,0ptp4l0-21swapper/509:57:385
111391250,0ptp4l0-21swapper/509:03:485
111391250,0ptp4l0-21swapper/508:44:005
111391250,0ptp4l0-21swapper/508:17:465
111391250,0ptp4l0-21swapper/508:06:175
111391250,0ptp4l0-21swapper/508:00:205
111391250,0ptp4l0-21swapper/412:33:384
111391250,0ptp4l0-21swapper/411:26:374
111391250,0ptp4l0-21swapper/411:20:354
111391250,0ptp4l0-21swapper/410:23:484
111391250,0ptp4l0-21swapper/409:25:194
111391250,0ptp4l0-21swapper/409:09:404
111391250,0ptp4l0-21swapper/408:50:274
111391250,0ptp4l0-21swapper/407:20:124
111391250,0ptp4l0-21swapper/111:55:361
111391250,0ptp4l0-21swapper/111:55:351
111391250,0ptp4l0-21swapper/111:35:001
111391250,0ptp4l0-21swapper/110:55:161
111391250,0ptp4l0-21swapper/110:29:441
111391250,0ptp4l0-21swapper/109:54:191
111391250,0ptp4l0-21swapper/012:23:110
111391250,0ptp4l0-21swapper/012:12:160
111391250,0ptp4l0-21swapper/011:46:150
111391250,0ptp4l0-21swapper/011:43:480
111391250,0ptp4l0-21swapper/011:21:080
111391250,0ptp4l0-21swapper/011:12:480
111391250,0ptp4l0-21swapper/010:10:190
111391250,0ptp4l0-21swapper/009:50:180
111391250,0ptp4l0-21swapper/009:24:530
111391250,0ptp4l0-21swapper/008:46:450
111391250,0ptp4l0-21swapper/007:30:500
111391240,3ptp4l0-21swapper/408:07:074
111391240,1ptp4l8202-21df07:30:124
111391240,1ptp4l4633-21/usr/sbin/munin08:30:214
111391240,1ptp4l28499-21latency_hist09:20:011
111391240,1ptp4l28499-21latency_hist09:20:001
111391240,1ptp4l10490-21df07:35:121
111391240,0ptp4l21070-21diskmemload10:44:581
111391240,0ptp4l0-21swapper/512:10:185
111391240,0ptp4l0-21swapper/511:55:175
111391240,0ptp4l0-21swapper/511:55:175
111391240,0ptp4l0-21swapper/511:25:215
111391240,0ptp4l0-21swapper/511:15:205
111391240,0ptp4l0-21swapper/511:05:135
111391240,0ptp4l0-21swapper/509:50:525
111391240,0ptp4l0-21swapper/508:45:125
111391240,0ptp4l0-21swapper/508:38:485
111391240,0ptp4l0-21swapper/507:45:375
111391240,0ptp4l0-21swapper/412:11:544
111391240,0ptp4l0-21swapper/409:35:404
111391240,0ptp4l0-21swapper/408:35:204
111391240,0ptp4l0-21swapper/408:27:374
111391240,0ptp4l0-21swapper/407:58:564
111391240,0ptp4l0-21swapper/407:25:034
111391240,0ptp4l0-21swapper/407:16:044
111391240,0ptp4l0-21swapper/407:11:524
111391240,0ptp4l0-21swapper/210:35:172
111391240,0ptp4l0-21swapper/112:20:151
111391240,0ptp4l0-21swapper/108:55:201
111391240,0ptp4l0-21swapper/012:38:050
111391240,0ptp4l0-21swapper/009:01:210
111391240,0ptp4l0-21swapper/008:55:170
111391240,0ptp4l0-21swapper/008:50:130
111391240,0ptp4l0-21swapper/008:40:180
111391240,0ptp4l0-21swapper/008:29:060
111391240,0ptp4l0-21swapper/008:20:030
111391240,0ptp4l0-21swapper/008:05:130
111391240,0ptp4l0-21swapper/007:55:130
111391240,0ptp4l0-21swapper/007:51:020
111391240,0ptp4l0-21swapper/007:13:260
30349992317,4cyclictest8706-21awk11:10:006
111391230,1ptp4l21070-21diskmemload11:18:424
111391230,0ptp4l11667-21ssh10:25:220
111391230,0ptp4l0-21swapper/710:34:417
111391230,0ptp4l0-21swapper/709:21:297
111391230,0ptp4l0-21swapper/609:36:436
111391230,0ptp4l0-21swapper/608:05:006
111391230,0ptp4l0-21swapper/512:20:165
111391230,0ptp4l0-21swapper/510:55:125
111391230,0ptp4l0-21swapper/510:30:125
111391230,0ptp4l0-21swapper/510:22:415
111391230,0ptp4l0-21swapper/509:40:165
111391230,0ptp4l0-21swapper/509:25:005
111391230,0ptp4l0-21swapper/509:10:125
111391230,0ptp4l0-21swapper/509:05:075
111391230,0ptp4l0-21swapper/508:55:205
111391230,0ptp4l0-21swapper/508:10:175
111391230,0ptp4l0-21swapper/412:15:154
111391230,0ptp4l0-21swapper/412:05:214
111391230,0ptp4l0-21swapper/411:50:164
111391230,0ptp4l0-21swapper/410:25:154
111391230,0ptp4l0-21swapper/409:24:454
111391230,0ptp4l0-21swapper/408:55:164
111391230,0ptp4l0-21swapper/408:45:154
111391230,0ptp4l0-21swapper/408:20:214
111391230,0ptp4l0-21swapper/210:45:142
111391230,0ptp4l0-21swapper/112:19:361
111391230,0ptp4l0-21swapper/112:10:121
111391230,0ptp4l0-21swapper/111:47:231
111391230,0ptp4l0-21swapper/111:25:131
111391230,0ptp4l0-21swapper/111:00:221
111391230,0ptp4l0-21swapper/110:23:561
111391230,0ptp4l0-21swapper/110:00:151
111391230,0ptp4l0-21swapper/109:55:121
111391230,0ptp4l0-21swapper/109:48:531
111391230,0ptp4l0-21swapper/109:40:131
111391230,0ptp4l0-21swapper/109:35:201
111391230,0ptp4l0-21swapper/109:29:071
111391230,0ptp4l0-21swapper/109:20:131
111391230,0ptp4l0-21swapper/109:10:171
111391230,0ptp4l0-21swapper/109:05:171
111391230,0ptp4l0-21swapper/108:10:131
111391230,0ptp4l0-21swapper/108:05:151
111391230,0ptp4l0-21swapper/011:01:260
111391230,0ptp4l0-21swapper/010:20:180
111391230,0ptp4l0-21swapper/009:55:210
111391230,0ptp4l0-21swapper/007:20:120
111391230,0ptp4l0-21swapper/007:15:150
111391220,0ptp4l0-21swapper/710:56:587
111391220,0ptp4l0-21swapper/710:21:027
111391220,0ptp4l0-21swapper/611:41:046
111391220,0ptp4l0-21swapper/610:45:156
111391220,0ptp4l0-21swapper/607:35:476
111391220,0ptp4l0-21swapper/512:30:055
111391220,0ptp4l0-21swapper/512:28:295
111391220,0ptp4l0-21swapper/512:00:365
111391220,0ptp4l0-21swapper/511:22:445
111391220,0ptp4l0-21swapper/511:12:555
111391220,0ptp4l0-21swapper/509:49:025
111391220,0ptp4l0-21swapper/509:37:105
111391220,0ptp4l0-21swapper/507:35:205
111391220,0ptp4l0-21swapper/410:15:014
111391220,0ptp4l0-21swapper/409:50:194
111391220,0ptp4l0-21swapper/408:40:144
111391220,0ptp4l0-21swapper/407:40:114
111391220,0ptp4l0-21swapper/309:43:573
111391220,0ptp4l0-21swapper/212:15:182
111391220,0ptp4l0-21swapper/212:14:032
111391220,0ptp4l0-21swapper/210:15:232
111391220,0ptp4l0-21swapper/112:35:001
111391220,0ptp4l0-21swapper/112:30:121
111391220,0ptp4l0-21swapper/111:35:131
111391220,0ptp4l0-21swapper/111:20:131
111391220,0ptp4l0-21swapper/111:15:241
111391220,0ptp4l0-21swapper/111:05:101
111391220,0ptp4l0-21swapper/110:50:131
111391220,0ptp4l0-21swapper/108:00:141
111391220,0ptp4l0-21swapper/107:34:201
111391220,0ptp4l0-21swapper/010:30:170
111391220,0ptp4l0-21swapper/009:07:550
111391220,0ptp4l0-21swapper/008:30:200
111391220,0ptp4l0-21swapper/008:15:200
111391220,0ptp4l0-21swapper/007:37:030
111391210,0ptp4l0-21swapper/709:43:587
111391210,0ptp4l0-21swapper/611:23:446
111391210,0ptp4l0-21swapper/610:35:196
111391210,0ptp4l0-21swapper/512:35:585
111391210,0ptp4l0-21swapper/511:54:565
111391210,0ptp4l0-21swapper/509:26:425
111391210,0ptp4l0-21swapper/310:21:043
111391210,0ptp4l0-21swapper/309:25:463
111391210,0ptp4l0-21swapper/307:59:103
111391210,0ptp4l0-21swapper/211:41:002
111391210,0ptp4l0-21swapper/211:23:522
111391210,0ptp4l0-21swapper/208:05:012
111391210,0ptp4l0-21swapper/112:25:081
111391210,0ptp4l0-21swapper/112:01:111
111391210,0ptp4l0-21swapper/111:13:071
111391210,0ptp4l0-21swapper/110:49:111
111391210,0ptp4l0-21swapper/110:37:201
111391210,0ptp4l0-21swapper/110:30:031
111391210,0ptp4l0-21swapper/110:09:181
111391210,0ptp4l0-21swapper/108:49:391
111391210,0ptp4l0-21swapper/107:40:111
111391210,0ptp4l0-21swapper/008:12:080
111391200,1ptp4l641ktimersoftd/608:37:366
111391200,0ptp4l0-21swapper/709:25:477
111391200,0ptp4l0-21swapper/612:29:056
111391200,0ptp4l0-21swapper/611:10:536
111391200,0ptp4l0-21swapper/511:04:315
111391200,0ptp4l0-21swapper/510:38:465
111391200,0ptp4l0-21swapper/510:19:475
111391200,0ptp4l0-21swapper/508:34:555
111391200,0ptp4l0-21swapper/507:56:005
111391200,0ptp4l0-21swapper/507:16:265
111391200,0ptp4l0-21swapper/310:12:243
111391200,0ptp4l0-21swapper/212:29:112
111391200,0ptp4l0-21swapper/211:01:472
111391200,0ptp4l0-21swapper/208:54:272
111391200,0ptp4l0-21swapper/207:35:502
111391200,0ptp4l0-21swapper/108:43:011
111391200,0ptp4l0-21swapper/108:38:001
111391200,0ptp4l0-21swapper/107:23:271
111391200,0ptp4l0-21swapper/107:18:221
111391200,0ptp4l0-21swapper/008:01:000
111391190,0ptp4l0-21swapper/609:34:286
111391190,0ptp4l0-21swapper/507:25:595
111391190,0ptp4l0-21swapper/507:10:125
111391190,0ptp4l0-21swapper/408:01:264
111391190,0ptp4l0-21swapper/407:45:134
111391190,0ptp4l0-21swapper/308:26:263
111391180,2ptp4l0-21swapper/108:52:591
111391180,0ptp4l0-21swapper/710:12:257
111391180,0ptp4l0-21swapper/511:47:035
111391180,0ptp4l0-21swapper/511:44:095
111391180,0ptp4l0-21swapper/408:12:094
111391180,0ptp4l0-21swapper/212:00:302
111391180,0ptp4l0-21swapper/209:36:392
111391180,0ptp4l0-21swapper/110:19:351
111391180,0ptp4l0-21swapper/109:33:041
111391170,2ptp4l0-21swapper/108:34:371
111391170,2ptp4l0-21swapper/107:53:431
111391170,0ptp4l0-21swapper/612:14:026
111391170,0ptp4l0-21swapper/211:10:512
111391170,0ptp4l0-21swapper/209:34:282
111391170,0ptp4l0-21swapper/111:44:261
111391170,0ptp4l0-21swapper/007:45:130
111391160,1ptp4l1061-21snmpd07:12:331
111391160,0ptp4l0-21swapper/610:30:536
111391160,0ptp4l0-21swapper/507:34:315
111391160,0ptp4l0-21swapper/507:23:255
111391160,0ptp4l0-21swapper/407:35:574
111391160,0ptp4l0-21swapper/210:30:522
111391160,0ptp4l0-21swapper/209:01:292
111391160,0ptp4l0-21swapper/108:20:241
111391160,0ptp4l0-21swapper/107:47:311
30349991513,1cyclictest0-21swapper/609:55:116
111391150,1ptp4l0-21swapper/608:24:116
111391150,0ptp4l0-21swapper/707:59:057
111391150,0ptp4l0-21swapper/609:07:136
111391150,0ptp4l0-21swapper/608:52:466
111391150,0ptp4l0-21swapper/608:05:036
111391150,0ptp4l0-21swapper/607:26:436
111391150,0ptp4l0-21swapper/607:22:036
111391150,0ptp4l0-21swapper/607:19:006
111391150,0ptp4l0-21swapper/508:51:215
111391150,0ptp4l0-21swapper/508:20:265
111391150,0ptp4l0-21swapper/507:53:435
111391150,0ptp4l0-21swapper/208:28:402
111391150,0ptp4l0-21swapper/208:04:592
111391150,0ptp4l0-21swapper/207:22:042
111391150,0ptp4l0-21swapper/207:19:032
111391150,0ptp4l0-21swapper/109:01:331
111391150,0ptp4l0-21swapper/108:28:001
111391150,0ptp4l0-21swapper/108:16:301
111391150,0ptp4l0-21swapper/107:55:021
111391150,0ptp4l0-21swapper/107:25:531
30328991411,2cyclictest17225-21munin-run09:50:003
111391140,0ptp4l0-21swapper/708:26:207
111391140,0ptp4l0-21swapper/609:40:236
111391140,0ptp4l0-21swapper/209:07:122
111391140,0ptp4l0-21swapper/208:37:372
111391140,0ptp4l0-21swapper/208:24:092
111391140,0ptp4l0-21swapper/208:15:522
111391140,0ptp4l0-21swapper/207:26:412
3035699122,7cyclictest110891getstats08:46:277
3035699121,10cyclictest0-21swapper/711:00:277
3035699119,1cyclictest0-21swapper/711:49:307
3035699119,1cyclictest0-21swapper/709:15:197
3035699119,1cyclictest0-21swapper/709:15:197
30356991110,0cyclictest721ktimersoftd/710:43:297
30356991110,0cyclictest721ktimersoftd/710:39:147
30356991110,0cyclictest0-21swapper/712:20:517
3032899110,10cyclictest0-21swapper/310:42:453
3035699109,0cyclictest721ktimersoftd/710:45:597
3035699109,0cyclictest0-21swapper/711:30:577
3035699107,0cyclictest110891getstats09:38:487
3035699107,0cyclictest110891getstats08:56:457
3035699100,9cyclictest0-21swapper/712:07:437
3035699100,9cyclictest0-21swapper/711:13:307
3035699100,9cyclictest0-21swapper/707:30:017
3034999109,0cyclictest0-21swapper/610:02:556
3034999109,0cyclictest0-21swapper/609:23:096
3034999109,0cyclictest0-21swapper/608:55:216
3034999100,9cyclictest0-21swapper/612:22:296
3034999100,9cyclictest0-21swapper/610:18:096
3034999100,9cyclictest0-21swapper/609:14:026
3034999100,0cyclictest0-21swapper/611:45:146
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional