You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-19 - 16:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackcslot8s.osadl.org (updated Thu Mar 19, 2026 12:46:08)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
111391760,29ptp4l0-21swapper/207:05:142
111391690,35ptp4l0-21swapper/007:08:260
246382660,0sleep00-21swapper/008:10:000
111391620,5ptp4l0-21swapper/707:05:457
111391620,25ptp4l0-21swapper/107:05:161
111391610,30ptp4l0-21swapper/307:05:303
38822580,0sleep50-21swapper/510:16:125
234022550,1sleep323403-21latency_hist10:00:003
199522540,0sleep10-21swapper/108:00:001
2843625139,7sleep60-21swapper/607:08:486
111391510,5ptp4l0-21swapper/407:09:574
111391490,5ptp4l0-21swapper/507:05:275
111391350,0ptp4l0-21swapper/712:18:147
111391340,0ptp4l0-21swapper/510:28:455
111391330,0ptp4l0-21swapper/509:20:135
111391330,0ptp4l0-21swapper/212:35:182
111391330,0ptp4l0-21swapper/009:59:170
111391330,0ptp4l0-21swapper/007:45:000
111391320,0ptp4l0-21swapper/512:17:425
111391320,0ptp4l0-21swapper/512:10:175
111391320,0ptp4l0-21swapper/412:01:494
111391320,0ptp4l0-21swapper/111:38:341
111391320,0ptp4l0-21swapper/009:30:150
111391310,1ptp4l11895-21ls08:50:185
111391310,0ptp4l0-21swapper/510:38:205
111391310,0ptp4l0-21swapper/009:25:350
111391300,3ptp4l0-21swapper/009:40:460
111391300,2ptp4l0-21swapper/411:29:594
111391300,0ptp4l0-21swapper/012:16:180
111391300,0ptp4l0-21swapper/011:26:190
111391300,0ptp4l0-21swapper/010:55:190
111391300,0ptp4l0-21swapper/009:22:520
111391290,0ptp4l0-21swapper/412:22:324
111391290,0ptp4l0-21swapper/411:13:234
111391290,0ptp4l0-21swapper/410:03:534
111391290,0ptp4l0-21swapper/011:14:460
111391290,0ptp4l0-21swapper/010:43:150
111391290,0ptp4l0-21swapper/010:12:370
111391290,0ptp4l0-21swapper/010:09:560
111391290,0ptp4l0-21swapper/009:47:510
111391280,2ptp4l0-21swapper/011:33:120
111391280,0ptp4l0-21swapper/508:25:195
111391280,0ptp4l0-21swapper/410:23:394
111391280,0ptp4l0-21swapper/409:47:524
111391280,0ptp4l0-21swapper/409:23:524
111391280,0ptp4l0-21swapper/112:38:491
111391280,0ptp4l0-21swapper/109:55:131
111391280,0ptp4l0-21swapper/012:30:040
111391280,0ptp4l0-21swapper/012:21:030
111391280,0ptp4l0-21swapper/011:04:550
111391280,0ptp4l0-21swapper/010:23:190
111391280,0ptp4l0-21swapper/009:15:530
111391270,2ptp4l0-21swapper/512:04:325
111391270,0ptp4l0-21swapper/410:32:334
111391270,0ptp4l0-21swapper/410:16:464
111391270,0ptp4l0-21swapper/410:14:094
111391270,0ptp4l0-21swapper/109:10:551
111391270,0ptp4l0-21swapper/011:36:350
111391270,0ptp4l0-21swapper/010:30:060
111391270,0ptp4l0-21swapper/010:17:130
111391260,6ptp4l0-21swapper/010:46:270
111391260,0ptp4l0-21swapper/510:07:545
111391260,0ptp4l0-21swapper/509:10:105
111391260,0ptp4l0-21swapper/508:49:465
111391260,0ptp4l0-21swapper/412:37:534
111391260,0ptp4l0-21swapper/411:51:264
111391260,0ptp4l0-21swapper/411:45:074
111391260,0ptp4l0-21swapper/411:45:074
111391260,0ptp4l0-21swapper/411:05:144
111391260,0ptp4l0-21swapper/410:48:134
111391260,0ptp4l0-21swapper/410:40:124
111391260,0ptp4l0-21swapper/410:26:434
111391260,0ptp4l0-21swapper/109:17:381
111391260,0ptp4l0-21swapper/012:26:250
111391260,0ptp4l0-21swapper/012:08:250
111391260,0ptp4l0-21swapper/009:14:260
111391250,1ptp4l6731-21hddtemp_smartct07:30:101
111391250,1ptp4l6064-21turbostat07:30:001
111391250,1ptp4l30473-21hddtemp_smartct11:40:100
111391250,1ptp4l30473-21hddtemp_smartct11:40:100
111391250,0ptp4l0-21swapper/712:09:187
111391250,0ptp4l0-21swapper/512:38:235
111391250,0ptp4l0-21swapper/509:30:125
111391250,0ptp4l0-21swapper/508:57:005
111391250,0ptp4l0-21swapper/508:05:155
111391250,0ptp4l0-21swapper/507:30:165
111391250,0ptp4l0-21swapper/412:16:014
111391250,0ptp4l0-21swapper/411:36:064
111391250,0ptp4l0-21swapper/411:30:094
111391250,0ptp4l0-21swapper/410:55:314
111391250,0ptp4l0-21swapper/410:09:594
111391250,0ptp4l0-21swapper/409:15:254
111391250,0ptp4l0-21swapper/408:00:134
111391250,0ptp4l0-21swapper/110:30:151
111391250,0ptp4l0-21swapper/109:37:161
111391250,0ptp4l0-21swapper/109:20:171
111391250,0ptp4l0-21swapper/107:54:551
111391250,0ptp4l0-21swapper/012:10:190
111391250,0ptp4l0-21swapper/011:57:090
111391250,0ptp4l0-21swapper/011:18:380
111391250,0ptp4l0-21swapper/010:35:190
111391250,0ptp4l0-21swapper/010:02:020
111391240,3ptp4l641ktimersoftd/612:01:036
111391240,3ptp4l481ktimersoftd/411:18:224
111391240,3ptp4l0-21swapper/011:53:550
111391240,2ptp4l0-21swapper/509:50:225
111391240,1ptp4l31192-21fw_conntrack10:10:105
111391240,1ptp4l25995-21threads08:10:190
111391240,1ptp4l16628-21cat09:00:214
111391240,1ptp4l15646-21fw_forwarded_lo09:00:120
111391240,0ptp4l0-21swapper/511:47:585
111391240,0ptp4l0-21swapper/511:47:585
111391240,0ptp4l0-21swapper/507:40:355
111391240,0ptp4l0-21swapper/412:32:154
111391240,0ptp4l0-21swapper/412:08:584
111391240,0ptp4l0-21swapper/411:57:114
111391240,0ptp4l0-21swapper/411:40:054
111391240,0ptp4l0-21swapper/411:40:044
111391240,0ptp4l0-21swapper/410:53:584
111391240,0ptp4l0-21swapper/410:40:004
111391240,0ptp4l0-21swapper/409:25:124
111391240,0ptp4l0-21swapper/409:05:194
111391240,0ptp4l0-21swapper/409:05:194
111391240,0ptp4l0-21swapper/408:55:144
111391240,0ptp4l0-21swapper/408:45:194
111391240,0ptp4l0-21swapper/408:15:164
111391240,0ptp4l0-21swapper/111:30:131
111391240,0ptp4l0-21swapper/111:20:541
111391240,0ptp4l0-21swapper/111:18:401
111391240,0ptp4l0-21swapper/109:45:061
111391240,0ptp4l0-21swapper/109:32:131
111391240,0ptp4l0-21swapper/109:25:241
111391240,0ptp4l0-21swapper/012:36:490
111391240,0ptp4l0-21swapper/008:45:200
111391240,0ptp4l0-21swapper/008:40:120
111391240,0ptp4l0-21swapper/008:20:110
111391240,0ptp4l0-21swapper/007:35:030
111391240,0ptp4l0-21swapper/007:15:000
111391230,1ptp4l3046-21tail08:30:191
111391230,1ptp4l14071-21ssh12:01:210
111391230,0ptp4l19569-21diskmemload11:00:104
111391230,0ptp4l16731-21cpuspeed_turbos09:50:101
111391230,0ptp4l0-21swapper/711:53:377
111391230,0ptp4l0-21swapper/512:06:385
111391230,0ptp4l0-21swapper/511:20:185
111391230,0ptp4l0-21swapper/510:55:135
111391230,0ptp4l0-21swapper/510:54:105
111391230,0ptp4l0-21swapper/510:50:005
111391230,0ptp4l0-21swapper/510:30:115
111391230,0ptp4l0-21swapper/509:35:165
111391230,0ptp4l0-21swapper/509:27:545
111391230,0ptp4l0-21swapper/508:30:115
111391230,0ptp4l0-21swapper/508:24:175
111391230,0ptp4l0-21swapper/507:50:125
111391230,0ptp4l0-21swapper/507:29:245
111391230,0ptp4l0-21swapper/412:11:064
111391230,0ptp4l0-21swapper/411:24:474
111391230,0ptp4l0-21swapper/409:59:564
111391230,0ptp4l0-21swapper/409:40:134
111391230,0ptp4l0-21swapper/409:37:104
111391230,0ptp4l0-21swapper/409:30:154
111391230,0ptp4l0-21swapper/408:40:204
111391230,0ptp4l0-21swapper/408:26:254
111391230,0ptp4l0-21swapper/408:20:174
111391230,0ptp4l0-21swapper/408:10:164
111391230,0ptp4l0-21swapper/407:45:114
111391230,0ptp4l0-21swapper/407:35:194
111391230,0ptp4l0-21swapper/407:33:094
111391230,0ptp4l0-21swapper/407:25:204
111391230,0ptp4l0-21swapper/407:20:154
111391230,0ptp4l0-21swapper/407:15:074
111391230,0ptp4l0-21swapper/407:14:584
111391230,0ptp4l0-21swapper/311:51:453
111391230,0ptp4l0-21swapper/311:43:373
111391230,0ptp4l0-21swapper/311:43:373
111391230,0ptp4l0-21swapper/112:10:111
111391230,0ptp4l0-21swapper/112:00:021
111391230,0ptp4l0-21swapper/110:38:181
111391230,0ptp4l0-21swapper/110:10:121
111391230,0ptp4l0-21swapper/110:06:361
111391230,0ptp4l0-21swapper/109:44:201
111391230,0ptp4l0-21swapper/108:05:121
111391230,0ptp4l0-21swapper/108:00:101
111391230,0ptp4l0-21swapper/107:10:121
111391230,0ptp4l0-21swapper/011:47:420
111391230,0ptp4l0-21swapper/011:47:420
111391230,0ptp4l0-21swapper/011:20:110
111391230,0ptp4l0-21swapper/011:05:120
111391230,0ptp4l0-21swapper/009:52:490
111391230,0ptp4l0-21swapper/009:05:170
111391230,0ptp4l0-21swapper/009:05:160
111391230,0ptp4l0-21swapper/008:36:260
111391230,0ptp4l0-21swapper/008:32:270
111391230,0ptp4l0-21swapper/008:19:590
111391230,0ptp4l0-21swapper/008:00:190
111391230,0ptp4l0-21swapper/007:55:180
111391220,3ptp4l0-21swapper/511:02:205
111391220,1ptp4l478-21grep08:25:181
111391220,0ptp4l0-21swapper/711:28:587
111391220,0ptp4l0-21swapper/611:36:486
111391220,0ptp4l0-21swapper/511:55:455
111391220,0ptp4l0-21swapper/511:51:095
111391220,0ptp4l0-21swapper/511:35:185
111391220,0ptp4l0-21swapper/511:30:145
111391220,0ptp4l0-21swapper/510:40:285
111391220,0ptp4l0-21swapper/510:21:095
111391220,0ptp4l0-21swapper/510:02:275
111391220,0ptp4l0-21swapper/509:55:115
111391220,0ptp4l0-21swapper/509:45:195
111391220,0ptp4l0-21swapper/509:43:365
111391220,0ptp4l0-21swapper/509:19:005
111391220,0ptp4l0-21swapper/508:13:445
111391220,0ptp4l0-21swapper/507:55:115
111391220,0ptp4l0-21swapper/507:10:135
111391220,0ptp4l0-21swapper/412:25:174
111391220,0ptp4l0-21swapper/409:50:004
111391220,0ptp4l0-21swapper/409:11:054
111391220,0ptp4l0-21swapper/408:35:184
111391220,0ptp4l0-21swapper/408:30:174
111391220,0ptp4l0-21swapper/407:40:204
111391220,0ptp4l0-21swapper/312:18:103
111391220,0ptp4l0-21swapper/311:28:323
111391220,0ptp4l0-21swapper/309:42:543
111391220,0ptp4l0-21swapper/212:25:102
111391220,0ptp4l0-21swapper/211:50:502
111391220,0ptp4l0-21swapper/112:17:541
111391220,0ptp4l0-21swapper/112:05:581
111391220,0ptp4l0-21swapper/111:58:061
111391220,0ptp4l0-21swapper/111:54:001
111391220,0ptp4l0-21swapper/111:48:101
111391220,0ptp4l0-21swapper/111:48:101
111391220,0ptp4l0-21swapper/111:06:271
111391220,0ptp4l0-21swapper/110:50:121
111391220,0ptp4l0-21swapper/110:42:461
111391220,0ptp4l0-21swapper/110:21:071
111391220,0ptp4l0-21swapper/110:18:021
111391220,0ptp4l0-21swapper/110:02:331
111391220,0ptp4l0-21swapper/108:50:181
111391220,0ptp4l0-21swapper/108:24:171
111391220,0ptp4l0-21swapper/108:16:201
111391220,0ptp4l0-21swapper/107:40:131
111391220,0ptp4l0-21swapper/107:36:511
111391220,0ptp4l0-21swapper/010:51:560
111391220,0ptp4l0-21swapper/010:25:130
111391220,0ptp4l0-21swapper/009:35:180
111391220,0ptp4l0-21swapper/008:55:140
111391220,0ptp4l0-21swapper/007:40:120
111391220,0ptp4l0-21swapper/007:30:190
111391220,0ptp4l0-21swapper/007:25:130
111391220,0ptp4l0-21swapper/007:20:150
111391220,0ptp4l0-21swapper/007:15:160
111391210,0ptp4l0-21swapper/711:43:347
111391210,0ptp4l0-21swapper/711:43:347
111391210,0ptp4l0-21swapper/512:32:585
111391210,0ptp4l0-21swapper/512:26:105
111391210,0ptp4l0-21swapper/512:24:155
111391210,0ptp4l0-21swapper/511:15:445
111391210,0ptp4l0-21swapper/511:06:295
111391210,0ptp4l0-21swapper/509:06:455
111391210,0ptp4l0-21swapper/509:06:455
111391210,0ptp4l0-21swapper/508:16:345
111391210,0ptp4l0-21swapper/507:46:005
111391210,0ptp4l0-21swapper/408:50:454
111391210,0ptp4l0-21swapper/408:06:004
111391210,0ptp4l0-21swapper/312:09:003
111391210,0ptp4l0-21swapper/211:02:462
111391210,0ptp4l0-21swapper/112:32:381
111391210,0ptp4l0-21swapper/112:26:031
111391210,0ptp4l0-21swapper/111:40:561
111391210,0ptp4l0-21swapper/111:40:561
111391210,0ptp4l0-21swapper/111:01:341
111391210,0ptp4l0-21swapper/110:58:061
111391210,0ptp4l0-21swapper/110:47:071
111391210,0ptp4l0-21swapper/110:26:031
111391210,0ptp4l0-21swapper/109:09:561
111391210,0ptp4l0-21swapper/109:09:561
111391210,0ptp4l0-21swapper/108:42:351
111391210,0ptp4l0-21swapper/108:10:521
111391200,2ptp4l641ktimersoftd/612:25:066
111391200,0ptp4l0-21swapper/708:27:507
111391200,0ptp4l0-21swapper/511:41:145
111391200,0ptp4l0-21swapper/511:41:135
111391200,0ptp4l0-21swapper/508:42:555
111391200,0ptp4l0-21swapper/508:01:465
111391200,0ptp4l0-21swapper/507:20:535
111391200,0ptp4l0-21swapper/507:17:455
111391200,0ptp4l0-21swapper/210:23:122
111391200,0ptp4l0-21swapper/107:22:011
111391190,0ptp4l0-21swapper/511:14:345
111391190,0ptp4l0-21swapper/507:36:545
111391190,0ptp4l0-21swapper/212:15:082
111391190,0ptp4l0-21swapper/212:01:032
111391190,0ptp4l0-21swapper/108:57:461
111391190,0ptp4l0-21swapper/107:49:441
111391190,0ptp4l0-21swapper/008:54:450
111391180,0ptp4l0-21swapper/709:42:457
111391180,0ptp4l0-21swapper/610:23:116
111391180,0ptp4l0-21swapper/211:13:592
111391170,0ptp4l0-21swapper/712:01:367
111391170,0ptp4l0-21swapper/508:35:215
111391170,0ptp4l0-21swapper/407:55:194
111391170,0ptp4l0-21swapper/308:03:523
111391170,0ptp4l0-21swapper/111:14:351
111391170,0ptp4l0-21swapper/008:29:550
111391160,0ptp4l0-21swapper/710:02:007
111391160,0ptp4l0-21swapper/708:18:097
111391160,0ptp4l0-21swapper/612:35:176
111391160,0ptp4l0-21swapper/308:27:463
111391160,0ptp4l0-21swapper/209:29:312
111391160,0ptp4l0-21swapper/111:29:321
111391160,0ptp4l0-21swapper/108:49:321
111391160,0ptp4l0-21swapper/108:36:561
111391160,0ptp4l0-21swapper/007:51:090
172922150,0sleep20-21swapper/211:20:192
111391150,0ptp4l0-21swapper/708:03:407
111391150,0ptp4l0-21swapper/611:50:496
111391150,0ptp4l0-21swapper/607:19:366
111391150,0ptp4l0-21swapper/407:51:564
111391150,0ptp4l0-21swapper/308:17:043
111391150,0ptp4l0-21swapper/208:59:212
111391150,0ptp4l0-21swapper/112:24:151
111391150,0ptp4l0-21swapper/107:17:381
111391140,0ptp4l0-21swapper/608:59:196
111391140,0ptp4l0-21swapper/607:32:036
111391140,0ptp4l0-21swapper/312:01:373
111391140,0ptp4l0-21swapper/211:36:472
111391140,0ptp4l0-21swapper/207:19:352
2884499110,10cyclictest0-21swapper/612:17:096
2884499110,10cyclictest0-21swapper/611:14:546
2884499110,10cyclictest0-21swapper/609:16:156
28815991110,0cyclictest0-21swapper/209:15:122
2881599110,10cyclictest0-21swapper/211:55:202
2885199100,9cyclictest0-21swapper/709:47:257
2885199100,9cyclictest0-21swapper/709:18:127
2885199100,1cyclictest0-21swapper/712:38:257
2884499109,0cyclictest0-21swapper/611:15:056
2884499100,9cyclictest0-21swapper/610:53:426
2884499100,0cyclictest0-21swapper/611:58:086
2884499100,0cyclictest0-21swapper/610:32:206
2884499100,0cyclictest0-21swapper/610:08:366
2884499100,0cyclictest0-21swapper/609:48:486
2881599100,9cyclictest0-21swapper/212:11:412
2881599100,9cyclictest0-21swapper/209:59:502
2881599100,9cyclictest0-21swapper/209:44:442
30930290,0sleep7711rcuc/709:25:037
288519998,0cyclictest0-21swapper/711:05:137
288519990,8cyclictest0-21swapper/711:47:017
288519990,8cyclictest0-21swapper/711:47:017
288519990,0cyclictest0-21swapper/712:22:047
288519990,0cyclictest0-21swapper/710:26:527
288379990,0cyclictest0-21swapper/509:00:465
288239998,0cyclictest0-21swapper/310:35:203
288239991,2cyclictest0-21swapper/311:25:003
288239990,8cyclictest0-21swapper/311:57:593
288239990,8cyclictest0-21swapper/309:45:493
288239990,8cyclictest0-21swapper/309:22:153
288239990,0cyclictest0-21swapper/310:51:403
288159998,0cyclictest0-21swapper/210:00:082
288159990,8cyclictest0-21swapper/211:17:372
288159990,0cyclictest0-21swapper/210:58:272
288159990,0cyclictest0-21swapper/210:40:132
288519987,0cyclictest0-21swapper/710:05:017
288519982,5cyclictest0-21swapper/711:10:137
288519980,7cyclictest0-21swapper/709:58:057
288519980,7cyclictest0-21swapper/709:34:467
288519980,7cyclictest0-21swapper/708:20:227
288519980,7cyclictest0-21swapper/707:36:367
288519980,3cyclictest0-21swapper/707:55:137
288519980,3cyclictest0-21swapper/707:14:507
288519980,0cyclictest0-21swapper/711:04:537
288519980,0cyclictest0-21swapper/710:46:217
288449987,0cyclictest0-21swapper/608:09:476
288379980,0cyclictest0-21swapper/511:28:075
288239987,0cyclictest0-21swapper/310:19:083
288239982,3cyclictest30483-21kworker/3:010:55:173
288239982,1cyclictest41-21ksoftirqd/310:30:453
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional