You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-21 - 21:23

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackcslot8s.osadl.org (updated Sun Dec 21, 2025 12:46:09)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
111391730,5ptp4l0-21swapper/407:05:134
111391660,33ptp4l0-21swapper/007:05:230
111391620,31ptp4l0-21swapper/107:07:171
724525949,6sleep70-21swapper/707:07:507
111391590,5ptp4l0-21swapper/507:08:475
713125847,7sleep20-21swapper/207:06:172
554925432,17sleep30-21swapper/307:05:123
716225040,6sleep60-21swapper/607:06:456
173962500,0sleep7721ktimersoftd/712:10:157
111391340,0ptp4l0-21swapper/010:55:180
111391330,0ptp4l0-21swapper/009:15:140
111391290,0ptp4l0-21swapper/012:11:590
111391290,0ptp4l0-21swapper/008:50:180
111391290,0ptp4l0-21swapper/008:00:140
111391280,0ptp4l0-21swapper/609:58:116
111391280,0ptp4l0-21swapper/011:50:150
111391260,0ptp4l0-21swapper/107:56:371
111391260,0ptp4l0-21swapper/011:55:120
111391260,0ptp4l0-21swapper/008:45:140
111391250,1ptp4l7875-21idleruntime-cro08:20:000
111391250,1ptp4l26503-21irqstats12:30:174
111391250,1ptp4l26503-21irqstats12:30:164
111391250,0ptp4l0-21swapper/512:33:455
111391250,0ptp4l0-21swapper/512:33:455
111391250,0ptp4l0-21swapper/511:35:155
111391250,0ptp4l0-21swapper/509:32:305
111391250,0ptp4l0-21swapper/407:25:224
111391250,0ptp4l0-21swapper/111:30:211
111391250,0ptp4l0-21swapper/007:35:420
111391240,1ptp4l3566-21expr09:20:120
111391240,1ptp4l28264-21munin-run10:15:000
111391240,1ptp4l27094-21ps09:00:160
111391240,1ptp4l26378-21df_inode11:20:124
111391240,1ptp4l21549-21diskstats12:20:124
111391240,1ptp4l15201-21missed_timers12:05:171
111391240,1ptp4l10326-21diskstats10:45:124
111391240,0ptp4l14184-21smartctl07:20:181
111391240,0ptp4l0-21swapper/710:30:137
111391240,0ptp4l0-21swapper/607:10:186
111391240,0ptp4l0-21swapper/607:10:186
111391240,0ptp4l0-21swapper/511:05:195
111391240,0ptp4l0-21swapper/507:50:175
111391240,0ptp4l0-21swapper/507:45:155
111391240,0ptp4l0-21swapper/507:15:355
111391240,0ptp4l0-21swapper/412:00:184
111391240,0ptp4l0-21swapper/411:55:204
111391240,0ptp4l0-21swapper/410:15:224
111391240,0ptp4l0-21swapper/407:35:014
111391240,0ptp4l0-21swapper/111:35:181
111391240,0ptp4l0-21swapper/110:32:431
111391240,0ptp4l0-21swapper/110:25:121
111391240,0ptp4l0-21swapper/108:55:001
111391240,0ptp4l0-21swapper/108:46:501
111391240,0ptp4l0-21swapper/108:39:531
111391240,0ptp4l0-21swapper/108:30:151
111391240,0ptp4l0-21swapper/107:45:161
111391240,0ptp4l0-21swapper/107:40:201
111391240,0ptp4l0-21swapper/012:15:120
111391240,0ptp4l0-21swapper/010:50:180
111391240,0ptp4l0-21swapper/010:45:150
111391230,1ptp4l5496-21/usr/sbin/munin11:45:120
111391230,1ptp4l28672-21pgrep11:25:131
111391230,1ptp4l2139-21users11:35:224
111391230,0ptp4l0-21swapper/711:50:187
111391230,0ptp4l0-21swapper/512:05:215
111391230,0ptp4l0-21swapper/511:00:195
111391230,0ptp4l0-21swapper/510:49:125
111391230,0ptp4l0-21swapper/510:25:015
111391230,0ptp4l0-21swapper/510:05:235
111391230,0ptp4l0-21swapper/509:55:165
111391230,0ptp4l0-21swapper/509:23:285
111391230,0ptp4l0-21swapper/509:15:215
111391230,0ptp4l0-21swapper/508:50:005
111391230,0ptp4l0-21swapper/508:40:135
111391230,0ptp4l0-21swapper/508:10:175
111391230,0ptp4l0-21swapper/412:15:164
111391230,0ptp4l0-21swapper/411:50:164
111391230,0ptp4l0-21swapper/410:50:154
111391230,0ptp4l0-21swapper/410:00:214
111391230,0ptp4l0-21swapper/409:50:014
111391230,0ptp4l0-21swapper/409:50:014
111391230,0ptp4l0-21swapper/409:45:174
111391230,0ptp4l0-21swapper/409:35:194
111391230,0ptp4l0-21swapper/408:55:194
111391230,0ptp4l0-21swapper/408:50:134
111391230,0ptp4l0-21swapper/407:55:174
111391230,0ptp4l0-21swapper/112:35:121
111391230,0ptp4l0-21swapper/111:00:161
111391230,0ptp4l0-21swapper/110:45:011
111391230,0ptp4l0-21swapper/108:25:141
111391230,0ptp4l0-21swapper/107:20:011
111391230,0ptp4l0-21swapper/012:25:170
111391230,0ptp4l0-21swapper/011:20:160
111391230,0ptp4l0-21swapper/011:15:080
111391230,0ptp4l0-21swapper/011:10:120
111391230,0ptp4l0-21swapper/010:44:110
111391230,0ptp4l0-21swapper/010:20:120
111391230,0ptp4l0-21swapper/010:17:450
111391230,0ptp4l0-21swapper/010:00:000
111391230,0ptp4l0-21swapper/009:35:130
111391230,0ptp4l0-21swapper/009:25:120
111391230,0ptp4l0-21swapper/009:13:160
111391230,0ptp4l0-21swapper/009:05:230
111391230,0ptp4l0-21swapper/008:35:120
111391230,0ptp4l0-21swapper/007:55:150
111391230,0ptp4l0-21swapper/007:50:140
111391230,0ptp4l0-21swapper/007:25:160
111391220,3ptp4l0-21swapper/508:01:485
111391220,2ptp4l0-21swapper/510:56:455
111391220,0ptp4l0-21swapper/712:39:227
111391220,0ptp4l0-21swapper/709:35:017
111391220,0ptp4l0-21swapper/611:40:126
111391220,0ptp4l0-21swapper/611:15:196
111391220,0ptp4l0-21swapper/512:35:125
111391220,0ptp4l0-21swapper/512:25:115
111391220,0ptp4l0-21swapper/512:10:165
111391220,0ptp4l0-21swapper/511:54:165
111391220,0ptp4l0-21swapper/511:25:135
111391220,0ptp4l0-21swapper/511:20:395
111391220,0ptp4l0-21swapper/510:23:135
111391220,0ptp4l0-21swapper/510:19:525
111391220,0ptp4l0-21swapper/508:57:365
111391220,0ptp4l0-21swapper/508:30:135
111391220,0ptp4l0-21swapper/508:25:145
111391220,0ptp4l0-21swapper/508:15:185
111391220,0ptp4l0-21swapper/508:07:175
111391220,0ptp4l0-21swapper/507:55:135
111391220,0ptp4l0-21swapper/507:40:015
111391220,0ptp4l0-21swapper/507:30:185
111391220,0ptp4l0-21swapper/507:20:155
111391220,0ptp4l0-21swapper/412:25:204
111391220,0ptp4l0-21swapper/411:45:124
111391220,0ptp4l0-21swapper/411:40:194
111391220,0ptp4l0-21swapper/411:10:124
111391220,0ptp4l0-21swapper/410:55:174
111391220,0ptp4l0-21swapper/410:40:184
111391220,0ptp4l0-21swapper/410:35:154
111391220,0ptp4l0-21swapper/410:20:134
111391220,0ptp4l0-21swapper/410:10:234
111391220,0ptp4l0-21swapper/409:40:144
111391220,0ptp4l0-21swapper/409:30:174
111391220,0ptp4l0-21swapper/409:25:124
111391220,0ptp4l0-21swapper/409:20:174
111391220,0ptp4l0-21swapper/409:15:174
111391220,0ptp4l0-21swapper/409:10:144
111391220,0ptp4l0-21swapper/409:05:184
111391220,0ptp4l0-21swapper/409:00:114
111391220,0ptp4l0-21swapper/408:05:134
111391220,0ptp4l0-21swapper/408:00:194
111391220,0ptp4l0-21swapper/407:50:134
111391220,0ptp4l0-21swapper/407:45:204
111391220,0ptp4l0-21swapper/407:40:134
111391220,0ptp4l0-21swapper/407:35:124
111391220,0ptp4l0-21swapper/311:50:193
111391220,0ptp4l0-21swapper/311:30:003
111391220,0ptp4l0-21swapper/112:10:111
111391220,0ptp4l0-21swapper/112:05:001
111391220,0ptp4l0-21swapper/111:45:001
111391220,0ptp4l0-21swapper/111:05:131
111391220,0ptp4l0-21swapper/110:40:211
111391220,0ptp4l0-21swapper/110:37:151
111391220,0ptp4l0-21swapper/110:10:161
111391220,0ptp4l0-21swapper/110:05:151
111391220,0ptp4l0-21swapper/110:01:171
111391220,0ptp4l0-21swapper/109:55:191
111391220,0ptp4l0-21swapper/109:23:341
111391220,0ptp4l0-21swapper/109:16:031
111391220,0ptp4l0-21swapper/108:40:171
111391220,0ptp4l0-21swapper/108:15:201
111391220,0ptp4l0-21swapper/108:10:131
111391220,0ptp4l0-21swapper/108:07:011
111391220,0ptp4l0-21swapper/107:50:191
111391220,0ptp4l0-21swapper/107:30:141
111391220,0ptp4l0-21swapper/012:30:210
111391220,0ptp4l0-21swapper/012:30:210
111391220,0ptp4l0-21swapper/012:20:110
111391220,0ptp4l0-21swapper/011:35:210
111391220,0ptp4l0-21swapper/011:26:450
111391220,0ptp4l0-21swapper/010:35:120
111391220,0ptp4l0-21swapper/010:34:110
111391220,0ptp4l0-21swapper/010:00:210
111391220,0ptp4l0-21swapper/009:52:240
111391220,0ptp4l0-21swapper/009:52:240
111391220,0ptp4l0-21swapper/009:45:140
111391220,0ptp4l0-21swapper/009:40:110
111391220,0ptp4l0-21swapper/009:30:140
111391220,0ptp4l0-21swapper/008:55:170
111391220,0ptp4l0-21swapper/008:25:110
111391220,0ptp4l0-21swapper/008:20:130
111391220,0ptp4l0-21swapper/008:05:170
111391220,0ptp4l0-21swapper/007:45:190
111391220,0ptp4l0-21swapper/007:30:220
111391210,0ptp4l0-21swapper/711:30:147
111391210,0ptp4l0-21swapper/512:00:225
111391210,0ptp4l0-21swapper/510:40:135
111391210,0ptp4l0-21swapper/509:51:015
111391210,0ptp4l0-21swapper/509:51:015
111391210,0ptp4l0-21swapper/508:50:205
111391210,0ptp4l0-21swapper/507:39:045
111391210,0ptp4l0-21swapper/411:00:004
111391210,0ptp4l0-21swapper/409:59:124
111391210,0ptp4l0-21swapper/408:45:144
111391210,0ptp4l0-21swapper/408:35:114
111391210,0ptp4l0-21swapper/408:20:134
111391210,0ptp4l0-21swapper/310:30:183
111391210,0ptp4l0-21swapper/212:25:222
111391210,0ptp4l0-21swapper/208:33:052
111391210,0ptp4l0-21swapper/207:10:182
111391210,0ptp4l0-21swapper/207:10:172
111391210,0ptp4l0-21swapper/111:55:411
111391210,0ptp4l0-21swapper/111:40:151
111391210,0ptp4l0-21swapper/110:50:121
111391210,0ptp4l0-21swapper/109:25:201
111391210,0ptp4l0-21swapper/107:39:071
111391210,0ptp4l0-21swapper/107:10:091
111391210,0ptp4l0-21swapper/107:10:091
111391210,0ptp4l0-21swapper/012:00:190
111391210,0ptp4l0-21swapper/011:40:170
111391210,0ptp4l0-21swapper/011:33:290
111391210,0ptp4l0-21swapper/011:08:560
111391210,0ptp4l0-21swapper/011:04:130
111391210,0ptp4l0-21swapper/010:27:110
111391210,0ptp4l0-21swapper/010:09:140
111391210,0ptp4l0-21swapper/008:34:080
111391210,0ptp4l0-21swapper/007:19:360
111391210,0ptp4l0-21swapper/007:12:120
111391210,0ptp4l0-21swapper/007:12:120
111391200,2ptp4l0-21swapper/608:52:446
111391200,2ptp4l0-21swapper/008:10:010
111391200,0ptp4l0-21swapper/612:01:136
111391200,0ptp4l0-21swapper/511:56:125
111391200,0ptp4l0-21swapper/511:30:165
111391200,0ptp4l0-21swapper/511:14:065
111391200,0ptp4l0-21swapper/510:37:125
111391200,0ptp4l0-21swapper/510:31:135
111391200,0ptp4l0-21swapper/412:37:124
111391200,0ptp4l0-21swapper/411:26:124
111391200,0ptp4l0-21swapper/411:17:124
111391200,0ptp4l0-21swapper/410:28:124
111391200,0ptp4l0-21swapper/408:34:284
111391200,0ptp4l0-21swapper/211:15:222
111391200,0ptp4l0-21swapper/210:53:092
111391200,0ptp4l0-21swapper/209:26:112
111391200,0ptp4l0-21swapper/209:24:112
111391200,0ptp4l0-21swapper/112:34:121
111391200,0ptp4l0-21swapper/112:34:121
111391200,0ptp4l0-21swapper/111:16:441
111391200,0ptp4l0-21swapper/110:21:121
111391200,0ptp4l0-21swapper/109:46:221
111391200,0ptp4l0-21swapper/109:41:581
111391200,0ptp4l0-21swapper/108:57:231
111391200,0ptp4l0-21swapper/108:04:121
111391200,0ptp4l0-21swapper/012:08:030
111391190,0ptp4l0-21swapper/711:29:557
111391190,0ptp4l0-21swapper/512:24:135
111391190,0ptp4l0-21swapper/511:44:555
111391190,0ptp4l0-21swapper/509:01:115
111391190,0ptp4l0-21swapper/508:22:105
111391190,0ptp4l0-21swapper/507:13:435
111391190,0ptp4l0-21swapper/507:13:425
111391190,0ptp4l0-21swapper/412:12:134
111391190,0ptp4l0-21swapper/411:31:134
111391190,0ptp4l0-21swapper/411:09:554
111391190,0ptp4l0-21swapper/408:10:114
111391190,0ptp4l0-21swapper/207:29:552
111391190,0ptp4l0-21swapper/111:51:511
111391190,0ptp4l0-21swapper/108:24:271
111391190,0ptp4l0-21swapper/107:26:301
111391190,0ptp4l0-21swapper/007:40:120
111391190,0ptp4l0-21swapper/007:21:280
111391180,0ptp4l0-21swapper/611:24:136
111391180,0ptp4l0-21swapper/509:48:055
111391180,0ptp4l0-21swapper/410:34:124
111391180,0ptp4l0-21swapper/410:09:124
111391180,0ptp4l0-21swapper/408:17:124
111391180,0ptp4l0-21swapper/407:24:274
111391180,0ptp4l0-21swapper/407:10:234
111391180,0ptp4l0-21swapper/407:10:224
111391180,0ptp4l0-21swapper/310:39:003
111391180,0ptp4l0-21swapper/209:17:142
111391180,0ptp4l0-21swapper/207:58:282
111391180,0ptp4l0-21swapper/109:37:261
111391180,0ptp4l0-21swapper/109:01:131
111391170,0ptp4l0-21swapper/509:43:125
111391170,0ptp4l0-21swapper/211:40:142
111391170,0ptp4l0-21swapper/112:29:381
111391170,0ptp4l0-21swapper/111:21:131
111391170,0ptp4l0-21swapper/110:56:311
111391170,0ptp4l0-21swapper/109:33:351
110082170,0sleep50-21swapper/509:35:165
7699991611,4cyclictest25972-21munin-run10:10:003
111391160,0ptp4l0-21swapper/611:54:406
111391160,0ptp4l0-21swapper/610:55:286
111391160,0ptp4l0-21swapper/512:16:195
111391160,0ptp4l0-21swapper/511:45:065
111391160,0ptp4l0-21swapper/510:11:135
111391160,0ptp4l0-21swapper/408:27:134
111391160,0ptp4l0-21swapper/309:35:023
111391160,0ptp4l0-21swapper/109:51:001
111391160,0ptp4l0-21swapper/109:51:001
111391160,0ptp4l0-21swapper/109:10:571
111391150,0ptp4l33-21ksoftirqd/208:38:072
111391150,0ptp4l0-21swapper/711:12:417
111391150,0ptp4l0-21swapper/710:52:167
111391150,0ptp4l0-21swapper/710:39:017
111391150,0ptp4l0-21swapper/612:30:566
111391150,0ptp4l0-21swapper/612:30:566
111391150,0ptp4l0-21swapper/612:25:236
111391150,0ptp4l0-21swapper/612:18:446
111391150,0ptp4l0-21swapper/611:57:146
111391150,0ptp4l0-21swapper/611:45:436
111391150,0ptp4l0-21swapper/611:02:416
111391150,0ptp4l0-21swapper/610:53:106
111391150,0ptp4l0-21swapper/610:47:256
111391150,0ptp4l0-21swapper/610:11:336
111391150,0ptp4l0-21swapper/610:06:596
111391150,0ptp4l0-21swapper/610:02:576
111391150,0ptp4l0-21swapper/609:46:326
111391150,0ptp4l0-21swapper/609:38:456
111391150,0ptp4l0-21swapper/609:25:386
111391150,0ptp4l0-21swapper/609:24:116
111391150,0ptp4l0-21swapper/609:06:346
111391150,0ptp4l0-21swapper/608:59:206
111391150,0ptp4l0-21swapper/608:33:066
111391150,0ptp4l0-21swapper/607:58:226
111391150,0ptp4l0-21swapper/607:43:526
111391150,0ptp4l0-21swapper/607:33:576
111391150,0ptp4l0-21swapper/607:24:186
111391150,0ptp4l0-21swapper/607:19:016
111391150,0ptp4l0-21swapper/511:15:385
111391150,0ptp4l0-21swapper/510:50:025
111391150,0ptp4l0-21swapper/510:00:525
111391150,0ptp4l0-21swapper/509:25:175
111391150,0ptp4l0-21swapper/509:13:485
111391150,0ptp4l0-21swapper/509:07:175
111391150,0ptp4l0-21swapper/508:38:045
111391150,0ptp4l0-21swapper/507:26:235
111391150,0ptp4l0-21swapper/412:05:364
111391150,0ptp4l0-21swapper/408:40:314
111391150,0ptp4l0-21swapper/407:15:514
111391150,0ptp4l0-21swapper/312:39:233
111391150,0ptp4l0-21swapper/311:30:133
111391150,0ptp4l0-21swapper/311:12:473
111391150,0ptp4l0-21swapper/310:52:153
111391150,0ptp4l0-21swapper/212:18:402
111391150,0ptp4l0-21swapper/211:45:422
111391150,0ptp4l0-21swapper/211:24:112
111391150,0ptp4l0-21swapper/211:02:362
111391150,0ptp4l0-21swapper/210:55:442
111391150,0ptp4l0-21swapper/210:11:352
111391150,0ptp4l0-21swapper/210:07:082
111391150,0ptp4l0-21swapper/209:08:272
111391150,0ptp4l0-21swapper/208:24:302
111391150,0ptp4l0-21swapper/207:34:012
111391150,0ptp4l0-21swapper/112:23:521
111391150,0ptp4l0-21swapper/112:15:371
111391150,0ptp4l0-21swapper/111:11:351
111391150,0ptp4l0-21swapper/110:17:551
111391150,0ptp4l0-21swapper/109:06:211
111391150,0ptp4l0-21swapper/012:35:260
111391150,0ptp4l0-21swapper/008:40:380
111391140,0ptp4l0-21swapper/612:38:536
111391140,0ptp4l0-21swapper/610:20:496
111391140,0ptp4l0-21swapper/609:51:166
111391140,0ptp4l0-21swapper/609:51:166
111391140,0ptp4l0-21swapper/608:24:326
111391140,0ptp4l0-21swapper/608:11:596
111391140,0ptp4l0-21swapper/607:46:266
111391140,0ptp4l0-21swapper/607:38:446
111391140,0ptp4l0-21swapper/307:29:083
111391140,0ptp4l0-21swapper/212:38:502
111391140,0ptp4l0-21swapper/212:30:572
111391140,0ptp4l0-21swapper/212:30:562
111391140,0ptp4l0-21swapper/212:01:092
111391140,0ptp4l0-21swapper/211:57:142
111391140,0ptp4l0-21swapper/211:54:382
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional