You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-13 - 03:35

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackcslot8s.osadl.org (updated Wed Nov 12, 2025 12:46:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
225692980,1sleep70-21swapper/707:07:047
289982910,0sleep60-21swapper/612:25:216
114091650,34ptp4l0-21swapper/207:05:062
279452630,0sleep10-21swapper/110:55:181
114091620,5ptp4l0-21swapper/107:09:321
114091620,29ptp4l0-21swapper/007:09:340
114091610,6ptp4l0-21swapper/607:05:336
2252726049,7sleep30-21swapper/307:06:293
196532590,0sleep20-21swapper/208:10:182
71412560,0sleep11093-21runrttasks11:55:281
2279325633,7sleep40-21swapper/407:09:504
97132550,0sleep20-21swapper/210:30:212
114091550,5ptp4l0-21swapper/507:09:555
114091360,1ptp4l23524-21unixbench_multi09:20:225
114091340,0ptp4l0-21swapper/508:25:175
23074993322,0cyclictest0-21swapper/012:39:550
114091330,0ptp4l0-21swapper/509:41:215
114091320,0ptp4l0-21swapper/510:50:355
114091310,2ptp4l0-21swapper/010:30:190
114091310,0ptp4l0-21swapper/712:34:157
114091310,0ptp4l0-21swapper/511:48:565
114091310,0ptp4l0-21swapper/110:20:181
114091300,3ptp4l0-21swapper/510:28:225
114091290,0ptp4l0-21swapper/512:36:315
114091290,0ptp4l0-21swapper/510:34:065
114091290,0ptp4l0-21swapper/508:35:165
114091290,0ptp4l0-21swapper/409:55:234
114091290,0ptp4l0-21swapper/209:25:082
114091290,0ptp4l0-21swapper/209:24:372
114091290,0ptp4l0-21swapper/112:12:161
114091290,0ptp4l0-21swapper/111:54:571
114091290,0ptp4l0-21swapper/111:24:231
114091290,0ptp4l0-21swapper/108:35:131
114091290,0ptp4l0-21swapper/011:45:180
114091290,0ptp4l0-21swapper/009:57:290
114091280,0ptp4l0-21swapper/512:23:535
114091280,0ptp4l0-21swapper/511:50:355
114091280,0ptp4l0-21swapper/112:36:131
114091280,0ptp4l0-21swapper/112:17:331
114091280,0ptp4l0-21swapper/010:15:230
114091270,0ptp4l0-21swapper/311:40:423
114091270,0ptp4l0-21swapper/311:40:413
114091270,0ptp4l0-21swapper/212:08:292
114091270,0ptp4l0-21swapper/210:52:192
114091270,0ptp4l0-21swapper/209:39:312
114091270,0ptp4l0-21swapper/111:38:241
114091270,0ptp4l0-21swapper/110:50:531
114091270,0ptp4l0-21swapper/110:43:401
114091270,0ptp4l0-21swapper/109:10:551
114091270,0ptp4l0-21swapper/011:53:050
114091270,0ptp4l0-21swapper/010:28:480
114091260,0ptp4l0-21swapper/711:44:077
114091260,0ptp4l0-21swapper/711:44:067
114091260,0ptp4l0-21swapper/610:57:256
114091260,0ptp4l0-21swapper/512:30:425
114091260,0ptp4l0-21swapper/512:16:525
114091260,0ptp4l0-21swapper/511:25:555
114091260,0ptp4l0-21swapper/511:02:165
114091260,0ptp4l0-21swapper/509:57:355
114091260,0ptp4l0-21swapper/509:45:535
114091260,0ptp4l0-21swapper/508:50:165
114091260,0ptp4l0-21swapper/410:24:174
114091260,0ptp4l0-21swapper/409:30:164
114091260,0ptp4l0-21swapper/212:10:482
114091260,0ptp4l0-21swapper/211:27:502
114091260,0ptp4l0-21swapper/111:47:361
114091260,0ptp4l0-21swapper/109:22:391
114091260,0ptp4l0-21swapper/011:22:450
114091260,0ptp4l0-21swapper/010:51:390
114091260,0ptp4l0-21swapper/009:27:590
114091250,1ptp4l9-21ksoftirqd/007:10:210
114091250,0ptp4l0-21swapper/612:20:016
114091250,0ptp4l0-21swapper/609:27:486
114091250,0ptp4l0-21swapper/512:11:415
114091250,0ptp4l0-21swapper/510:20:185
114091250,0ptp4l0-21swapper/509:51:005
114091250,0ptp4l0-21swapper/509:32:465
114091250,0ptp4l0-21swapper/508:05:205
114091250,0ptp4l0-21swapper/410:45:164
114091250,0ptp4l0-21swapper/409:45:014
114091250,0ptp4l0-21swapper/211:35:132
114091250,0ptp4l0-21swapper/112:00:571
114091250,0ptp4l0-21swapper/110:26:071
114091250,0ptp4l0-21swapper/110:10:021
114091250,0ptp4l0-21swapper/110:07:281
114091250,0ptp4l0-21swapper/109:54:261
114091250,0ptp4l0-21swapper/108:45:101
114091250,0ptp4l0-21swapper/107:15:171
114091250,0ptp4l0-21swapper/012:26:110
114091250,0ptp4l0-21swapper/012:17:420
114091250,0ptp4l0-21swapper/011:58:380
114091250,0ptp4l0-21swapper/011:00:170
114091250,0ptp4l0-21swapper/009:10:200
2311099240,16cyclictest0-21swapper/511:18:315
114091240,1ptp4l9112-21fw_forwarded_lo11:15:151
114091240,1ptp4l753-21cat10:19:591
114091240,1ptp4l3286-21diskstats07:35:145
114091240,1ptp4l30261-21df10:15:142
114091240,1ptp4l23528-21smartctl11:35:146
114091240,1ptp4l20674-21/usr/sbin/munin11:30:175
114091240,1ptp4l19560-21ssh10:45:145
114091240,1ptp4l17061-21/usr/sbin/munin10:40:195
114091240,1ptp4l10506-21memory09:00:171
114091240,1ptp4l0-21swapper/212:20:122
114091240,0ptp4l0-21swapper/612:10:216
114091240,0ptp4l0-21swapper/609:24:466
114091240,0ptp4l0-21swapper/512:04:255
114091240,0ptp4l0-21swapper/511:45:015
114091240,0ptp4l0-21swapper/511:45:005
114091240,0ptp4l0-21swapper/511:37:135
114091240,0ptp4l0-21swapper/511:22:355
114091240,0ptp4l0-21swapper/510:35:125
114091240,0ptp4l0-21swapper/507:45:185
114091240,0ptp4l0-21swapper/507:25:195
114091240,0ptp4l0-21swapper/507:20:175
114091240,0ptp4l0-21swapper/412:11:364
114091240,0ptp4l0-21swapper/411:10:204
114091240,0ptp4l0-21swapper/411:04:594
114091240,0ptp4l0-21swapper/209:49:242
114091240,0ptp4l0-21swapper/112:25:211
114091240,0ptp4l0-21swapper/111:34:181
114091240,0ptp4l0-21swapper/111:26:301
114091240,0ptp4l0-21swapper/110:45:121
114091240,0ptp4l0-21swapper/110:00:341
114091240,0ptp4l0-21swapper/109:34:451
114091240,0ptp4l0-21swapper/011:05:040
114091240,0ptp4l0-21swapper/010:58:180
114091240,0ptp4l0-21swapper/010:45:140
114091240,0ptp4l0-21swapper/010:10:200
114091240,0ptp4l0-21swapper/009:45:180
114091240,0ptp4l0-21swapper/008:16:450
114091230,4ptp4l13941-21diskmemload09:35:345
114091230,2ptp4l0-21swapper/012:06:370
114091230,1ptp4l33-21ksoftirqd/208:40:002
114091230,1ptp4l28794-21interrupts08:30:171
114091230,1ptp4l22169-21load08:15:137
114091230,1ptp4l13941-21diskmemload10:03:282
114091230,0ptp4l561ktimersoftd/510:00:225
114091230,0ptp4l0-21swapper/612:08:316
114091230,0ptp4l0-21swapper/610:15:186
114091230,0ptp4l0-21swapper/610:05:196
114091230,0ptp4l0-21swapper/609:12:246
114091230,0ptp4l0-21swapper/608:40:136
114091230,0ptp4l0-21swapper/607:55:166
114091230,0ptp4l0-21swapper/512:25:195
114091230,0ptp4l0-21swapper/512:05:145
114091230,0ptp4l0-21swapper/511:13:545
114091230,0ptp4l0-21swapper/510:55:185
114091230,0ptp4l0-21swapper/509:28:345
114091230,0ptp4l0-21swapper/509:15:135
114091230,0ptp4l0-21swapper/509:10:005
114091230,0ptp4l0-21swapper/508:55:225
114091230,0ptp4l0-21swapper/508:30:135
114091230,0ptp4l0-21swapper/508:20:195
114091230,0ptp4l0-21swapper/507:15:135
114091230,0ptp4l0-21swapper/412:25:134
114091230,0ptp4l0-21swapper/411:55:174
114091230,0ptp4l0-21swapper/411:36:344
114091230,0ptp4l0-21swapper/411:33:064
114091230,0ptp4l0-21swapper/411:05:204
114091230,0ptp4l0-21swapper/410:42:164
114091230,0ptp4l0-21swapper/410:30:164
114091230,0ptp4l0-21swapper/410:27:364
114091230,0ptp4l0-21swapper/408:30:194
114091230,0ptp4l0-21swapper/408:25:214
114091230,0ptp4l0-21swapper/407:10:224
114091230,0ptp4l0-21swapper/311:55:463
114091230,0ptp4l0-21swapper/210:10:212
114091230,0ptp4l0-21swapper/210:05:122
114091230,0ptp4l0-21swapper/112:05:211
114091230,0ptp4l0-21swapper/110:35:121
114091230,0ptp4l0-21swapper/109:55:121
114091230,0ptp4l0-21swapper/109:43:301
114091230,0ptp4l0-21swapper/109:37:161
114091230,0ptp4l0-21swapper/109:15:151
114091230,0ptp4l0-21swapper/108:55:221
114091230,0ptp4l0-21swapper/108:50:131
114091230,0ptp4l0-21swapper/108:20:121
114091230,0ptp4l0-21swapper/108:05:221
114091230,0ptp4l0-21swapper/107:40:131
114091230,0ptp4l0-21swapper/107:25:181
114091230,0ptp4l0-21swapper/107:10:161
114091230,0ptp4l0-21swapper/012:30:120
114091230,0ptp4l0-21swapper/011:38:310
114091230,0ptp4l0-21swapper/010:40:140
114091230,0ptp4l0-21swapper/009:31:480
2311099225,13cyclictest0-21swapper/511:05:255
114091220,0ptp4l0-21swapper/711:21:427
114091220,0ptp4l0-21swapper/612:20:096
114091220,0ptp4l0-21swapper/611:27:386
114091220,0ptp4l0-21swapper/610:11:166
114091220,0ptp4l0-21swapper/610:05:006
114091220,0ptp4l0-21swapper/609:39:326
114091220,0ptp4l0-21swapper/609:16:066
114091220,0ptp4l0-21swapper/511:55:155
114091220,0ptp4l0-21swapper/510:15:405
114091220,0ptp4l0-21swapper/510:10:015
114091220,0ptp4l0-21swapper/510:06:015
114091220,0ptp4l0-21swapper/509:05:205
114091220,0ptp4l0-21swapper/509:05:195
114091220,0ptp4l0-21swapper/509:00:125
114091220,0ptp4l0-21swapper/508:45:155
114091220,0ptp4l0-21swapper/507:40:155
114091220,0ptp4l0-21swapper/507:30:125
114091220,0ptp4l0-21swapper/507:10:155
114091220,0ptp4l0-21swapper/412:35:184
114091220,0ptp4l0-21swapper/412:30:114
114091220,0ptp4l0-21swapper/412:15:434
114091220,0ptp4l0-21swapper/411:53:034
114091220,0ptp4l0-21swapper/411:45:164
114091220,0ptp4l0-21swapper/411:20:224
114091220,0ptp4l0-21swapper/410:53:244
114091220,0ptp4l0-21swapper/410:15:514
114091220,0ptp4l0-21swapper/410:10:154
114091220,0ptp4l0-21swapper/410:08:564
114091220,0ptp4l0-21swapper/410:00:054
114091220,0ptp4l0-21swapper/409:45:354
114091220,0ptp4l0-21swapper/409:36:394
114091220,0ptp4l0-21swapper/409:10:134
114091220,0ptp4l0-21swapper/409:00:164
114091220,0ptp4l0-21swapper/408:10:194
114091220,0ptp4l0-21swapper/408:00:124
114091220,0ptp4l0-21swapper/408:00:004
114091220,0ptp4l0-21swapper/312:31:313
114091220,0ptp4l0-21swapper/308:15:093
114091220,0ptp4l0-21swapper/212:25:012
114091220,0ptp4l0-21swapper/212:19:372
114091220,0ptp4l0-21swapper/212:01:202
114091220,0ptp4l0-21swapper/211:42:202
114091220,0ptp4l0-21swapper/211:42:192
114091220,0ptp4l0-21swapper/211:13:072
114091220,0ptp4l0-21swapper/210:56:422
114091220,0ptp4l0-21swapper/210:46:542
114091220,0ptp4l0-21swapper/209:18:002
114091220,0ptp4l0-21swapper/207:55:162
114091220,0ptp4l0-21swapper/112:24:191
114091220,0ptp4l0-21swapper/111:42:291
114091220,0ptp4l0-21swapper/111:42:291
114091220,0ptp4l0-21swapper/111:10:121
114091220,0ptp4l0-21swapper/111:07:451
114091220,0ptp4l0-21swapper/111:00:131
114091220,0ptp4l0-21swapper/110:33:511
114091220,0ptp4l0-21swapper/109:45:111
114091220,0ptp4l0-21swapper/109:28:111
114091220,0ptp4l0-21swapper/108:25:141
114091220,0ptp4l0-21swapper/108:12:561
114091220,0ptp4l0-21swapper/107:50:131
114091220,0ptp4l0-21swapper/107:45:171
114091220,0ptp4l0-21swapper/107:35:001
114091220,0ptp4l0-21swapper/107:30:121
114091220,0ptp4l0-21swapper/107:20:161
114091220,0ptp4l0-21swapper/012:14:050
114091220,0ptp4l0-21swapper/011:33:430
114091220,0ptp4l0-21swapper/011:27:110
114091220,0ptp4l0-21swapper/011:15:550
114091220,0ptp4l0-21swapper/011:10:180
114091220,0ptp4l0-21swapper/010:05:210
114091220,0ptp4l0-21swapper/009:50:230
114091220,0ptp4l0-21swapper/009:40:070
114091220,0ptp4l0-21swapper/009:35:150
114091220,0ptp4l0-21swapper/009:00:160
114091220,0ptp4l0-21swapper/008:50:000
114091220,0ptp4l0-21swapper/008:45:190
114091220,0ptp4l0-21swapper/008:10:170
114091220,0ptp4l0-21swapper/007:50:200
114091220,0ptp4l0-21swapper/007:30:190
114091210,1ptp4l11897-21ssh11:19:504
114091210,0ptp4l0-21swapper/711:55:227
114091210,0ptp4l0-21swapper/711:39:557
114091210,0ptp4l0-21swapper/611:56:156
114091210,0ptp4l0-21swapper/611:46:236
114091210,0ptp4l0-21swapper/611:42:226
114091210,0ptp4l0-21swapper/611:42:226
114091210,0ptp4l0-21swapper/611:16:186
114091210,0ptp4l0-21swapper/611:12:466
114091210,0ptp4l0-21swapper/610:42:086
114091210,0ptp4l0-21swapper/609:48:216
114091210,0ptp4l0-21swapper/507:50:145
114091210,0ptp4l0-21swapper/411:27:234
114091210,0ptp4l0-21swapper/410:35:574
114091210,0ptp4l0-21swapper/409:50:374
114091210,0ptp4l0-21swapper/409:27:214
114091210,0ptp4l0-21swapper/409:20:064
114091210,0ptp4l0-21swapper/408:57:134
114091210,0ptp4l0-21swapper/407:50:224
114091210,0ptp4l0-21swapper/407:45:134
114091210,0ptp4l0-21swapper/407:30:164
114091210,0ptp4l0-21swapper/211:00:322
114091210,0ptp4l0-21swapper/210:22:332
114091210,0ptp4l0-21swapper/209:51:422
114091210,0ptp4l0-21swapper/208:40:172
114091210,0ptp4l0-21swapper/207:51:162
114091210,0ptp4l0-21swapper/112:34:331
114091210,0ptp4l0-21swapper/109:05:201
114091210,0ptp4l0-21swapper/109:05:191
114091210,0ptp4l0-21swapper/108:43:051
114091210,0ptp4l0-21swapper/108:16:061
114091210,0ptp4l0-21swapper/108:00:141
114091210,0ptp4l0-21swapper/012:22:300
114091210,0ptp4l0-21swapper/012:00:190
114091210,0ptp4l0-21swapper/010:36:000
114091210,0ptp4l0-21swapper/010:22:400
114091210,0ptp4l0-21swapper/010:02:250
114091210,0ptp4l0-21swapper/009:20:080
114091210,0ptp4l0-21swapper/008:30:210
114091210,0ptp4l0-21swapper/008:07:050
114091210,0ptp4l0-21swapper/008:01:000
114091210,0ptp4l0-21swapper/007:55:460
114091200,0ptp4l13941-21diskmemload09:15:264
114091200,0ptp4l0-21swapper/612:01:186
114091200,0ptp4l0-21swapper/611:00:376
114091200,0ptp4l0-21swapper/610:52:406
114091200,0ptp4l0-21swapper/610:46:586
114091200,0ptp4l0-21swapper/610:22:226
114091200,0ptp4l0-21swapper/609:51:236
114091200,0ptp4l0-21swapper/608:39:566
114091200,0ptp4l0-21swapper/608:18:056
114091200,0ptp4l0-21swapper/508:11:055
114091200,0ptp4l0-21swapper/508:00:155
114091200,0ptp4l0-21swapper/507:59:055
114091200,0ptp4l0-21swapper/412:24:264
114091200,0ptp4l0-21swapper/412:07:234
114091200,0ptp4l0-21swapper/410:55:524
114091200,0ptp4l0-21swapper/408:15:374
114091200,0ptp4l0-21swapper/408:06:454
114091200,0ptp4l0-21swapper/407:42:294
114091200,0ptp4l0-21swapper/308:14:483
114091200,0ptp4l0-21swapper/209:43:112
114091200,0ptp4l0-21swapper/207:30:212
114091200,0ptp4l0-21swapper/107:57:051
114091200,0ptp4l0-21swapper/011:42:280
114091200,0ptp4l0-21swapper/011:42:270
114091200,0ptp4l0-21swapper/009:15:250
114091200,0ptp4l0-21swapper/008:25:200
114091200,0ptp4l0-21swapper/007:47:420
114091200,0ptp4l0-21swapper/007:29:340
114091200,0ptp4l0-21swapper/007:20:010
114091190,0ptp4l0-21swapper/708:14:357
114091190,0ptp4l0-21swapper/508:42:415
114091190,0ptp4l0-21swapper/409:08:254
114091190,0ptp4l0-21swapper/409:08:244
114091190,0ptp4l0-21swapper/408:45:204
114091190,0ptp4l0-21swapper/407:15:454
114091190,0ptp4l0-21swapper/311:39:533
114091190,0ptp4l0-21swapper/207:16:482
114091190,0ptp4l0-21swapper/008:20:220
114091180,0ptp4l0-21swapper/610:30:096
114091180,0ptp4l0-21swapper/412:00:214
114091180,0ptp4l0-21swapper/211:56:162
114091180,0ptp4l0-21swapper/211:48:352
114091180,0ptp4l0-21swapper/211:19:512
114091180,0ptp4l0-21swapper/210:44:432
114091180,0ptp4l0-21swapper/208:46:592
114091170,0ptp4l0-21swapper/311:21:443
114091160,0ptp4l0-21swapper/609:57:446
114091160,0ptp4l0-21swapper/609:43:116
114091160,0ptp4l0-21swapper/608:24:516
114091160,0ptp4l0-21swapper/607:16:046
114091160,0ptp4l0-21swapper/411:42:284
114091160,0ptp4l0-21swapper/411:42:274
114091160,0ptp4l0-21swapper/408:53:154
114091160,0ptp4l0-21swapper/407:29:384
114091160,0ptp4l0-21swapper/308:43:123
114091160,0ptp4l0-21swapper/209:57:242
114091160,0ptp4l0-21swapper/209:12:222
114091160,0ptp4l0-21swapper/208:50:422
114091160,0ptp4l0-21swapper/207:27:372
114091160,0ptp4l0-21swapper/009:06:310
114091160,0ptp4l0-21swapper/009:06:310
114091160,0ptp4l0-21swapper/008:40:470
114091160,0ptp4l0-21swapper/007:40:480
23102991513,0cyclictest49-21ksoftirqd/407:38:264
2309599150,2cyclictest0-21swapper/309:25:143
114091150,0ptp4l0-21swapper/708:43:177
114091150,0ptp4l0-21swapper/608:51:056
114091150,0ptp4l0-21swapper/608:45:556
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional