You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-21 - 16:32

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackcslot8s.osadl.org (updated Fri Nov 21, 2025 12:46:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
277822650,1sleep327786-21cpuspeed_turbos11:00:133
1736326443,6sleep70-21swapper/707:08:217
158682640,0sleep70-21swapper/708:15:007
12542630,0sleep00-21swapper/011:07:240
179262620,0sleep40-21swapper/411:30:104
222102600,0sleep20-21swapper/209:25:192
1715026050,6sleep20-21swapper/207:05:352
114091590,5ptp4l0-21swapper/307:10:003
190362570,0sleep10-21swapper/109:21:511
1733425633,7sleep40-21swapper/407:08:024
2120915533,7phc2sys0-21swapper/007:08:000
1734525534,6sleep60-21swapper/607:08:126
1745825443,6sleep10-21swapper/107:09:271
1729024635,7sleep50-21swapper/507:07:235
114091330,1ptp4l11307-21awk09:55:115
114091330,0ptp4l0-21swapper/209:48:532
114091320,0ptp4l0-21swapper/210:27:332
114091320,0ptp4l0-21swapper/110:37:291
114091310,1ptp4l5600-21sh09:47:050
114091310,1ptp4l28674-21ssh10:17:261
114091310,0ptp4l0-21swapper/409:44:434
114091310,0ptp4l0-21swapper/109:28:521
114091300,0ptp4l0-21swapper/410:07:344
114091300,0ptp4l0-21swapper/208:06:202
114091300,0ptp4l0-21swapper/112:00:161
114091300,0ptp4l0-21swapper/109:30:391
114091300,0ptp4l0-21swapper/012:26:500
114091290,2ptp4l0-21swapper/110:47:181
114091290,0ptp4l0-21swapper/511:20:175
114091290,0ptp4l0-21swapper/510:25:205
114091290,0ptp4l0-21swapper/411:39:584
114091290,0ptp4l0-21swapper/411:39:574
114091290,0ptp4l0-21swapper/210:18:122
114091290,0ptp4l0-21swapper/111:13:171
114091290,0ptp4l0-21swapper/110:10:111
114091290,0ptp4l0-21swapper/109:52:361
114091280,6ptp4l0-21swapper/110:33:001
114091280,0ptp4l0-21swapper/712:35:187
114091280,0ptp4l0-21swapper/511:04:045
114091280,0ptp4l0-21swapper/510:31:215
114091280,0ptp4l0-21swapper/209:35:422
114091280,0ptp4l0-21swapper/112:15:471
114091280,0ptp4l0-21swapper/112:14:191
114091280,0ptp4l0-21swapper/112:06:361
114091280,0ptp4l0-21swapper/111:39:211
114091280,0ptp4l0-21swapper/111:39:201
114091280,0ptp4l0-21swapper/111:16:591
114091280,0ptp4l0-21swapper/109:49:531
114091280,0ptp4l0-21swapper/109:44:001
114091280,0ptp4l0-21swapper/107:32:291
114091280,0ptp4l0-21swapper/010:59:350
114091270,2ptp4l0-21swapper/411:02:124
114091270,0ptp4l0-21swapper/509:48:065
114091270,0ptp4l0-21swapper/212:19:042
114091270,0ptp4l0-21swapper/110:23:121
114091270,0ptp4l0-21swapper/107:56:201
114091270,0ptp4l0-21swapper/012:02:210
114091270,0ptp4l0-21swapper/010:24:060
114091270,0ptp4l0-21swapper/010:12:550
114091270,0ptp4l0-21swapper/009:15:110
114091260,2ptp4l0-21swapper/110:29:001
114091260,1ptp4l868-21cut10:25:004
114091260,1ptp4l0-21swapper/610:57:416
114091260,0ptp4l16300-21tr08:15:136
114091260,0ptp4l0-21swapper/611:14:296
114091260,0ptp4l0-21swapper/609:25:466
114091260,0ptp4l0-21swapper/510:23:165
114091260,0ptp4l0-21swapper/507:45:175
114091260,0ptp4l0-21swapper/412:26:254
114091260,0ptp4l0-21swapper/410:55:084
114091260,0ptp4l0-21swapper/409:50:474
114091260,0ptp4l0-21swapper/312:38:003
114091260,0ptp4l0-21swapper/212:05:102
114091260,0ptp4l0-21swapper/111:51:291
114091260,0ptp4l0-21swapper/111:27:411
114091260,0ptp4l0-21swapper/110:08:301
114091260,0ptp4l0-21swapper/109:19:301
114091260,0ptp4l0-21swapper/108:40:211
114091260,0ptp4l0-21swapper/011:12:520
114091260,0ptp4l0-21swapper/009:50:110
114091260,0ptp4l0-21swapper/009:13:260
114091250,2ptp4l0-21swapper/410:35:044
114091250,1ptp4l24134-21grep10:55:125
114091250,1ptp4l22225-21fw_conntrack12:20:140
114091250,0ptp4l0-21swapper/611:50:366
114091250,0ptp4l0-21swapper/610:12:466
114091250,0ptp4l0-21swapper/511:48:575
114091250,0ptp4l0-21swapper/511:30:135
114091250,0ptp4l0-21swapper/510:35:165
114091250,0ptp4l0-21swapper/508:30:195
114091250,0ptp4l0-21swapper/508:10:115
114091250,0ptp4l0-21swapper/508:05:125
114091250,0ptp4l0-21swapper/411:14:414
114091250,0ptp4l0-21swapper/410:45:134
114091250,0ptp4l0-21swapper/311:33:203
114091250,0ptp4l0-21swapper/208:35:142
114091250,0ptp4l0-21swapper/112:35:501
114091250,0ptp4l0-21swapper/111:45:141
114091250,0ptp4l0-21swapper/111:03:451
114091250,0ptp4l0-21swapper/110:42:331
114091250,0ptp4l0-21swapper/108:19:311
114091250,0ptp4l0-21swapper/107:50:131
114091250,0ptp4l0-21swapper/107:35:171
114091250,0ptp4l0-21swapper/009:00:120
114091250,0ptp4l0-21swapper/009:00:110
114091240,7ptp4l0-21swapper/609:36:166
114091240,6ptp4l0-21swapper/107:46:261
114091240,1ptp4l28292-21ssh11:44:244
114091240,1ptp4l27387-21sensors_fan10:15:185
114091240,1ptp4l25574-21/usr/sbin/munin11:40:141
114091240,1ptp4l23657-21ps07:20:131
114091240,0ptp4l22840-21latency_hist07:20:005
114091240,0ptp4l0-21swapper/609:16:326
114091240,0ptp4l0-21swapper/609:10:496
114091240,0ptp4l0-21swapper/607:18:576
114091240,0ptp4l0-21swapper/512:20:175
114091240,0ptp4l0-21swapper/512:10:205
114091240,0ptp4l0-21swapper/512:05:385
114091240,0ptp4l0-21swapper/511:05:035
114091240,0ptp4l0-21swapper/510:11:155
114091240,0ptp4l0-21swapper/510:00:115
114091240,0ptp4l0-21swapper/508:40:215
114091240,0ptp4l0-21swapper/508:00:125
114091240,0ptp4l0-21swapper/411:50:184
114091240,0ptp4l0-21swapper/408:55:214
114091240,0ptp4l0-21swapper/407:20:174
114091240,0ptp4l0-21swapper/407:10:214
114091240,0ptp4l0-21swapper/210:46:492
114091240,0ptp4l0-21swapper/209:20:182
114091240,0ptp4l0-21swapper/109:05:161
114091240,0ptp4l0-21swapper/012:08:520
114091240,0ptp4l0-21swapper/011:50:240
114091240,0ptp4l0-21swapper/011:30:450
114091240,0ptp4l0-21swapper/010:53:240
114091240,0ptp4l0-21swapper/010:25:170
114091230,5ptp4l8666-21kworker/0:209:42:540
114091230,1ptp4l4935-21irqrtprio09:00:141
114091230,1ptp4l4935-21irqrtprio09:00:141
114091230,0ptp4l8635-21diskmemload09:10:152
114091230,0ptp4l20942-21fw_conntrack09:25:110
114091230,0ptp4l0-21swapper/612:31:236
114091230,0ptp4l0-21swapper/612:25:186
114091230,0ptp4l0-21swapper/611:15:126
114091230,0ptp4l0-21swapper/609:20:196
114091230,0ptp4l0-21swapper/609:09:556
114091230,0ptp4l0-21swapper/608:35:206
114091230,0ptp4l0-21swapper/512:30:225
114091230,0ptp4l0-21swapper/512:15:225
114091230,0ptp4l0-21swapper/512:00:195
114091230,0ptp4l0-21swapper/511:55:015
114091230,0ptp4l0-21swapper/511:40:175
114091230,0ptp4l0-21swapper/511:35:145
114091230,0ptp4l0-21swapper/511:35:145
114091230,0ptp4l0-21swapper/511:25:135
114091230,0ptp4l0-21swapper/511:15:195
114091230,0ptp4l0-21swapper/511:13:305
114091230,0ptp4l0-21swapper/510:50:225
114091230,0ptp4l0-21swapper/510:05:145
114091230,0ptp4l0-21swapper/509:54:585
114091230,0ptp4l0-21swapper/509:40:135
114091230,0ptp4l0-21swapper/509:30:005
114091230,0ptp4l0-21swapper/509:15:455
114091230,0ptp4l0-21swapper/509:05:165
114091230,0ptp4l0-21swapper/509:00:165
114091230,0ptp4l0-21swapper/509:00:165
114091230,0ptp4l0-21swapper/508:20:125
114091230,0ptp4l0-21swapper/507:55:145
114091230,0ptp4l0-21swapper/507:30:145
114091230,0ptp4l0-21swapper/507:25:185
114091230,0ptp4l0-21swapper/507:22:175
114091230,0ptp4l0-21swapper/507:10:155
114091230,0ptp4l0-21swapper/412:30:184
114091230,0ptp4l0-21swapper/412:20:144
114091230,0ptp4l0-21swapper/411:15:174
114091230,0ptp4l0-21swapper/408:45:224
114091230,0ptp4l0-21swapper/408:20:174
114091230,0ptp4l0-21swapper/407:50:164
114091230,0ptp4l0-21swapper/212:25:172
114091230,0ptp4l0-21swapper/207:15:012
114091230,0ptp4l0-21swapper/112:30:211
114091230,0ptp4l0-21swapper/112:20:191
114091230,0ptp4l0-21swapper/111:55:021
114091230,0ptp4l0-21swapper/111:30:111
114091230,0ptp4l0-21swapper/111:20:201
114091230,0ptp4l0-21swapper/110:59:501
114091230,0ptp4l0-21swapper/110:00:171
114091230,0ptp4l0-21swapper/109:55:161
114091230,0ptp4l0-21swapper/109:38:001
114091230,0ptp4l0-21swapper/109:14:231
114091230,0ptp4l0-21swapper/108:55:141
114091230,0ptp4l0-21swapper/108:50:191
114091230,0ptp4l0-21swapper/108:36:551
114091230,0ptp4l0-21swapper/108:30:131
114091230,0ptp4l0-21swapper/108:25:141
114091230,0ptp4l0-21swapper/108:20:141
114091230,0ptp4l0-21swapper/108:10:361
114091230,0ptp4l0-21swapper/108:05:101
114091230,0ptp4l0-21swapper/107:43:121
114091230,0ptp4l0-21swapper/107:25:171
114091230,0ptp4l0-21swapper/012:30:030
114091230,0ptp4l0-21swapper/012:10:130
114091230,0ptp4l0-21swapper/011:55:110
114091230,0ptp4l0-21swapper/011:15:130
114091230,0ptp4l0-21swapper/010:45:140
114091230,0ptp4l0-21swapper/010:43:110
114091230,0ptp4l0-21swapper/010:10:000
114091230,0ptp4l0-21swapper/009:59:580
114091230,0ptp4l0-21swapper/007:50:150
114091220,1ptp4l30949-21awk11:46:224
114091220,1ptp4l1776499cyclictest12:04:082
114091220,0ptp4l860-21strings07:40:190
114091220,0ptp4l0-21swapper/712:34:557
114091220,0ptp4l0-21swapper/711:31:537
114091220,0ptp4l0-21swapper/612:17:296
114091220,0ptp4l0-21swapper/612:12:306
114091220,0ptp4l0-21swapper/612:05:176
114091220,0ptp4l0-21swapper/612:04:366
114091220,0ptp4l0-21swapper/610:46:156
114091220,0ptp4l0-21swapper/610:27:116
114091220,0ptp4l0-21swapper/608:53:216
114091220,0ptp4l0-21swapper/512:38:575
114091220,0ptp4l0-21swapper/512:25:165
114091220,0ptp4l0-21swapper/511:55:105
114091220,0ptp4l0-21swapper/510:47:195
114091220,0ptp4l0-21swapper/510:40:145
114091220,0ptp4l0-21swapper/509:37:555
114091220,0ptp4l0-21swapper/509:30:125
114091220,0ptp4l0-21swapper/509:20:065
114091220,0ptp4l0-21swapper/509:14:265
114091220,0ptp4l0-21swapper/508:59:555
114091220,0ptp4l0-21swapper/508:50:125
114091220,0ptp4l0-21swapper/508:45:175
114091220,0ptp4l0-21swapper/508:37:185
114091220,0ptp4l0-21swapper/412:36:174
114091220,0ptp4l0-21swapper/412:19:594
114091220,0ptp4l0-21swapper/412:14:434
114091220,0ptp4l0-21swapper/412:07:004
114091220,0ptp4l0-21swapper/411:55:424
114091220,0ptp4l0-21swapper/411:25:244
114091220,0ptp4l0-21swapper/411:22:334
114091220,0ptp4l0-21swapper/411:05:174
114091220,0ptp4l0-21swapper/410:43:564
114091220,0ptp4l0-21swapper/410:31:394
114091220,0ptp4l0-21swapper/410:27:564
114091220,0ptp4l0-21swapper/410:11:434
114091220,0ptp4l0-21swapper/410:03:594
114091220,0ptp4l0-21swapper/409:58:464
114091220,0ptp4l0-21swapper/409:47:064
114091220,0ptp4l0-21swapper/409:32:564
114091220,0ptp4l0-21swapper/409:25:174
114091220,0ptp4l0-21swapper/409:15:124
114091220,0ptp4l0-21swapper/408:25:154
114091220,0ptp4l0-21swapper/407:35:214
114091220,0ptp4l0-21swapper/312:34:193
114091220,0ptp4l0-21swapper/310:33:453
114091220,0ptp4l0-21swapper/212:32:502
114091220,0ptp4l0-21swapper/212:12:232
114091220,0ptp4l0-21swapper/211:00:532
114091220,0ptp4l0-21swapper/210:57:442
114091220,0ptp4l0-21swapper/210:24:522
114091220,0ptp4l0-21swapper/209:32:502
114091220,0ptp4l0-21swapper/208:15:172
114091220,0ptp4l0-21swapper/112:27:191
114091220,0ptp4l0-21swapper/111:05:151
114091220,0ptp4l0-21swapper/110:50:161
114091220,0ptp4l0-21swapper/108:45:171
114091220,0ptp4l0-21swapper/107:10:191
114091220,0ptp4l0-21swapper/011:45:210
114091220,0ptp4l0-21swapper/011:42:140
114091220,0ptp4l0-21swapper/011:24:270
114091220,0ptp4l0-21swapper/011:00:180
114091220,0ptp4l0-21swapper/010:30:220
114091220,0ptp4l0-21swapper/010:01:580
114091220,0ptp4l0-21swapper/009:37:210
114091220,0ptp4l0-21swapper/009:31:350
114091220,0ptp4l0-21swapper/008:55:160
114091220,0ptp4l0-21swapper/008:40:160
114091220,0ptp4l0-21swapper/007:20:170
114091220,0ptp4l0-21swapper/007:10:190
114091210,2ptp4l0-21swapper/410:51:414
114091210,0ptp4l0-21swapper/710:33:507
114091210,0ptp4l0-21swapper/710:28:537
114091210,0ptp4l0-21swapper/710:06:037
114091210,0ptp4l0-21swapper/611:46:216
114091210,0ptp4l0-21swapper/610:24:536
114091210,0ptp4l0-21swapper/610:09:206
114091210,0ptp4l0-21swapper/609:48:406
114091210,0ptp4l0-21swapper/507:50:215
114091210,0ptp4l0-21swapper/507:40:155
114091210,0ptp4l0-21swapper/507:35:155
114091210,0ptp4l0-21swapper/412:00:574
114091210,0ptp4l0-21swapper/409:37:354
114091210,0ptp4l0-21swapper/409:22:254
114091210,0ptp4l0-21swapper/409:14:494
114091210,0ptp4l0-21swapper/408:44:554
114091210,0ptp4l0-21swapper/310:28:193
114091210,0ptp4l0-21swapper/310:06:093
114091210,0ptp4l0-21swapper/210:34:582
114091210,0ptp4l0-21swapper/208:27:212
114091210,0ptp4l0-21swapper/011:35:210
114091210,0ptp4l0-21swapper/011:35:200
114091210,0ptp4l0-21swapper/011:26:120
114091210,0ptp4l0-21swapper/010:35:130
114091210,0ptp4l0-21swapper/010:18:140
114091210,0ptp4l0-21swapper/009:22:310
114091210,0ptp4l0-21swapper/008:25:150
114091210,0ptp4l0-21swapper/007:25:150
114091200,3ptp4l0-21swapper/008:03:000
114091200,0ptp4l0-21swapper/611:40:376
114091200,0ptp4l0-21swapper/611:00:576
114091200,0ptp4l0-21swapper/608:33:156
114091200,0ptp4l0-21swapper/607:48:316
114091200,0ptp4l0-21swapper/607:14:516
114091200,0ptp4l0-21swapper/508:19:465
114091200,0ptp4l0-21swapper/410:17:514
114091200,0ptp4l0-21swapper/211:50:402
114091200,0ptp4l0-21swapper/210:53:132
114091200,0ptp4l0-21swapper/207:58:082
114091200,0ptp4l0-21swapper/012:19:110
114091200,0ptp4l0-21swapper/008:20:170
114091190,3ptp4l28115-21kworker/0:007:55:420
114091190,1ptp4l1084-21snmpd07:24:206
114091190,0ptp4l0-21swapper/611:56:056
114091190,0ptp4l0-21swapper/611:26:406
114091190,0ptp4l0-21swapper/610:35:006
114091190,0ptp4l0-21swapper/610:17:576
114091190,0ptp4l0-21swapper/609:34:546
114091190,0ptp4l0-21swapper/607:52:396
114091190,0ptp4l0-21swapper/508:25:195
114091190,0ptp4l0-21swapper/409:09:354
114091190,0ptp4l0-21swapper/408:02:514
114091190,0ptp4l0-21swapper/211:46:292
114091190,0ptp4l0-21swapper/211:14:282
114091190,0ptp4l0-21swapper/210:09:162
114091190,0ptp4l0-21swapper/209:19:592
114091190,0ptp4l0-21swapper/208:14:552
114091190,0ptp4l0-21swapper/108:00:191
114091190,0ptp4l0-21swapper/012:36:230
114091190,0ptp4l0-21swapper/008:33:350
114091190,0ptp4l0-21swapper/007:45:150
114091180,0ptp4l0-21swapper/610:53:156
114091180,0ptp4l0-21swapper/408:16:204
114091180,0ptp4l0-21swapper/407:19:394
114091180,0ptp4l0-21swapper/307:44:203
114091180,0ptp4l0-21swapper/211:15:102
114091180,0ptp4l0-21swapper/208:52:452
226372170,0sleep70-21swapper/710:10:117
114091170,0ptp4l0-21swapper/210:12:342
114091170,0ptp4l0-21swapper/008:45:210
114091170,0ptp4l0-21swapper/007:35:200
114091160,1ptp4l13383-21runrttasks08:09:504
114091160,0ptp4l0-21swapper/611:09:456
114091160,0ptp4l0-21swapper/608:14:226
114091160,0ptp4l0-21swapper/407:55:454
114091160,0ptp4l0-21swapper/211:40:362
114091160,0ptp4l0-21swapper/209:09:552
114091160,0ptp4l0-21swapper/207:48:532
114091160,0ptp4l0-21swapper/107:16:491
114091160,0ptp4l0-21swapper/009:05:270
114091160,0ptp4l0-21swapper/008:50:480
114091160,0ptp4l0-21swapper/008:09:140
114091160,0ptp4l0-21swapper/007:33:400
114091150,0ptp4l0-21swapper/708:20:487
114091150,0ptp4l0-21swapper/707:10:067
114091150,0ptp4l0-21swapper/608:49:026
114091150,0ptp4l0-21swapper/608:26:276
114091150,0ptp4l0-21swapper/608:20:006
114091150,0ptp4l0-21swapper/608:05:366
114091150,0ptp4l0-21swapper/607:57:446
114091150,0ptp4l0-21swapper/607:44:086
114091150,0ptp4l0-21swapper/607:31:446
114091150,0ptp4l0-21swapper/409:00:314
114091150,0ptp4l0-21swapper/409:00:314
114091150,0ptp4l0-21swapper/408:51:024
114091150,0ptp4l0-21swapper/408:38:124
114091150,0ptp4l0-21swapper/408:30:264
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional