You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-02 - 22:35

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackcslot8s.osadl.org (updated Tue Dec 02, 2025 12:46:10)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
80992620,0sleep50-21swapper/509:38:265
114091610,5ptp4l0-21swapper/507:05:335
114091610,5ptp4l0-21swapper/407:05:104
114091610,25ptp4l0-21swapper/107:05:231
294322600,0sleep10-21swapper/111:31:241
294322600,0sleep10-21swapper/111:31:241
2120916049,6phc2sys0-21swapper/707:05:337
114091600,28ptp4l0-21swapper/307:09:073
114091600,26ptp4l0-21swapper/007:07:220
2680225747,6sleep60-21swapper/607:09:136
2650225039,6sleep20-21swapper/207:05:242
114091330,0ptp4l0-21swapper/512:31:065
114091330,0ptp4l0-21swapper/512:15:345
114091330,0ptp4l0-21swapper/510:44:565
114091330,0ptp4l0-21swapper/210:27:182
114091320,0ptp4l17997-21diskmemload12:09:436
114091320,0ptp4l0-21swapper/510:49:015
114091320,0ptp4l0-21swapper/510:25:215
114091320,0ptp4l0-21swapper/509:00:175
114091320,0ptp4l0-21swapper/509:00:175
114091310,0ptp4l0-21swapper/510:51:355
114091310,0ptp4l0-21swapper/211:40:392
114091300,0ptp4l0-21swapper/611:22:446
114091300,0ptp4l0-21swapper/512:11:225
114091300,0ptp4l0-21swapper/511:34:265
114091300,0ptp4l0-21swapper/511:34:265
114091300,0ptp4l0-21swapper/510:09:195
114091300,0ptp4l0-21swapper/509:17:195
114091300,0ptp4l0-21swapper/508:27:195
114091300,0ptp4l0-21swapper/507:55:185
114091300,0ptp4l0-21swapper/410:35:214
114091300,0ptp4l0-21swapper/311:34:083
114091300,0ptp4l0-21swapper/311:34:083
114091300,0ptp4l0-21swapper/210:54:172
114091300,0ptp4l0-21swapper/208:25:202
114091300,0ptp4l0-21swapper/012:09:060
114091300,0ptp4l0-21swapper/010:19:580
114091290,3ptp4l641ktimersoftd/610:10:226
114091290,0ptp4l0-21swapper/611:45:346
114091290,0ptp4l0-21swapper/609:15:306
114091290,0ptp4l0-21swapper/511:53:115
114091290,0ptp4l0-21swapper/511:18:305
114091290,0ptp4l0-21swapper/511:04:135
114091290,0ptp4l0-21swapper/509:28:285
114091290,0ptp4l0-21swapper/210:32:452
114091290,0ptp4l0-21swapper/109:44:131
114091280,0ptp4l0-21swapper/610:27:536
114091280,0ptp4l0-21swapper/609:49:176
114091280,0ptp4l0-21swapper/512:21:085
114091280,0ptp4l0-21swapper/512:02:415
114091280,0ptp4l0-21swapper/509:42:075
114091280,0ptp4l0-21swapper/509:32:535
114091280,0ptp4l0-21swapper/509:13:195
114091280,0ptp4l0-21swapper/508:30:195
114091280,0ptp4l0-21swapper/412:35:144
114091280,0ptp4l0-21swapper/209:56:372
114091280,0ptp4l0-21swapper/208:20:102
114091280,0ptp4l0-21swapper/111:56:021
114091270,0ptp4l0-21swapper/411:31:554
114091270,0ptp4l0-21swapper/411:31:554
114091270,0ptp4l0-21swapper/111:07:411
114091270,0ptp4l0-21swapper/110:08:101
114091270,0ptp4l0-21swapper/012:14:440
114091270,0ptp4l0-21swapper/011:19:520
114091270,0ptp4l0-21swapper/010:12:250
114091260,0ptp4l0-21swapper/612:12:596
114091260,0ptp4l0-21swapper/607:57:046
114091260,0ptp4l0-21swapper/511:45:575
114091260,0ptp4l0-21swapper/511:35:225
114091260,0ptp4l0-21swapper/511:35:225
114091260,0ptp4l0-21swapper/510:19:255
114091260,0ptp4l0-21swapper/507:48:135
114091260,0ptp4l0-21swapper/211:39:432
114091260,0ptp4l0-21swapper/211:39:432
114091260,0ptp4l0-21swapper/209:10:192
114091260,0ptp4l0-21swapper/109:28:271
114091260,0ptp4l0-21swapper/109:23:311
114091260,0ptp4l0-21swapper/109:12:041
114091260,0ptp4l0-21swapper/011:37:080
114091260,0ptp4l0-21swapper/011:37:070
114091260,0ptp4l0-21swapper/010:45:430
114091250,2ptp4l0-21swapper/608:05:016
114091250,1ptp4l3975-21sed07:25:201
114091250,1ptp4l14706-21ssh11:12:091
114091250,1ptp4l10509-21ls08:50:200
114091250,0ptp4l0-21swapper/608:35:146
114091250,0ptp4l0-21swapper/511:58:265
114091250,0ptp4l0-21swapper/511:21:085
114091250,0ptp4l0-21swapper/510:20:155
114091250,0ptp4l0-21swapper/508:46:195
114091250,0ptp4l0-21swapper/508:12:135
114091250,0ptp4l0-21swapper/507:51:215
114091250,0ptp4l0-21swapper/507:16:055
114091250,0ptp4l0-21swapper/411:35:144
114091250,0ptp4l0-21swapper/411:35:144
114091250,0ptp4l0-21swapper/410:58:024
114091250,0ptp4l0-21swapper/410:23:384
114091250,0ptp4l0-21swapper/409:26:234
114091250,0ptp4l0-21swapper/408:50:214
114091250,0ptp4l0-21swapper/212:03:462
114091250,0ptp4l0-21swapper/210:10:172
114091250,0ptp4l0-21swapper/208:50:002
114091250,0ptp4l0-21swapper/207:34:562
114091250,0ptp4l0-21swapper/111:02:211
114091250,0ptp4l0-21swapper/110:50:511
114091250,0ptp4l0-21swapper/110:48:261
114091250,0ptp4l0-21swapper/110:42:341
114091250,0ptp4l0-21swapper/110:14:301
114091250,0ptp4l0-21swapper/012:02:110
114091250,0ptp4l0-21swapper/008:16:280
114091250,0ptp4l0-21swapper/007:50:100
114091240,3ptp4l561ktimersoftd/509:20:395
114091240,3ptp4l0-21swapper/511:29:495
114091240,1ptp4l9638-21diskstats07:40:125
114091240,1ptp4l7791-21needreboot08:45:184
114091240,1ptp4l5561-21smartctl09:35:141
114091240,1ptp4l29662-21vmstat10:05:216
114091240,1ptp4l2912-21fw_forwarded_lo11:40:166
114091240,1ptp4l20069-21tr11:20:111
114091240,1ptp4l17997-21diskmemload11:55:182
114091240,1ptp4l12796-21idleruntime11:10:165
114091240,1ptp4l11104-21munin-run08:55:001
114091240,0ptp4l17997-21diskmemload10:25:141
114091240,0ptp4l0-21swapper/611:58:476
114091240,0ptp4l0-21swapper/610:01:516
114091240,0ptp4l0-21swapper/608:24:586
114091240,0ptp4l0-21swapper/608:17:016
114091240,0ptp4l0-21swapper/508:58:135
114091240,0ptp4l0-21swapper/508:58:135
114091240,0ptp4l0-21swapper/508:53:595
114091240,0ptp4l0-21swapper/508:20:335
114091240,0ptp4l0-21swapper/508:00:035
114091240,0ptp4l0-21swapper/507:27:275
114091240,0ptp4l0-21swapper/507:10:145
114091240,0ptp4l0-21swapper/412:10:144
114091240,0ptp4l0-21swapper/411:52:094
114091240,0ptp4l0-21swapper/410:53:194
114091240,0ptp4l0-21swapper/409:21:384
114091240,0ptp4l0-21swapper/211:22:412
114091240,0ptp4l0-21swapper/208:50:022
114091240,0ptp4l0-21swapper/208:05:072
114091240,0ptp4l0-21swapper/207:52:322
114091240,0ptp4l0-21swapper/109:30:131
114091240,0ptp4l0-21swapper/109:05:201
114091240,0ptp4l0-21swapper/107:55:221
114091240,0ptp4l0-21swapper/107:20:121
114091240,0ptp4l0-21swapper/011:10:230
114091240,0ptp4l0-21swapper/010:04:070
114091240,0ptp4l0-21swapper/009:52:290
114091240,0ptp4l0-21swapper/009:15:070
114091240,0ptp4l0-21swapper/007:27:100
2716399230,5cyclictest0-21swapper/508:05:495
114091230,1ptp4l8171-21ssh09:38:340
114091230,1ptp4l8151-21ssh10:20:181
114091230,1ptp4l57-21ksoftirqd/512:07:245
114091230,1ptp4l57-21ksoftirqd/509:45:365
114091230,1ptp4l31967-21latency11:35:181
114091230,1ptp4l31967-21latency11:35:171
114091230,1ptp4l30744-21ssh10:08:070
114091230,1ptp4l22693-21hddtemp_smartct09:15:144
114091230,1ptp4l20766-21missed_timers11:20:164
114091230,1ptp4l16145-21sed07:55:001
114091230,1ptp4l12754-21sensors_fan07:45:194
114091230,0ptp4l0-21swapper/611:39:416
114091230,0ptp4l0-21swapper/611:39:416
114091230,0ptp4l0-21swapper/610:30:116
114091230,0ptp4l0-21swapper/609:55:186
114091230,0ptp4l0-21swapper/609:10:156
114091230,0ptp4l0-21swapper/608:25:126
114091230,0ptp4l0-21swapper/512:35:225
114091230,0ptp4l0-21swapper/512:28:115
114091230,0ptp4l0-21swapper/510:00:175
114091230,0ptp4l0-21swapper/508:40:195
114091230,0ptp4l0-21swapper/412:25:164
114091230,0ptp4l0-21swapper/412:25:004
114091230,0ptp4l0-21swapper/412:05:524
114091230,0ptp4l0-21swapper/412:00:134
114091230,0ptp4l0-21swapper/410:13:294
114091230,0ptp4l0-21swapper/407:50:124
114091230,0ptp4l0-21swapper/211:45:122
114091230,0ptp4l0-21swapper/209:54:572
114091230,0ptp4l0-21swapper/112:35:161
114091230,0ptp4l0-21swapper/112:30:171
114091230,0ptp4l0-21swapper/112:29:261
114091230,0ptp4l0-21swapper/112:20:191
114091230,0ptp4l0-21swapper/112:15:011
114091230,0ptp4l0-21swapper/112:05:171
114091230,0ptp4l0-21swapper/111:50:171
114091230,0ptp4l0-21swapper/111:47:291
114091230,0ptp4l0-21swapper/111:26:161
114091230,0ptp4l0-21swapper/111:15:201
114091230,0ptp4l0-21swapper/110:00:121
114091230,0ptp4l0-21swapper/109:45:141
114091230,0ptp4l0-21swapper/109:02:591
114091230,0ptp4l0-21swapper/109:02:591
114091230,0ptp4l0-21swapper/108:55:191
114091230,0ptp4l0-21swapper/108:55:191
114091230,0ptp4l0-21swapper/108:30:181
114091230,0ptp4l0-21swapper/108:15:111
114091230,0ptp4l0-21swapper/108:10:131
114091230,0ptp4l0-21swapper/107:40:131
114091230,0ptp4l0-21swapper/107:35:201
114091230,0ptp4l0-21swapper/107:15:131
114091230,0ptp4l0-21swapper/107:10:121
114091230,0ptp4l0-21swapper/012:20:010
114091230,0ptp4l0-21swapper/011:52:190
114091230,0ptp4l0-21swapper/011:20:160
114091230,0ptp4l0-21swapper/011:05:130
114091230,0ptp4l0-21swapper/010:58:040
114091230,0ptp4l0-21swapper/009:28:050
114091230,0ptp4l0-21swapper/009:08:340
114091230,0ptp4l0-21swapper/008:45:160
114091230,0ptp4l0-21swapper/007:40:000
114091230,0ptp4l0-21swapper/007:30:230
114091230,0ptp4l0-21swapper/007:20:000
114091220,1ptp4l49-21ksoftirqd/410:06:404
114091220,1ptp4l17997-21diskmemload10:25:320
114091220,1ptp4l17997-21diskmemload09:58:274
114091220,0ptp4l0-21swapper/711:33:437
114091220,0ptp4l0-21swapper/711:33:427
114091220,0ptp4l0-21swapper/611:51:446
114091220,0ptp4l0-21swapper/610:38:516
114091220,0ptp4l0-21swapper/609:50:016
114091220,0ptp4l0-21swapper/511:44:345
114091220,0ptp4l0-21swapper/511:05:215
114091220,0ptp4l0-21swapper/510:55:215
114091220,0ptp4l0-21swapper/510:36:215
114091220,0ptp4l0-21swapper/510:33:275
114091220,0ptp4l0-21swapper/510:10:155
114091220,0ptp4l0-21swapper/509:56:115
114091220,0ptp4l0-21swapper/509:50:215
114091220,0ptp4l0-21swapper/509:05:165
114091220,0ptp4l0-21swapper/508:15:195
114091220,0ptp4l0-21swapper/507:35:215
114091220,0ptp4l0-21swapper/507:30:205
114091220,0ptp4l0-21swapper/507:20:135
114091220,0ptp4l0-21swapper/411:48:054
114091220,0ptp4l0-21swapper/411:27:114
114091220,0ptp4l0-21swapper/411:15:034
114091220,0ptp4l0-21swapper/411:05:144
114091220,0ptp4l0-21swapper/411:02:504
114091220,0ptp4l0-21swapper/410:45:474
114091220,0ptp4l0-21swapper/410:25:344
114091220,0ptp4l0-21swapper/410:00:424
114091220,0ptp4l0-21swapper/409:50:184
114091220,0ptp4l0-21swapper/409:48:504
114091220,0ptp4l0-21swapper/409:44:354
114091220,0ptp4l0-21swapper/409:30:564
114091220,0ptp4l0-21swapper/407:35:234
114091220,0ptp4l0-21swapper/212:12:132
114091220,0ptp4l0-21swapper/212:09:052
114091220,0ptp4l0-21swapper/211:50:472
114091220,0ptp4l0-21swapper/210:05:002
114091220,0ptp4l0-21swapper/209:49:312
114091220,0ptp4l0-21swapper/209:15:192
114091220,0ptp4l0-21swapper/208:35:142
114091220,0ptp4l0-21swapper/112:15:121
114091220,0ptp4l0-21swapper/112:00:031
114091220,0ptp4l0-21swapper/110:55:191
114091220,0ptp4l0-21swapper/110:35:561
114091220,0ptp4l0-21swapper/110:15:141
114091220,0ptp4l0-21swapper/109:58:321
114091220,0ptp4l0-21swapper/109:51:261
114091220,0ptp4l0-21swapper/109:16:011
114091220,0ptp4l0-21swapper/108:40:131
114091220,0ptp4l0-21swapper/108:20:191
114091220,0ptp4l0-21swapper/108:00:151
114091220,0ptp4l0-21swapper/107:45:161
114091220,0ptp4l0-21swapper/107:30:151
114091220,0ptp4l0-21swapper/012:39:090
114091220,0ptp4l0-21swapper/012:25:120
114091220,0ptp4l0-21swapper/011:56:500
114091220,0ptp4l0-21swapper/011:48:210
114091220,0ptp4l0-21swapper/011:30:190
114091220,0ptp4l0-21swapper/011:30:180
114091220,0ptp4l0-21swapper/011:28:160
114091220,0ptp4l0-21swapper/010:50:130
114091220,0ptp4l0-21swapper/010:35:160
114091220,0ptp4l0-21swapper/010:34:550
114091220,0ptp4l0-21swapper/010:23:380
114091220,0ptp4l0-21swapper/009:58:570
114091220,0ptp4l0-21swapper/009:46:390
114091220,0ptp4l0-21swapper/009:42:330
114091220,0ptp4l0-21swapper/009:32:190
114091220,0ptp4l0-21swapper/009:21:420
114091220,0ptp4l0-21swapper/009:12:260
114091220,0ptp4l0-21swapper/009:04:570
114091220,0ptp4l0-21swapper/009:04:570
114091220,0ptp4l0-21swapper/008:30:200
114091220,0ptp4l0-21swapper/008:20:000
114091220,0ptp4l0-21swapper/008:08:300
114091220,0ptp4l0-21swapper/007:45:180
114091210,1ptp4l0-21swapper/607:33:466
114091210,0ptp4l0-21swapper/612:03:306
114091210,0ptp4l0-21swapper/607:52:196
114091210,0ptp4l0-21swapper/508:35:015
114091210,0ptp4l0-21swapper/412:34:244
114091210,0ptp4l0-21swapper/412:16:204
114091210,0ptp4l0-21swapper/411:56:554
114091210,0ptp4l0-21swapper/411:14:084
114091210,0ptp4l0-21swapper/410:40:074
114091210,0ptp4l0-21swapper/410:33:334
114091210,0ptp4l0-21swapper/410:19:304
114091210,0ptp4l0-21swapper/409:35:354
114091210,0ptp4l0-21swapper/409:14:044
114091210,0ptp4l0-21swapper/409:08:314
114091210,0ptp4l0-21swapper/408:11:114
114091210,0ptp4l0-21swapper/210:37:232
114091210,0ptp4l0-21swapper/210:01:312
114091210,0ptp4l0-21swapper/209:41:062
114091210,0ptp4l0-21swapper/208:18:302
114091210,0ptp4l0-21swapper/207:18:292
114091210,0ptp4l0-21swapper/110:33:101
114091210,0ptp4l0-21swapper/108:47:261
114091210,0ptp4l0-21swapper/012:30:060
114091210,0ptp4l0-21swapper/012:16:310
114091210,0ptp4l0-21swapper/011:00:000
42092200,1sleep3725-21systemd-logind08:40:003
114091200,0ptp4l0-21swapper/610:17:476
114091200,0ptp4l0-21swapper/607:17:086
114091200,0ptp4l0-21swapper/409:04:554
114091200,0ptp4l0-21swapper/409:04:554
114091200,0ptp4l0-21swapper/408:44:514
114091200,0ptp4l0-21swapper/408:08:474
114091200,0ptp4l0-21swapper/111:44:181
114091200,0ptp4l0-21swapper/010:40:390
114091190,1ptp4l4084-21pgrep08:38:304
114091190,0ptp4l0-21swapper/407:59:494
114091190,0ptp4l0-21swapper/007:35:240
114091190,0ptp4l0-21swapper/007:23:290
114091190,0ptp4l0-21swapper/007:12:190
114091180,0ptp4l0-21swapper/610:54:166
114091180,0ptp4l0-21swapper/210:17:492
114091180,0ptp4l0-21swapper/108:37:241
114091170,0ptp4l0-21swapper/611:19:426
114091170,0ptp4l0-21swapper/609:41:026
114091170,0ptp4l0-21swapper/211:19:442
114091160,0ptp4l0-21swapper/608:04:326
114091160,0ptp4l0-21swapper/607:35:016
114091160,0ptp4l0-21swapper/411:44:314
114091160,0ptp4l0-21swapper/408:59:524
114091160,0ptp4l0-21swapper/408:59:524
114091160,0ptp4l0-21swapper/408:33:104
114091160,0ptp4l0-21swapper/407:40:544
114091160,0ptp4l0-21swapper/407:25:544
114091160,0ptp4l0-21swapper/407:16:164
114091160,0ptp4l0-21swapper/209:08:572
114091160,0ptp4l0-21swapper/208:04:332
114091160,0ptp4l0-21swapper/207:57:162
114091160,0ptp4l0-21swapper/108:27:221
114091160,0ptp4l0-21swapper/007:55:090
114091150,0ptp4l0-21swapper/609:09:086
114091150,0ptp4l0-21swapper/608:50:016
114091150,0ptp4l0-21swapper/608:49:506
114091150,0ptp4l0-21swapper/608:30:546
114091150,0ptp4l0-21swapper/607:26:306
114091150,0ptp4l0-21swapper/408:25:554
114091150,0ptp4l0-21swapper/408:20:454
114091150,0ptp4l0-21swapper/408:16:174
114091150,0ptp4l0-21swapper/408:00:354
114091150,0ptp4l0-21swapper/407:30:014
114091150,0ptp4l0-21swapper/407:20:014
114091150,0ptp4l0-21swapper/407:10:424
114091150,0ptp4l0-21swapper/212:37:542
114091150,0ptp4l0-21swapper/208:30:482
114091150,0ptp4l0-21swapper/207:35:002
114091150,0ptp4l0-21swapper/207:26:312
114091150,0ptp4l0-21swapper/108:06:591
114091150,0ptp4l0-21swapper/008:40:470
114091150,0ptp4l0-21swapper/008:35:380
114091150,0ptp4l0-21swapper/008:25:480
114091150,0ptp4l0-21swapper/008:10:310
114091150,0ptp4l0-21swapper/008:01:160
2717799140,1cyclictest0-21swapper/711:40:007
2717799140,1cyclictest0-21swapper/711:40:007
114091140,0ptp4l0-21swapper/008:57:500
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional