You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-29 - 03:15

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackcslot8s.osadl.org (updated Fri Nov 28, 2025 12:46:10)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
334121020,0sleep40-21swapper/411:58:014
102132660,0sleep50-21swapper/512:06:445
102132660,0sleep50-21swapper/512:06:445
167232640,0sleep30-21swapper/308:20:193
110092640,1sleep30-21swapper/312:08:503
110092640,1sleep30-21swapper/312:08:503
70692620,0sleep30-21swapper/310:35:173
114091620,29ptp4l0-21swapper/007:06:000
114091600,6ptp4l0-21swapper/207:09:302
114091600,5ptp4l0-21swapper/607:06:586
2120915734,7phc2sys0-21swapper/407:08:044
1440325736,6sleep30-21swapper/307:07:323
114091540,6ptp4l0-21swapper/107:05:201
114091520,5ptp4l0-21swapper/507:05:115
1439825039,6sleep70-21swapper/707:07:297
92672490,0sleep20-21swapper/212:05:222
92672490,0sleep20-21swapper/212:05:212
114091340,1ptp4l17335-21latency_hist09:25:006
114091330,1ptp4l32246-21ssh10:25:595
114091320,0ptp4l0-21swapper/712:03:037
114091320,0ptp4l0-21swapper/611:55:116
114091320,0ptp4l0-21swapper/111:15:141
114091310,0ptp4l0-21swapper/512:38:145
114091310,0ptp4l0-21swapper/511:39:245
114091310,0ptp4l0-21swapper/511:19:025
114091310,0ptp4l0-21swapper/410:32:424
114091300,4ptp4l0-21swapper/509:24:055
114091300,0ptp4l0-21swapper/708:35:117
114091300,0ptp4l0-21swapper/609:11:386
114091300,0ptp4l0-21swapper/510:20:165
114091300,0ptp4l0-21swapper/411:05:004
114091300,0ptp4l0-21swapper/410:28:424
114091300,0ptp4l0-21swapper/110:51:521
114091300,0ptp4l0-21swapper/110:38:421
114091300,0ptp4l0-21swapper/109:52:171
114091300,0ptp4l0-21swapper/010:28:350
14903992926,0cyclictest0-21swapper/510:45:555
114091290,0ptp4l0-21swapper/709:33:157
114091290,0ptp4l0-21swapper/709:33:157
114091290,0ptp4l0-21swapper/611:53:416
114091290,0ptp4l0-21swapper/509:50:405
114091290,0ptp4l0-21swapper/412:37:134
114091290,0ptp4l0-21swapper/409:42:524
114091290,0ptp4l0-21swapper/409:36:464
114091290,0ptp4l0-21swapper/409:36:464
114091290,0ptp4l0-21swapper/112:30:191
114091290,0ptp4l0-21swapper/010:35:560
114091280,0ptp4l0-21swapper/510:31:125
114091280,0ptp4l0-21swapper/508:00:115
114091280,0ptp4l0-21swapper/012:31:460
114091280,0ptp4l0-21swapper/012:26:180
114091270,3ptp4l0-21swapper/509:32:185
114091270,3ptp4l0-21swapper/509:32:185
114091270,0ptp4l0-21swapper/610:39:196
114091270,0ptp4l0-21swapper/609:54:196
114091270,0ptp4l0-21swapper/512:25:175
114091270,0ptp4l0-21swapper/510:01:105
114091270,0ptp4l0-21swapper/509:43:395
114091270,0ptp4l0-21swapper/411:33:524
114091270,0ptp4l0-21swapper/410:15:364
114091270,0ptp4l0-21swapper/112:02:011
114091270,0ptp4l0-21swapper/111:47:561
114091270,0ptp4l0-21swapper/109:56:541
114091270,0ptp4l0-21swapper/109:44:381
114091270,0ptp4l0-21swapper/108:05:141
114091270,0ptp4l0-21swapper/010:34:060
114091270,0ptp4l0-21swapper/009:44:060
14903992621,0cyclictest0-21swapper/512:18:145
114091260,1ptp4l5742-21diskmemload10:21:001
114091260,1ptp4l32666-21smartctl08:55:180
114091260,1ptp4l17163-21df10:50:135
114091260,1ptp4l0-21swapper/010:16:390
114091260,0ptp4l0-21swapper/709:23:157
114091260,0ptp4l0-21swapper/611:04:526
114091260,0ptp4l0-21swapper/609:55:146
114091260,0ptp4l0-21swapper/609:38:096
114091260,0ptp4l0-21swapper/609:38:096
114091260,0ptp4l0-21swapper/512:30:085
114091260,0ptp4l0-21swapper/512:24:255
114091260,0ptp4l0-21swapper/511:52:035
114091260,0ptp4l0-21swapper/511:01:595
114091260,0ptp4l0-21swapper/509:58:025
114091260,0ptp4l0-21swapper/508:45:155
114091260,0ptp4l0-21swapper/507:50:155
114091260,0ptp4l0-21swapper/507:30:155
114091260,0ptp4l0-21swapper/411:25:244
114091260,0ptp4l0-21swapper/410:44:444
114091260,0ptp4l0-21swapper/409:21:074
114091260,0ptp4l0-21swapper/212:18:132
114091260,0ptp4l0-21swapper/209:11:432
114091260,0ptp4l0-21swapper/111:58:191
114091260,0ptp4l0-21swapper/111:40:291
114091260,0ptp4l0-21swapper/111:37:101
114091260,0ptp4l0-21swapper/111:25:141
114091260,0ptp4l0-21swapper/111:02:001
114091260,0ptp4l0-21swapper/110:31:221
114091250,1ptp4l7267-21diskstats11:20:111
114091250,1ptp4l29648-21sh11:50:121
114091250,1ptp4l20501-21expr12:20:194
114091250,0ptp4l0-21swapper/707:55:107
114091250,0ptp4l0-21swapper/512:14:085
114091250,0ptp4l0-21swapper/512:14:085
114091250,0ptp4l0-21swapper/512:00:365
114091250,0ptp4l0-21swapper/511:43:065
114091250,0ptp4l0-21swapper/511:20:185
114091250,0ptp4l0-21swapper/412:09:114
114091250,0ptp4l0-21swapper/412:09:114
114091250,0ptp4l0-21swapper/411:43:394
114091250,0ptp4l0-21swapper/409:29:364
114091250,0ptp4l0-21swapper/309:23:543
114091250,0ptp4l0-21swapper/110:05:141
114091250,0ptp4l0-21swapper/110:01:191
114091250,0ptp4l0-21swapper/109:12:581
114091250,0ptp4l0-21swapper/011:24:270
114091250,0ptp4l0-21swapper/008:20:190
114091250,0ptp4l0-21swapper/007:10:200
14903992421,0cyclictest0-21swapper/509:18:305
114091240,1ptp4l9695-21df_inode10:40:111
114091240,1ptp4l28044-21latency_hist11:05:000
114091240,1ptp4l24770-21grep08:40:104
114091240,1ptp4l23712-21ssh10:59:035
114091240,1ptp4l21758-21/usr/sbin/munin10:55:160
114091240,1ptp4l15739-21kernelversion07:10:162
114091240,1ptp4l12669-21munin-run10:45:000
114091240,1ptp4l10576-21/usr/sbin/munin09:15:161
114091240,1ptp4l0-21swapper/112:35:241
114091240,0ptp4l15404-21open_inodes11:30:172
114091240,0ptp4l14086-21strings08:15:161
114091240,0ptp4l0-21swapper/611:35:226
114091240,0ptp4l0-21swapper/511:47:225
114091240,0ptp4l0-21swapper/511:10:285
114091240,0ptp4l0-21swapper/510:40:115
114091240,0ptp4l0-21swapper/510:10:145
114091240,0ptp4l0-21swapper/509:13:585
114091240,0ptp4l0-21swapper/508:50:125
114091240,0ptp4l0-21swapper/507:35:145
114091240,0ptp4l0-21swapper/411:10:134
114091240,0ptp4l0-21swapper/410:55:124
114091240,0ptp4l0-21swapper/410:52:114
114091240,0ptp4l0-21swapper/410:47:044
114091240,0ptp4l0-21swapper/410:05:134
114091240,0ptp4l0-21swapper/409:45:514
114091240,0ptp4l0-21swapper/409:14:554
114091240,0ptp4l0-21swapper/408:45:384
114091240,0ptp4l0-21swapper/408:00:194
114091240,0ptp4l0-21swapper/310:45:213
114091240,0ptp4l0-21swapper/211:55:192
114091240,0ptp4l0-21swapper/210:39:252
114091240,0ptp4l0-21swapper/207:15:012
114091240,0ptp4l0-21swapper/112:21:521
114091240,0ptp4l0-21swapper/112:16:421
114091240,0ptp4l0-21swapper/112:05:161
114091240,0ptp4l0-21swapper/112:05:161
114091240,0ptp4l0-21swapper/110:18:131
114091240,0ptp4l0-21swapper/108:50:161
114091240,0ptp4l0-21swapper/108:30:141
114091240,0ptp4l0-21swapper/108:25:101
114091240,0ptp4l0-21swapper/010:11:320
114091240,0ptp4l0-21swapper/009:50:130
114091230,1ptp4l8831-21expr08:05:114
114091230,1ptp4l27310-21ssh11:45:443
114091230,1ptp4l1486799cyclictest07:25:170
114091230,1ptp4l13511-21ssh09:19:554
114091230,1ptp4l1283-21ssh10:29:372
114091230,0ptp4l0-21swapper/710:45:197
114091230,0ptp4l0-21swapper/707:17:557
114091230,0ptp4l0-21swapper/610:51:226
114091230,0ptp4l0-21swapper/609:25:146
114091230,0ptp4l0-21swapper/609:18:416
114091230,0ptp4l0-21swapper/511:28:495
114091230,0ptp4l0-21swapper/511:05:155
114091230,0ptp4l0-21swapper/510:35:155
114091230,0ptp4l0-21swapper/509:45:125
114091230,0ptp4l0-21swapper/509:00:165
114091230,0ptp4l0-21swapper/508:55:115
114091230,0ptp4l0-21swapper/508:30:155
114091230,0ptp4l0-21swapper/508:25:125
114091230,0ptp4l0-21swapper/508:15:125
114091230,0ptp4l0-21swapper/508:10:105
114091230,0ptp4l0-21swapper/507:45:145
114091230,0ptp4l0-21swapper/507:40:175
114091230,0ptp4l0-21swapper/507:20:195
114091230,0ptp4l0-21swapper/412:25:554
114091230,0ptp4l0-21swapper/412:15:174
114091230,0ptp4l0-21swapper/411:22:104
114091230,0ptp4l0-21swapper/411:01:164
114091230,0ptp4l0-21swapper/410:35:104
114091230,0ptp4l0-21swapper/410:21:404
114091230,0ptp4l0-21swapper/410:00:154
114091230,0ptp4l0-21swapper/409:50:204
114091230,0ptp4l0-21swapper/409:30:124
114091230,0ptp4l0-21swapper/409:30:124
114091230,0ptp4l0-21swapper/408:25:184
114091230,0ptp4l0-21swapper/408:20:214
114091230,0ptp4l0-21swapper/312:02:343
114091230,0ptp4l0-21swapper/309:33:303
114091230,0ptp4l0-21swapper/309:33:293
114091230,0ptp4l0-21swapper/308:35:103
114091230,0ptp4l0-21swapper/212:39:012
114091230,0ptp4l0-21swapper/212:25:412
114091230,0ptp4l0-21swapper/211:52:482
114091230,0ptp4l0-21swapper/210:53:522
114091230,0ptp4l0-21swapper/209:55:172
114091230,0ptp4l0-21swapper/209:25:152
114091230,0ptp4l0-21swapper/208:20:182
114091230,0ptp4l0-21swapper/112:25:131
114091230,0ptp4l0-21swapper/111:32:081
114091230,0ptp4l0-21swapper/111:10:151
114091230,0ptp4l0-21swapper/111:05:171
114091230,0ptp4l0-21swapper/110:46:201
114091230,0ptp4l0-21swapper/110:25:201
114091230,0ptp4l0-21swapper/110:10:121
114091230,0ptp4l0-21swapper/109:45:121
114091230,0ptp4l0-21swapper/109:28:291
114091230,0ptp4l0-21swapper/109:20:121
114091230,0ptp4l0-21swapper/109:00:201
114091230,0ptp4l0-21swapper/108:55:151
114091230,0ptp4l0-21swapper/108:00:161
114091230,0ptp4l0-21swapper/107:45:161
114091230,0ptp4l0-21swapper/107:35:191
114091230,0ptp4l0-21swapper/107:30:151
114091230,0ptp4l0-21swapper/107:25:131
114091230,0ptp4l0-21swapper/012:22:120
114091230,0ptp4l0-21swapper/012:08:180
114091230,0ptp4l0-21swapper/012:08:180
114091230,0ptp4l0-21swapper/012:04:110
114091230,0ptp4l0-21swapper/011:56:510
114091230,0ptp4l0-21swapper/011:45:160
114091230,0ptp4l0-21swapper/011:15:220
114091230,0ptp4l0-21swapper/010:45:530
114091230,0ptp4l0-21swapper/010:05:110
114091230,0ptp4l0-21swapper/010:00:460
114091230,0ptp4l0-21swapper/009:35:210
114091230,0ptp4l0-21swapper/009:35:210
114091230,0ptp4l0-21swapper/009:30:110
114091230,0ptp4l0-21swapper/009:30:110
114091230,0ptp4l0-21swapper/009:29:340
114091230,0ptp4l0-21swapper/009:05:210
114091230,0ptp4l0-21swapper/008:40:130
114091230,0ptp4l0-21swapper/008:05:140
114091230,0ptp4l0-21swapper/008:00:140
114091230,0ptp4l0-21swapper/007:35:010
114091220,7ptp4l0-21swapper/612:06:266
114091220,7ptp4l0-21swapper/612:06:266
114091220,0ptp4l0-21swapper/711:45:427
114091220,0ptp4l0-21swapper/711:23:287
114091220,0ptp4l0-21swapper/612:38:466
114091220,0ptp4l0-21swapper/611:30:146
114091220,0ptp4l0-21swapper/611:25:006
114091220,0ptp4l0-21swapper/610:29:386
114091220,0ptp4l0-21swapper/609:46:576
114091220,0ptp4l0-21swapper/608:20:126
114091220,0ptp4l0-21swapper/607:15:156
114091220,0ptp4l0-21swapper/607:10:186
114091220,0ptp4l0-21swapper/511:57:485
114091220,0ptp4l0-21swapper/510:15:155
114091220,0ptp4l0-21swapper/510:05:175
114091220,0ptp4l0-21swapper/509:35:015
114091220,0ptp4l0-21swapper/509:35:015
114091220,0ptp4l0-21swapper/509:05:155
114091220,0ptp4l0-21swapper/507:59:115
114091220,0ptp4l0-21swapper/412:32:044
114091220,0ptp4l0-21swapper/412:10:344
114091220,0ptp4l0-21swapper/412:10:344
114091220,0ptp4l0-21swapper/412:00:584
114091220,0ptp4l0-21swapper/411:50:204
114091220,0ptp4l0-21swapper/411:45:004
114091220,0ptp4l0-21swapper/411:36:294
114091220,0ptp4l0-21swapper/411:15:594
114091220,0ptp4l0-21swapper/409:07:444
114091220,0ptp4l0-21swapper/408:55:204
114091220,0ptp4l0-21swapper/408:31:054
114091220,0ptp4l0-21swapper/407:55:184
114091220,0ptp4l0-21swapper/407:10:204
114091220,0ptp4l0-21swapper/308:32:373
114091220,0ptp4l0-21swapper/308:04:493
114091220,0ptp4l0-21swapper/307:55:103
114091220,0ptp4l0-21swapper/211:35:202
114091220,0ptp4l0-21swapper/211:25:132
114091220,0ptp4l0-21swapper/211:16:402
114091220,0ptp4l0-21swapper/210:56:012
114091220,0ptp4l0-21swapper/209:53:092
114091220,0ptp4l0-21swapper/209:47:002
114091220,0ptp4l0-21swapper/209:18:242
114091220,0ptp4l0-21swapper/112:10:191
114091220,0ptp4l0-21swapper/112:10:191
114091220,0ptp4l0-21swapper/110:56:451
114091220,0ptp4l0-21swapper/109:35:141
114091220,0ptp4l0-21swapper/109:35:141
114091220,0ptp4l0-21swapper/109:31:461
114091220,0ptp4l0-21swapper/109:31:451
114091220,0ptp4l0-21swapper/109:05:131
114091220,0ptp4l0-21swapper/108:45:141
114091220,0ptp4l0-21swapper/108:10:161
114091220,0ptp4l0-21swapper/107:50:171
114091220,0ptp4l0-21swapper/107:20:361
114091220,0ptp4l0-21swapper/012:38:410
114091220,0ptp4l0-21swapper/012:15:120
114091220,0ptp4l0-21swapper/012:10:100
114091220,0ptp4l0-21swapper/012:10:100
114091220,0ptp4l0-21swapper/011:50:560
114091220,0ptp4l0-21swapper/011:41:350
114091220,0ptp4l0-21swapper/011:36:540
114091220,0ptp4l0-21swapper/011:33:480
114091220,0ptp4l0-21swapper/011:29:400
114091220,0ptp4l0-21swapper/011:10:140
114091220,0ptp4l0-21swapper/010:51:080
114091220,0ptp4l0-21swapper/010:20:180
114091220,0ptp4l0-21swapper/009:58:460
114091220,0ptp4l0-21swapper/009:49:220
114091220,0ptp4l0-21swapper/008:25:170
114091210,3ptp4l0-21swapper/208:02:032
114091210,0ptp4l0-21swapper/612:28:106
114091210,0ptp4l0-21swapper/612:24:066
114091210,0ptp4l0-21swapper/612:18:516
114091210,0ptp4l0-21swapper/611:16:346
114091210,0ptp4l0-21swapper/610:55:386
114091210,0ptp4l0-21swapper/610:06:176
114091210,0ptp4l0-21swapper/609:42:006
114091210,0ptp4l0-21swapper/609:32:586
114091210,0ptp4l0-21swapper/609:32:586
114091210,0ptp4l0-21swapper/608:56:386
114091210,0ptp4l0-21swapper/608:18:166
114091210,0ptp4l0-21swapper/607:36:356
114091210,0ptp4l0-21swapper/511:32:515
114091210,0ptp4l0-21swapper/509:27:185
114091210,0ptp4l0-21swapper/507:12:365
114091210,0ptp4l0-21swapper/410:11:084
114091210,0ptp4l0-21swapper/409:55:564
114091210,0ptp4l0-21swapper/311:23:333
114091210,0ptp4l0-21swapper/310:29:503
114091210,0ptp4l0-21swapper/309:49:553
114091210,0ptp4l0-21swapper/211:24:582
114091210,0ptp4l0-21swapper/211:03:562
114091210,0ptp4l0-21swapper/210:06:092
114091210,0ptp4l0-21swapper/209:41:552
114091210,0ptp4l0-21swapper/209:38:132
114091210,0ptp4l0-21swapper/209:38:132
114091210,0ptp4l0-21swapper/209:33:022
114091210,0ptp4l0-21swapper/209:33:022
114091210,0ptp4l0-21swapper/209:24:582
114091210,0ptp4l0-21swapper/207:36:212
114091210,0ptp4l0-21swapper/107:55:581
114091210,0ptp4l0-21swapper/011:09:300
114091210,0ptp4l0-21swapper/009:21:070
114091210,0ptp4l0-21swapper/009:16:320
114091210,0ptp4l0-21swapper/009:13:050
114091200,3ptp4l0-21swapper/408:54:134
114091200,2ptp4l0-21swapper/609:09:016
114091200,2ptp4l0-21swapper/407:23:014
114091200,0ptp4l0-21swapper/707:54:377
114091200,0ptp4l0-21swapper/611:25:116
114091200,0ptp4l0-21swapper/609:04:386
114091200,0ptp4l0-21swapper/608:53:246
114091200,0ptp4l0-21swapper/608:07:316
114091200,0ptp4l0-21swapper/607:33:346
114091200,0ptp4l0-21swapper/507:25:145
114091200,0ptp4l0-21swapper/408:39:444
114091200,0ptp4l0-21swapper/408:13:374
114091200,0ptp4l0-21swapper/407:26:004
114091200,0ptp4l0-21swapper/308:41:523
114091200,0ptp4l0-21swapper/209:09:382
114091200,0ptp4l0-21swapper/108:24:531
114091200,0ptp4l0-21swapper/107:40:191
114091200,0ptp4l0-21swapper/009:03:140
114091200,0ptp4l0-21swapper/008:49:380
114091200,0ptp4l0-21swapper/007:56:370
114091200,0ptp4l0-21swapper/007:51:470
114091190,0ptp4l0-21swapper/711:29:067
114091190,0ptp4l0-21swapper/710:29:497
114091190,0ptp4l0-21swapper/708:32:027
114091190,0ptp4l0-21swapper/607:57:236
114091190,0ptp4l0-21swapper/508:44:345
114091190,0ptp4l0-21swapper/508:23:345
114091190,0ptp4l0-21swapper/507:19:395
114091190,0ptp4l0-21swapper/409:03:094
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional