You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-16 - 05:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackcslot8s.osadl.org (updated Sun Nov 16, 2025 00:46:08)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
99612650,1sleep0111rcuc/019:45:190
114091620,5ptp4l0-21swapper/019:08:150
114091610,30ptp4l0-21swapper/119:09:211
114091600,5ptp4l0-21swapper/519:09:205
2417725836,7sleep30-21swapper/319:09:033
2402625747,6sleep70-21swapper/719:07:077
114091570,0ptp4l29475-21ssh22:11:190
2395825534,7sleep20-21swapper/219:06:212
2120915432,7phc2sys0-21swapper/419:05:214
2233924837,7sleep60-21swapper/619:05:056
114091320,0ptp4l0-21swapper/220:55:002
114091310,0ptp4l0-21swapper/119:55:151
114091300,0ptp4l0-21swapper/600:20:176
114091300,0ptp4l0-21swapper/123:03:381
114091300,0ptp4l0-21swapper/119:29:551
114091300,0ptp4l0-21swapper/119:20:181
114091290,0ptp4l0-21swapper/621:13:216
114091290,0ptp4l0-21swapper/421:20:194
114091290,0ptp4l0-21swapper/421:20:194
114091290,0ptp4l0-21swapper/123:14:331
114091290,0ptp4l0-21swapper/119:30:141
114091280,2ptp4l0-21swapper/622:15:156
114091280,0ptp4l0-21swapper/623:19:096
114091280,0ptp4l0-21swapper/622:24:516
114091280,0ptp4l0-21swapper/621:15:406
114091280,0ptp4l0-21swapper/519:49:545
114091280,0ptp4l0-21swapper/400:02:474
114091280,0ptp4l0-21swapper/400:02:474
114091280,0ptp4l0-21swapper/222:28:092
114091280,0ptp4l0-21swapper/222:03:242
114091280,0ptp4l0-21swapper/123:43:341
114091280,0ptp4l0-21swapper/122:08:081
114091280,0ptp4l0-21swapper/121:48:031
114091280,0ptp4l0-21swapper/021:56:440
114091270,2ptp4l0-21swapper/121:41:461
114091270,0ptp4l0-21swapper/721:34:597
114091270,0ptp4l0-21swapper/623:25:256
114091270,0ptp4l0-21swapper/523:31:325
114091270,0ptp4l0-21swapper/522:53:205
114091270,0ptp4l0-21swapper/522:35:185
114091270,0ptp4l0-21swapper/520:30:175
114091270,0ptp4l0-21swapper/123:31:301
114091270,0ptp4l0-21swapper/123:21:121
114091270,0ptp4l0-21swapper/121:36:231
114091260,1ptp4l25065-21missed_timers22:50:191
114091260,1ptp4l10393-21vmstat20:55:260
114091260,0ptp4l0-21swapper/621:21:346
114091260,0ptp4l0-21swapper/621:21:346
114091260,0ptp4l0-21swapper/523:13:245
114091260,0ptp4l0-21swapper/521:00:185
114091260,0ptp4l0-21swapper/500:11:175
114091260,0ptp4l0-21swapper/423:06:274
114091260,0ptp4l0-21swapper/419:35:214
114091260,0ptp4l0-21swapper/223:03:032
114091260,0ptp4l0-21swapper/121:20:581
114091260,0ptp4l0-21swapper/121:20:571
114091260,0ptp4l0-21swapper/119:15:191
114091260,0ptp4l0-21swapper/100:18:031
114091260,0ptp4l0-21swapper/023:20:140
114091260,0ptp4l0-21swapper/021:34:380
114091250,3ptp4l0-21swapper/121:27:441
114091250,3ptp4l0-21swapper/100:13:421
114091250,2ptp4l0-21swapper/100:02:051
114091250,2ptp4l0-21swapper/100:02:051
114091250,0ptp4l0-21swapper/721:35:137
114091250,0ptp4l0-21swapper/622:57:386
114091250,0ptp4l0-21swapper/523:21:125
114091250,0ptp4l0-21swapper/522:04:235
114091250,0ptp4l0-21swapper/521:30:585
114091250,0ptp4l0-21swapper/520:40:135
114091250,0ptp4l0-21swapper/519:40:005
114091250,0ptp4l0-21swapper/423:35:254
114091250,0ptp4l0-21swapper/422:04:344
114091250,0ptp4l0-21swapper/200:20:172
114091250,0ptp4l0-21swapper/123:28:441
114091250,0ptp4l0-21swapper/122:44:361
114091250,0ptp4l0-21swapper/122:30:181
114091250,0ptp4l0-21swapper/121:30:331
114091250,0ptp4l0-21swapper/100:22:121
114091250,0ptp4l0-21swapper/022:34:590
114091250,0ptp4l0-21swapper/022:22:210
114091250,0ptp4l0-21swapper/021:10:160
114091240,2ptp4l0-21swapper/623:44:346
114091240,2ptp4l0-21swapper/621:44:136
114091240,1ptp4l9345-21hddtemp_smartct19:45:166
114091240,1ptp4l7693-21sort20:50:204
114091240,1ptp4l21233-21latency22:45:175
114091240,1ptp4l0-21swapper/223:56:322
114091240,1ptp4l0-21swapper/223:56:322
114091240,1ptp4l0-21swapper/022:44:320
114091240,0ptp4l0-21swapper/623:45:216
114091240,0ptp4l0-21swapper/523:59:445
114091240,0ptp4l0-21swapper/523:59:445
114091240,0ptp4l0-21swapper/523:50:145
114091240,0ptp4l0-21swapper/523:35:225
114091240,0ptp4l0-21swapper/523:16:345
114091240,0ptp4l0-21swapper/523:05:165
114091240,0ptp4l0-21swapper/523:04:385
114091240,0ptp4l0-21swapper/521:19:075
114091240,0ptp4l0-21swapper/520:15:205
114091240,0ptp4l0-21swapper/520:05:175
114091240,0ptp4l0-21swapper/519:59:515
114091240,0ptp4l0-21swapper/519:40:225
114091240,0ptp4l0-21swapper/500:35:025
114091240,0ptp4l0-21swapper/500:30:225
114091240,0ptp4l0-21swapper/423:51:494
114091240,0ptp4l0-21swapper/423:40:124
114091240,0ptp4l0-21swapper/423:03:224
114091240,0ptp4l0-21swapper/422:50:154
114091240,0ptp4l0-21swapper/419:47:124
114091240,0ptp4l0-21swapper/321:35:313
114091240,0ptp4l0-21swapper/222:56:592
114091240,0ptp4l0-21swapper/222:54:432
114091240,0ptp4l0-21swapper/221:50:062
114091240,0ptp4l0-21swapper/221:33:232
114091240,0ptp4l0-21swapper/220:10:152
114091240,0ptp4l0-21swapper/100:34:011
114091240,0ptp4l0-21swapper/100:09:311
114091240,0ptp4l0-21swapper/021:22:470
114091240,0ptp4l0-21swapper/021:22:460
114091240,0ptp4l0-21swapper/019:30:200
114091240,0ptp4l0-21swapper/000:25:010
114091230,3ptp4l241ktimersoftd/120:25:051
114091230,1ptp4l1-21systemd22:54:486
114091230,0ptp4l65-21ksoftirqd/621:25:166
114091230,0ptp4l25-21ksoftirqd/120:40:171
114091230,0ptp4l0-21swapper/719:50:147
114091230,0ptp4l0-21swapper/621:55:156
114091230,0ptp4l0-21swapper/621:50:176
114091230,0ptp4l0-21swapper/621:33:406
114091230,0ptp4l0-21swapper/621:05:186
114091230,0ptp4l0-21swapper/620:55:196
114091230,0ptp4l0-21swapper/620:50:156
114091230,0ptp4l0-21swapper/620:10:146
114091230,0ptp4l0-21swapper/620:10:006
114091230,0ptp4l0-21swapper/600:16:026
114091230,0ptp4l0-21swapper/600:05:136
114091230,0ptp4l0-21swapper/523:47:005
114091230,0ptp4l0-21swapper/522:40:205
114091230,0ptp4l0-21swapper/522:25:235
114091230,0ptp4l0-21swapper/522:20:225
114091230,0ptp4l0-21swapper/522:10:145
114091230,0ptp4l0-21swapper/522:05:155
114091230,0ptp4l0-21swapper/521:59:345
114091230,0ptp4l0-21swapper/521:41:255
114091230,0ptp4l0-21swapper/521:29:485
114091230,0ptp4l0-21swapper/521:20:495
114091230,0ptp4l0-21swapper/521:20:485
114091230,0ptp4l0-21swapper/521:00:005
114091230,0ptp4l0-21swapper/520:45:195
114091230,0ptp4l0-21swapper/520:20:225
114091230,0ptp4l0-21swapper/519:54:555
114091230,0ptp4l0-21swapper/519:30:135
114091230,0ptp4l0-21swapper/519:20:165
114091230,0ptp4l0-21swapper/423:57:484
114091230,0ptp4l0-21swapper/423:57:484
114091230,0ptp4l0-21swapper/423:30:164
114091230,0ptp4l0-21swapper/423:10:184
114091230,0ptp4l0-21swapper/422:25:134
114091230,0ptp4l0-21swapper/422:09:484
114091230,0ptp4l0-21swapper/421:29:104
114091230,0ptp4l0-21swapper/421:17:434
114091230,0ptp4l0-21swapper/419:55:174
114091230,0ptp4l0-21swapper/419:30:214
114091230,0ptp4l0-21swapper/419:10:154
114091230,0ptp4l0-21swapper/400:30:184
114091230,0ptp4l0-21swapper/319:50:133
114091230,0ptp4l0-21swapper/223:44:252
114091230,0ptp4l0-21swapper/223:25:232
114091230,0ptp4l0-21swapper/221:40:162
114091230,0ptp4l0-21swapper/221:15:122
114091230,0ptp4l0-21swapper/221:05:012
114091230,0ptp4l0-21swapper/220:55:202
114091230,0ptp4l0-21swapper/219:45:132
114091230,0ptp4l0-21swapper/200:39:142
114091230,0ptp4l0-21swapper/200:15:162
114091230,0ptp4l0-21swapper/123:50:151
114091230,0ptp4l0-21swapper/123:35:151
114091230,0ptp4l0-21swapper/123:05:211
114091230,0ptp4l0-21swapper/122:45:161
114091230,0ptp4l0-21swapper/122:35:161
114091230,0ptp4l0-21swapper/122:25:191
114091230,0ptp4l0-21swapper/122:21:411
114091230,0ptp4l0-21swapper/121:11:491
114091230,0ptp4l0-21swapper/121:10:001
114091230,0ptp4l0-21swapper/120:20:221
114091230,0ptp4l0-21swapper/120:05:001
114091230,0ptp4l0-21swapper/119:40:151
114091230,0ptp4l0-21swapper/119:35:141
114091230,0ptp4l0-21swapper/119:10:231
114091230,0ptp4l0-21swapper/100:25:151
114091230,0ptp4l0-21swapper/023:39:440
114091230,0ptp4l0-21swapper/023:30:430
114091230,0ptp4l0-21swapper/023:26:080
114091230,0ptp4l0-21swapper/023:10:160
114091230,0ptp4l0-21swapper/023:03:290
114091230,0ptp4l0-21swapper/022:35:140
114091230,0ptp4l0-21swapper/020:40:190
114091230,0ptp4l0-21swapper/019:55:150
114091230,0ptp4l0-21swapper/019:40:230
114091230,0ptp4l0-21swapper/000:36:540
114091230,0ptp4l0-21swapper/000:10:210
114091220,0ptp4l0-21swapper/623:58:406
114091220,0ptp4l0-21swapper/623:58:406
114091220,0ptp4l0-21swapper/622:45:456
114091220,0ptp4l0-21swapper/622:27:026
114091220,0ptp4l0-21swapper/622:13:236
114091220,0ptp4l0-21swapper/622:02:466
114091220,0ptp4l0-21swapper/621:45:106
114091220,0ptp4l0-21swapper/620:23:486
114091220,0ptp4l0-21swapper/600:38:116
114091220,0ptp4l0-21swapper/600:04:176
114091220,0ptp4l0-21swapper/600:04:176
114091220,0ptp4l0-21swapper/523:27:045
114091220,0ptp4l0-21swapper/522:32:265
114091220,0ptp4l0-21swapper/521:45:245
114091220,0ptp4l0-21swapper/521:36:215
114091220,0ptp4l0-21swapper/521:10:015
114091220,0ptp4l0-21swapper/521:08:505
114091220,0ptp4l0-21swapper/520:50:225
114091220,0ptp4l0-21swapper/520:25:145
114091220,0ptp4l0-21swapper/520:00:175
114091220,0ptp4l0-21swapper/519:25:205
114091220,0ptp4l0-21swapper/519:15:025
114091220,0ptp4l0-21swapper/500:25:155
114091220,0ptp4l0-21swapper/500:00:125
114091220,0ptp4l0-21swapper/500:00:125
114091220,0ptp4l0-21swapper/423:23:044
114091220,0ptp4l0-21swapper/423:17:004
114091220,0ptp4l0-21swapper/422:34:284
114091220,0ptp4l0-21swapper/422:22:244
114091220,0ptp4l0-21swapper/422:11:184
114091220,0ptp4l0-21swapper/421:56:394
114091220,0ptp4l0-21swapper/421:37:184
114091220,0ptp4l0-21swapper/421:30:214
114091220,0ptp4l0-21swapper/421:10:114
114091220,0ptp4l0-21swapper/420:40:204
114091220,0ptp4l0-21swapper/420:35:154
114091220,0ptp4l0-21swapper/420:30:274
114091220,0ptp4l0-21swapper/420:20:174
114091220,0ptp4l0-21swapper/420:15:164
114091220,0ptp4l0-21swapper/419:15:214
114091220,0ptp4l0-21swapper/400:35:174
114091220,0ptp4l0-21swapper/400:25:034
114091220,0ptp4l0-21swapper/400:23:134
114091220,0ptp4l0-21swapper/400:13:504
114091220,0ptp4l0-21swapper/323:06:463
114091220,0ptp4l0-21swapper/223:45:152
114091220,0ptp4l0-21swapper/223:18:032
114091220,0ptp4l0-21swapper/222:46:242
114091220,0ptp4l0-21swapper/222:24:402
114091220,0ptp4l0-21swapper/222:15:012
114091220,0ptp4l0-21swapper/221:55:132
114091220,0ptp4l0-21swapper/221:45:182
114091220,0ptp4l0-21swapper/221:37:482
114091220,0ptp4l0-21swapper/221:25:102
114091220,0ptp4l0-21swapper/221:21:472
114091220,0ptp4l0-21swapper/221:21:472
114091220,0ptp4l0-21swapper/221:12:362
114091220,0ptp4l0-21swapper/220:23:502
114091220,0ptp4l0-21swapper/219:56:442
114091220,0ptp4l0-21swapper/200:05:152
114091220,0ptp4l0-21swapper/200:04:242
114091220,0ptp4l0-21swapper/200:04:242
114091220,0ptp4l0-21swapper/123:55:121
114091220,0ptp4l0-21swapper/123:55:121
114091220,0ptp4l0-21swapper/123:15:161
114091220,0ptp4l0-21swapper/122:10:161
114091220,0ptp4l0-21swapper/122:00:161
114091220,0ptp4l0-21swapper/121:59:361
114091220,0ptp4l0-21swapper/121:54:061
114091220,0ptp4l0-21swapper/121:16:431
114091220,0ptp4l0-21swapper/121:00:131
114091220,0ptp4l0-21swapper/120:59:441
114091220,0ptp4l0-21swapper/120:50:201
114091220,0ptp4l0-21swapper/120:45:181
114091220,0ptp4l0-21swapper/120:38:451
114091220,0ptp4l0-21swapper/120:30:191
114091220,0ptp4l0-21swapper/120:15:191
114091220,0ptp4l0-21swapper/120:07:311
114091220,0ptp4l0-21swapper/100:35:011
114091220,0ptp4l0-21swapper/023:40:120
114091220,0ptp4l0-21swapper/023:16:420
114091220,0ptp4l0-21swapper/023:07:550
114091220,0ptp4l0-21swapper/022:50:140
114091220,0ptp4l0-21swapper/022:46:500
114091220,0ptp4l0-21swapper/022:25:480
114091220,0ptp4l0-21swapper/022:05:120
114091220,0ptp4l0-21swapper/022:01:310
114091220,0ptp4l0-21swapper/021:39:020
114091220,0ptp4l0-21swapper/021:28:040
114091220,0ptp4l0-21swapper/021:18:260
114091220,0ptp4l0-21swapper/020:45:160
114091220,0ptp4l0-21swapper/020:35:190
114091220,0ptp4l0-21swapper/020:30:240
114091220,0ptp4l0-21swapper/020:15:140
114091220,0ptp4l0-21swapper/019:35:150
114091220,0ptp4l0-21swapper/019:15:190
114091220,0ptp4l0-21swapper/019:10:220
114091220,0ptp4l0-21swapper/000:30:170
114091220,0ptp4l0-21swapper/000:23:080
114091220,0ptp4l0-21swapper/000:05:190
114091220,0ptp4l0-21swapper/000:01:150
114091220,0ptp4l0-21swapper/000:01:150
93232210,0sleep0101ktimersoftd/023:58:480
93232210,0sleep0101ktimersoftd/023:58:480
114091210,0ptp4l0-21swapper/723:06:367
114091210,0ptp4l0-21swapper/623:12:476
114091210,0ptp4l0-21swapper/623:09:176
114091210,0ptp4l0-21swapper/621:37:476
114091210,0ptp4l0-21swapper/620:30:416
114091210,0ptp4l0-21swapper/620:17:446
114091210,0ptp4l0-21swapper/619:44:446
114091210,0ptp4l0-21swapper/619:35:486
114091210,0ptp4l0-21swapper/523:41:585
114091210,0ptp4l0-21swapper/522:56:155
114091210,0ptp4l0-21swapper/522:18:465
114091210,0ptp4l0-21swapper/521:51:465
114091210,0ptp4l0-21swapper/520:38:495
114091210,0ptp4l0-21swapper/520:12:185
114091210,0ptp4l0-21swapper/519:13:315
114091210,0ptp4l0-21swapper/500:22:185
114091210,0ptp4l0-21swapper/500:05:375
114091210,0ptp4l0-21swapper/423:46:084
114091210,0ptp4l0-21swapper/423:28:194
114091210,0ptp4l0-21swapper/422:59:184
114091210,0ptp4l0-21swapper/422:45:334
114091210,0ptp4l0-21swapper/422:41:264
114091210,0ptp4l0-21swapper/421:50:014
114091210,0ptp4l0-21swapper/421:49:424
114091210,0ptp4l0-21swapper/400:05:234
114091210,0ptp4l0-21swapper/223:23:412
114091210,0ptp4l0-21swapper/223:12:492
114091210,0ptp4l0-21swapper/222:30:012
114091210,0ptp4l0-21swapper/222:13:062
114091210,0ptp4l0-21swapper/219:23:472
114091210,0ptp4l0-21swapper/200:14:502
114091210,0ptp4l0-21swapper/123:48:481
114091210,0ptp4l0-21swapper/122:56:301
114091210,0ptp4l0-21swapper/122:17:391
114091210,0ptp4l0-21swapper/120:10:171
114091210,0ptp4l0-21swapper/119:54:221
114091210,0ptp4l0-21swapper/119:48:481
114091210,0ptp4l0-21swapper/023:50:120
114091210,0ptp4l0-21swapper/023:46:040
114091210,0ptp4l0-21swapper/022:59:160
114091210,0ptp4l0-21swapper/022:17:370
114091210,0ptp4l0-21swapper/021:52:460
114091210,0ptp4l0-21swapper/021:49:080
114091210,0ptp4l0-21swapper/021:40:030
114091210,0ptp4l0-21swapper/020:54:450
114091200,0ptp4l0-21swapper/723:45:467
114091200,0ptp4l0-21swapper/623:23:386
114091200,0ptp4l0-21swapper/623:03:156
114091200,0ptp4l0-21swapper/620:28:436
114091200,0ptp4l0-21swapper/619:28:486
114091200,0ptp4l0-21swapper/500:17:235
114091200,0ptp4l0-21swapper/422:19:564
114091200,0ptp4l0-21swapper/420:47:254
114091200,0ptp4l0-21swapper/223:39:312
114091200,0ptp4l0-21swapper/220:26:142
114091200,0ptp4l0-21swapper/220:09:402
114091200,0ptp4l0-21swapper/219:35:252
114091200,0ptp4l0-21swapper/219:26:232
114091200,0ptp4l0-21swapper/219:18:122
114091200,0ptp4l0-21swapper/219:14:492
114091200,0ptp4l0-21swapper/020:10:230
114091200,0ptp4l0-21swapper/000:17:030
114091190,0ptp4l0-21swapper/619:24:436
114091190,0ptp4l0-21swapper/600:32:146
114091190,0ptp4l0-21swapper/422:37:194
114091190,0ptp4l0-21swapper/420:27:334
114091190,0ptp4l0-21swapper/400:17:064
114091190,0ptp4l0-21swapper/321:34:593
114091190,0ptp4l0-21swapper/223:09:132
114091190,0ptp4l0-21swapper/220:46:322
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional