You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-04-11 - 22:59

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Fri Apr 11, 2025 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
227799810,6rtkit-daemon0-21swapper/008:19:530
227799800,6rtkit-daemon0-21swapper/005:44:510
39982790,5chrt3999-21fschecks_count07:56:381
227799790,6rtkit-daemon0-21swapper/007:23:100
227799780,6rtkit-daemon0-21swapper/007:08:030
227799770,7rtkit-daemon0-21swapper/006:00:360
227799770,6rtkit-daemon0-21swapper/008:38:140
227799770,5rtkit-daemon0-21swapper/008:04:310
227799750,7rtkit-daemon0-21swapper/008:33:220
227799740,7rtkit-daemon3-21ksoftirqd/007:47:010
227799740,20rtkit-daemon27150-21cyclictest05:19:003
227799730,7rtkit-daemon0-21swapper/006:29:190
227799730,13rtkit-daemon0-21swapper/007:31:320
227799720,7rtkit-daemon0-21swapper/007:59:230
227799720,7rtkit-daemon0-21swapper/006:07:500
227799720,7rtkit-daemon0-21swapper/005:41:210
227799720,7rtkit-daemon0-21swapper/005:41:210
227799720,6rtkit-daemon0-21swapper/008:09:380
227799720,6rtkit-daemon0-21swapper/007:52:160
227799710,7rtkit-daemon0-21swapper/008:24:450
227799710,7rtkit-daemon0-21swapper/007:43:470
227799710,7rtkit-daemon0-21swapper/006:57:110
227799710,7rtkit-daemon0-21swapper/006:43:190
227799700,8rtkit-daemon0-21swapper/008:26:300
227799700,7rtkit-daemon0-21swapper/008:12:230
227799700,7rtkit-daemon0-21swapper/006:48:110
227799700,7rtkit-daemon0-21swapper/006:33:190
227799700,6rtkit-daemon0-21swapper/007:17:330
227799700,6rtkit-daemon0-21swapper/006:36:340
227799700,6rtkit-daemon0-21swapper/006:25:570
227799700,6rtkit-daemon0-21swapper/006:03:060
227799700,5rtkit-daemon0-21swapper/006:15:050
227799690,7rtkit-daemon0-21swapper/006:54:560
227799690,6rtkit-daemon0-21swapper/007:38:540
227799690,6rtkit-daemon0-21swapper/007:30:400
227799690,6rtkit-daemon0-21swapper/007:16:180
227799690,6rtkit-daemon0-21swapper/006:18:500
227799690,6rtkit-daemon0-21swapper/005:53:060
227799690,5rtkit-daemon0-21swapper/007:05:330
227799690,5rtkit-daemon0-21swapper/007:05:330
227799690,5rtkit-daemon0-21swapper/005:47:360
204062694,12sleep20-21swapper/208:36:512
227799680,18rtkit-daemon2276-21rtkit-daemon09:38:053
227799670,6rtkit-daemon0-21swapper/205:21:523
227799670,6rtkit-daemon0-21swapper/008:41:290
227799660,2rtkit-daemon0-21swapper/308:58:143
227799640,9rtkit-daemon0-21swapper/308:45:593
227799640,4rtkit-daemon2276-21rtkit-daemon05:26:591
227799640,4rtkit-daemon0-21swapper/310:26:253
227799640,4rtkit-daemon0-21swapper/310:26:253
227799640,4rtkit-daemon0-21swapper/310:19:103
227799640,4rtkit-daemon0-21swapper/308:49:073
227799640,3rtkit-daemon0-21swapper/310:33:403
227799640,3rtkit-daemon0-21swapper/310:33:403
227799640,3rtkit-daemon0-21swapper/309:51:123
227799640,3rtkit-daemon0-21swapper/309:18:353
227799630,9rtkit-daemon0-21swapper/309:23:433
227799630,8rtkit-daemon0-21swapper/310:12:033
227799630,4rtkit-daemon0-21swapper/310:40:023
227799630,3rtkit-daemon0-21swapper/310:44:473
227799630,3rtkit-daemon0-21swapper/310:08:033
227799630,3rtkit-daemon0-21swapper/309:29:353
227799630,2rtkit-daemon0-21swapper/309:33:353
227799620,8rtkit-daemon0-21swapper/309:52:423
227799620,8rtkit-daemon0-21swapper/309:52:423
227799620,6rtkit-daemon0-21swapper/205:26:443
227799620,4rtkit-daemon0-21swapper/309:42:193
227799620,3rtkit-daemon0-21swapper/310:23:103
227799620,3rtkit-daemon0-21swapper/310:02:193
227799620,10rtkit-daemon0-21swapper/308:52:513
27155996112,27cyclictest0-21swapper/109:56:281
227799610,7rtkit-daemon0-21swapper/105:31:520
227799610,6rtkit-daemon37-21ksoftirqd/309:56:263
2715499594,13cyclictest0-21swapper/009:01:550
27154995910,41cyclictest0-21swapper/010:21:280
2715499584,36cyclictest0-21swapper/010:01:340
27155995741,10cyclictest29708-21needreboot06:26:531
232102573,46sleep123294-21gltestperf07:21:441
27157995623,14cyclictest0-21swapper/306:01:283
2715699564,34cyclictest0-21swapper/209:21:322
2715499568,40cyclictest0-21swapper/009:21:210
27154995615,34cyclictest0-21swapper/009:36:420
2715799558,38cyclictest34-21rcuc/307:36:413
27157995535,13cyclictest13724-21grep07:01:453
27157995535,13cyclictest13724-21grep07:01:453
2715499557,30cyclictest0-21swapper/009:46:230
27154995537,12cyclictest0-21swapper/009:31:390
227799550,6rtkit-daemon0-21swapper/105:27:140
227799550,4rtkit-daemon2276-21rtkit-daemon05:33:221
165632552,9sleep30-21swapper/307:06:513
322232542,43sleep10-21swapper/110:29:241
322232542,43sleep10-21swapper/110:29:241
27156995436,11cyclictest17432-21gltestperf06:01:492
2715599544,31cyclictest0-21swapper/110:16:541
27154995414,32cyclictest1263-21runrttasks10:44:310
27154995412,27cyclictest0-21swapper/009:46:200
27154995411,36cyclictest5391-21tail09:21:400
27157995334,12cyclictest6595-21gltestperf08:01:423
27156995316,10cyclictest12552-21cpuspeed09:41:342
2715599535,29cyclictest0-21swapper/106:51:261
2715499535,33cyclictest0-21swapper/010:26:330
2715499535,33cyclictest0-21swapper/010:26:330
2715499535,29cyclictest0-21swapper/010:16:370
199642534,42sleep20-21swapper/206:06:522
11682534,41sleep20-21swapper/209:11:212
2715799525,30cyclictest0-21swapper/306:57:053
2715799525,29cyclictest0-21swapper/306:27:003
2715799525,29cyclictest0-21swapper/306:21:573
2715799524,29cyclictest0-21swapper/308:01:243
27157995221,13cyclictest0-21swapper/306:51:403
2715699524,30cyclictest0-21swapper/209:56:322
27156995235,10cyclictest7517-21unixbench_singl06:47:022
27156995234,11cyclictest22792-21grep07:21:392
227799520,5rtkit-daemon2276-21rtkit-daemon10:06:412
227799520,4rtkit-daemon2276-21rtkit-daemon10:02:492
2715799514,28cyclictest0-21swapper/308:11:243
2715799514,28cyclictest0-21swapper/307:36:263
27157995121,13cyclictest0-21swapper/306:12:003
27157995121,12cyclictest0-21swapper/308:16:443
27157995112,25cyclictest25935-21latency07:26:503
2715699514,29cyclictest0-21swapper/206:26:572
2715699513,42cyclictest0-21swapper/205:47:002
27156995123,21cyclictest28861-21interrupts07:36:482
2715599515,28cyclictest0-21swapper/110:41:341
2715599515,28cyclictest0-21swapper/109:06:531
2715599515,28cyclictest0-21swapper/106:26:291
2715599515,26cyclictest0-21swapper/108:28:021
2715599514,27cyclictest0-21swapper/108:26:021
27155995130,14cyclictest0-21swapper/106:36:271
2715499515,38cyclictest0-21swapper/005:16:320
27154995114,31cyclictest28063-21find08:56:470
227799510,5rtkit-daemon2276-21rtkit-daemon09:16:432
53922502,9sleep10-21swapper/106:44:521
295012502,9sleep20-21swapper/205:21:212
2715799506,27cyclictest0-21swapper/306:07:003
2715799505,28cyclictest0-21swapper/306:16:473
2715799505,28cyclictest0-21swapper/305:31:343
2715799505,27cyclictest0-21swapper/307:42:003
2715799504,28cyclictest0-21swapper/306:31:583
2715799503,41cyclictest4659-21ntpq06:41:563
2715699508,33cyclictest0-21swapper/210:16:182
2715699505,34cyclictest0-21swapper/208:31:362
2715699504,28cyclictest0-21swapper/210:36:292
2715699503,40cyclictest854-21tune2fs07:46:492
2715699503,40cyclictest0-21swapper/209:01:212
2715599505,28cyclictest0-21swapper/105:21:571
2715599505,27cyclictest0-21swapper/105:46:541
2715599504,28cyclictest0-21swapper/110:39:561
27155995022,11cyclictest0-21swapper/106:16:501
27155995021,12cyclictest0-21swapper/107:17:041
27155995020,12cyclictest0-21swapper/106:06:381
27155995020,12cyclictest0-21swapper/106:01:281
2715499508,26cyclictest0-21swapper/009:26:370
2715499504,28cyclictest0-21swapper/008:46:380
27154995032,11cyclictest32351-21wc09:06:430
27154995015,29cyclictest29884-21runrttasks05:21:430
113292502,41sleep10-21swapper/106:56:491
88712492,39sleep10-21swapper/105:42:441
2715799494,28cyclictest0-21swapper/305:41:563
2715799494,27cyclictest0-21swapper/308:26:233
2715799494,27cyclictest0-21swapper/307:46:443
2715799494,27cyclictest0-21swapper/305:41:303
2715799494,27cyclictest0-21swapper/305:41:303
2715799493,38cyclictest17230-21fschecks_count06:01:473
2715699494,28cyclictest0-21swapper/210:26:462
2715699494,28cyclictest0-21swapper/210:26:462
2715699494,28cyclictest0-21swapper/205:22:002
2715699494,27cyclictest0-21swapper/207:16:522
2715699494,27cyclictest0-21swapper/206:56:582
27156994934,9cyclictest9007-21cut06:51:492
27156994922,12cyclictest0-21swapper/206:31:402
27156994918,12cyclictest0-21swapper/205:28:552
2715599495,28cyclictest0-21swapper/108:46:441
2715599495,28cyclictest0-21swapper/106:06:281
2715599495,27cyclictest0-21swapper/108:41:371
2715599495,27cyclictest0-21swapper/108:06:441
2715599495,27cyclictest0-21swapper/107:01:381
2715599495,27cyclictest0-21swapper/107:01:381
2715599494,27cyclictest0-21swapper/109:46:201
2715599494,27cyclictest0-21swapper/107:41:431
2715599494,27cyclictest0-21swapper/107:10:041
2715599494,27cyclictest0-21swapper/106:11:411
2715499495,35cyclictest0-21swapper/010:06:410
27154994932,10cyclictest2704-21head10:36:470
119922492,41sleep10-21swapper/109:40:311
27157994826,15cyclictest0-21swapper/305:46:533
2715699484,34cyclictest0-21swapper/207:11:372
2715699484,27cyclictest0-21swapper/210:41:372
2715699484,27cyclictest0-21swapper/208:46:432
2715699484,27cyclictest0-21swapper/208:41:522
2715699484,27cyclictest0-21swapper/208:21:372
27156994835,8cyclictest14989-21cpuspeed_turbos09:46:342
2715699483,27cyclictest0-21swapper/207:01:552
2715699483,27cyclictest0-21swapper/207:01:552
27156994819,9cyclictest27017-21munin-run07:31:242
27156994819,12cyclictest0-21swapper/207:36:252
27156994819,12cyclictest0-21swapper/207:06:472
2715599484,26cyclictest0-21swapper/109:06:221
2715599484,26cyclictest0-21swapper/108:41:231
2715599483,14cyclictest0-21swapper/109:48:081
27155994828,13cyclictest0-21swapper/109:21:421
2715499488,15cyclictest0-21swapper/010:34:240
2715499488,15cyclictest0-21swapper/010:34:240
2715499484,27cyclictest0-21swapper/009:56:440
2715499484,26cyclictest0-21swapper/005:16:430
27154994825,18cyclictest1263-21runrttasks09:54:170
27154994825,18cyclictest1263-21runrttasks09:54:170
244192482,9sleep10-21swapper/110:08:561
106282482,39sleep10-21swapper/108:13:081
2715799476,25cyclictest0-21swapper/305:51:453
2715799475,26cyclictest0-21swapper/306:36:433
27157994724,15cyclictest0-21swapper/306:46:523
2715699475,26cyclictest0-21swapper/207:42:492
2715699474,27cyclictest0-21swapper/205:51:392
2715699474,26cyclictest0-21swapper/206:37:012
27156994729,10cyclictest6931-21strings08:01:472
27156994716,14cyclictest0-21swapper/205:33:302
27156994712,13cyclictest0-21swapper/205:46:292
2715599474,36cyclictest0-21swapper/110:33:451
2715599474,36cyclictest0-21swapper/110:33:451
2715599474,24cyclictest17697-21munin-node07:11:481
27155994726,14cyclictest0-21swapper/107:36:261
27155994720,10cyclictest26404-21crond08:56:211
27155994718,10cyclictest11141-21tail08:16:301
27155994717,24cyclictest6979-21tail09:26:331
2715499474,34cyclictest0-21swapper/010:14:260
249592472,37sleep10-21swapper/110:13:031
2715799466,33cyclictest0-21swapper/307:16:423
2715799465,25cyclictest0-21swapper/308:31:283
2715799464,35cyclictest0-21swapper/307:56:253
2715799464,34cyclictest0-21swapper/307:26:263
27157994620,7cyclictest10884-21latency_hist08:16:243
2715699464,35cyclictest0-21swapper/205:37:022
2715699464,35cyclictest0-21swapper/205:37:022
2715699464,25cyclictest0-21swapper/209:53:442
2715699464,25cyclictest0-21swapper/209:53:442
27156994629,9cyclictest7763-21grep09:26:402
2715699462,40cyclictest0-21swapper/206:14:072
2715599464,27cyclictest0-21swapper/109:16:211
27155994619,11cyclictest0-21swapper/106:51:591
27154994628,11cyclictest1138-21snmpd08:56:050
27154994613,27cyclictest0-21swapper/009:15:360
270682464,35sleep30-21swapper/305:15:543
267192462,38sleep10-21swapper/107:27:411
237122462,37sleep20-21swapper/206:16:312
221262462,36sleep10-21swapper/110:05:221
22072462,9sleep10-21swapper/107:48:091
95352452,9sleep20-21swapper/209:34:352
7932452,37sleep30-21swapper/309:07:113
77022452,37sleep10-21swapper/108:04:131
299182452,35sleep10-21swapper/110:25:291
2715799454,9cyclictest19863-21munin-run07:16:263
2715699454,34cyclictest0-21swapper/208:16:492
27156994530,8cyclictest3699-21tr07:56:342
2715699453,25cyclictest0-21swapper/208:26:352
2715699453,23cyclictest0-21swapper/209:36:332
2715599454,33cyclictest0-21swapper/109:21:221
2715599454,25cyclictest0-21swapper/107:36:381
2715599453,37cyclictest0-21swapper/105:17:491
27155994525,14cyclictest0-21swapper/105:51:451
27155994512,26cyclictest2688-21unixbench_multi06:37:041
16302452,9sleep30-21swapper/309:14:293
30632442,9sleep20-21swapper/207:56:002
299442442,9sleep20-21swapper/210:25:502
27157994426,11cyclictest29667-21fschecks_count09:01:403
2715799442,38cyclictest0-21swapper/308:37:583
2715699444,22cyclictest0-21swapper/208:06:352
27156994422,16cyclictest0-21swapper/208:56:162
27156994417,21cyclictest1263-21runrttasks09:05:092
2715599446,23cyclictest9677-21idleruntime-cro09:36:201
2715599445,33cyclictest0-21swapper/108:56:381
27155994418,12cyclictest0-21swapper/109:52:231
27155994418,12cyclictest0-21swapper/109:52:231
2715799435,18cyclictest0-21swapper/308:26:523
2715699434,32cyclictest0-21swapper/210:31:232
2715699434,32cyclictest0-21swapper/210:31:232
2715699433,35cyclictest0-21swapper/206:43:272
2715699433,34cyclictest0-21swapper/206:21:402
2715699433,25cyclictest0-21swapper/210:16:532
270522434,6sleep20-21swapper/205:15:412
163132432,9sleep20-21swapper/206:01:282
27155994220,11cyclictest0-21swapper/105:37:011
27155994220,11cyclictest0-21swapper/105:37:011
270262414,6sleep10-21swapper/105:15:201
2715699402,32cyclictest0-21swapper/209:13:042
2715599405,29cyclictest0-21swapper/107:56:251
184092402,9sleep10-21swapper/108:33:191
27156993925,10cyclictest0-21swapper/208:13:232
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional