You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-04-03 - 11:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot6s.osadl.org (updated Thu Apr 03, 2025 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2036899974,27cyclictest0-21swapper/121:34:371
2036899965,41cyclictest0-21swapper/118:45:031
2036899934,30cyclictest0-21swapper/121:49:401
2036899914,30cyclictest0-21swapper/117:29:571
2036899914,30cyclictest0-21swapper/117:29:571
2036899904,29cyclictest0-21swapper/120:54:411
20368999014,12cyclictest0-21swapper/120:34:571
2036899894,36cyclictest0-21swapper/122:49:421
2036899894,35cyclictest17216-21cpuspeed_turbos18:24:431
20370998827,10cyclictest30221-21aten_r1power_fr17:44:433
2036899884,29cyclictest0-21swapper/118:39:561
2036899884,27cyclictest0-21swapper/117:34:411
20368998732,10cyclictest21383-21cpuspeed_turbos22:29:321
2037099863,38cyclictest0-21swapper/320:19:233
20370998532,9cyclictest10856-21unixbench_singl20:34:593
2037099853,77cyclictest0-21swapper/317:26:563
2036899855,33cyclictest0-21swapper/120:04:331
2036899855,29cyclictest0-21swapper/117:59:411
20368998520,13cyclictest0-21swapper/122:34:471
2037099843,33cyclictest1241-21cut18:59:383
20370998429,10cyclictest23092-21aten_r1power_po17:29:443
20370998429,10cyclictest23092-21aten_r1power_po17:29:443
20370998317,13cyclictest0-21swapper/320:55:503
2036899834,15cyclictest0-21swapper/122:24:271
20368998317,8cyclictest6052-21unixbench_singl20:24:511
20370998220,9cyclictest13378-21telnet19:24:403
2036899824,25cyclictest0-21swapper/120:29:401
2036899814,38cyclictest0-21swapper/122:03:421
2037099804,37cyclictest0-21swapper/321:44:443
2037099804,37cyclictest0-21swapper/321:44:443
20370998028,9cyclictest29748-21gltestperf18:49:463
20370998023,10cyclictest1632-21nscd18:19:273
20370998023,10cyclictest1632-21nscd18:19:273
2036899803,43cyclictest0-21swapper/119:42:241
2037099794,37cyclictest0-21swapper/318:04:283
2037099792,40cyclictest0-21swapper/319:49:593
20370997825,10cyclictest28659-21kernelversion21:24:393
2037099763,33cyclictest0-21swapper/322:48:203
2037099753,65cyclictest0-21swapper/319:19:513
20370997520,8cyclictest11922-21munin-run18:14:273
2037099752,43cyclictest0-21swapper/322:49:473
20370997517,10cyclictest6776-21telnet20:29:353
2037099742,38cyclictest0-21swapper/321:14:533
227799690,4rtkit-daemon2276-21rtkit-daemon22:24:352
20370996914,14cyclictest17545-21fschecks_count18:24:473
227799680,5rtkit-daemon2276-21rtkit-daemon19:34:422
227799680,5rtkit-daemon2276-21rtkit-daemon19:34:422
2037099682,39cyclictest0-21swapper/317:49:563
20370996621,7cyclictest21742-21kworker/3:119:04:413
182292667,10sleep00-21swapper/017:19:470
227799620,5rtkit-daemon2276-21rtkit-daemon21:01:012
227799620,5rtkit-daemon2276-21rtkit-daemon21:01:012
20368996219,26cyclictest25610-21crond19:54:241
227799610,19rtkit-daemon2276-21rtkit-daemon22:12:132
227799600,4rtkit-daemon2276-21rtkit-daemon21:51:592
227799600,4rtkit-daemon2276-21rtkit-daemon18:35:292
227799600,19rtkit-daemon2276-21rtkit-daemon21:20:302
227799600,19rtkit-daemon2276-21rtkit-daemon18:40:222
20369996024,14cyclictest0-21swapper/222:06:482
228002594,48sleep00-21swapper/018:34:510
227799590,5rtkit-daemon2276-21rtkit-daemon17:48:242
227799590,18rtkit-daemon2276-21rtkit-daemon22:22:062
227799590,18rtkit-daemon2276-21rtkit-daemon21:59:592
20365995941,10cyclictest21579-21grep21:04:490
20365995925,27cyclictest0-21swapper/020:24:340
90852580,13sleep12036899cyclictest21:54:451
298502584,12sleep00-21swapper/022:49:420
2036999587,29cyclictest16638-21munin-run20:54:212
82712574,7sleep08305-21ls19:14:260
227799570,6rtkit-daemon2276-21rtkit-daemon17:49:392
2036999563,22cyclictest21188-21uniq17:24:482
2036999562,37cyclictest0-21swapper/220:54:482
20369995612,21cyclictest0-21swapper/221:54:322
20365995624,14cyclictest0-21swapper/022:39:000
151212563,45sleep20-21swapper/219:25:042
109832563,11sleep20-21swapper/219:19:402
227799550,6rtkit-daemon2276-21rtkit-daemon18:09:452
2036999554,36cyclictest0-21swapper/218:44:472
20369995535,11cyclictest12509-21grep18:14:412
20369995535,11cyclictest12509-21grep18:14:412
20369995522,14cyclictest0-21swapper/218:04:442
2036899555,31cyclictest0-21swapper/117:24:411
20365995538,10cyclictest30581-21grep18:50:000
35302542,44sleep10-21swapper/117:54:501
302782543,43sleep20-21swapper/220:04:502
227799540,4rtkit-daemon2276-21rtkit-daemon22:49:342
205182543,45sleep00-21swapper/019:40:130
2037099543,43cyclictest15692-21munin-node19:29:443
2036999544,28cyclictest0-21swapper/221:14:562
2036999543,25cyclictest0-21swapper/220:29:352
20369995422,13cyclictest0-21swapper/221:44:582
20369995422,13cyclictest0-21swapper/221:44:582
20369995421,14cyclictest0-21swapper/222:44:232
20369995420,15cyclictest0-21swapper/217:59:552
20369995420,14cyclictest0-21swapper/221:14:212
2036899545,32cyclictest0-21swapper/122:04:471
20368995422,12cyclictest0-21swapper/118:14:271
2036599544,30cyclictest0-21swapper/021:19:200
20365995437,11cyclictest19025-21tr22:24:280
75312533,42sleep00-21swapper/021:52:510
227799530,5rtkit-daemon2276-21rtkit-daemon22:14:362
227799530,5rtkit-daemon2276-21rtkit-daemon19:44:422
227799530,5rtkit-daemon2276-21rtkit-daemon18:49:512
20370995325,22cyclictest26248-21crond18:44:263
2036999535,30cyclictest0-21swapper/220:09:362
2036999535,29cyclictest0-21swapper/220:40:512
2036999535,28cyclictest0-21swapper/221:34:432
2036999535,28cyclictest0-21swapper/220:44:302
2036999535,27cyclictest0-21swapper/222:34:462
2036999534,29cyclictest0-21swapper/218:24:522
2036999534,26cyclictest0-21swapper/218:30:032
20369995322,13cyclictest0-21swapper/220:39:022
20369995317,12cyclictest0-21swapper/221:29:392
20369995311,24cyclictest0-21swapper/219:00:522
2036899535,30cyclictest0-21swapper/121:29:531
2036899533,44cyclictest0-21swapper/122:14:361
20368995322,13cyclictest0-21swapper/117:45:041
2036599535,28cyclictest0-21swapper/018:19:490
20365995334,11cyclictest4085-21cpuspeed_turbos19:04:430
105532533,43sleep00-21swapper/022:03:150
105192533,9sleep20-21swapper/219:17:262
260572523,9sleep00-21swapper/018:41:570
231802523,9sleep00-21swapper/019:48:520
227799520,5rtkit-daemon2276-21rtkit-daemon19:54:492
227799520,5rtkit-daemon2276-21rtkit-daemon18:19:452
227799520,4rtkit-daemon2276-21rtkit-daemon21:24:302
227799520,4rtkit-daemon2276-21rtkit-daemon20:24:482
2037099523,43cyclictest0-21swapper/320:00:213
2037099523,43cyclictest0-21swapper/318:44:593
2036999525,27cyclictest0-21swapper/217:54:542
2036999524,28cyclictest0-21swapper/217:34:442
2036999524,26cyclictest0-21swapper/222:33:512
2036999524,25cyclictest0-21swapper/219:29:542
20369995236,9cyclictest29452-21unixbench_multi17:40:032
20369995221,24cyclictest23461-21munin-node19:49:412
20369995216,13cyclictest0-21swapper/221:04:462
20369995216,10cyclictest31259-21munin-node18:54:542
20369995216,10cyclictest31259-21munin-node18:54:542
2036599524,29cyclictest0-21swapper/017:44:470
20365995235,10cyclictest7914-21tail20:29:480
142312523,43sleep014315-21interrupts19:24:500
92002512,9sleep00-21swapper/018:05:130
34702513,42sleep00-21swapper/020:19:110
34232513,10sleep00-21swapper/019:03:250
319122513,9sleep00-21swapper/021:31:020
279162513,9sleep00-21swapper/019:58:270
207762512,9sleep20-21swapper/219:43:382
2037099513,12cyclictest0-21swapper/317:55:013
2036999515,27cyclictest0-21swapper/217:29:472
2036999515,27cyclictest0-21swapper/217:29:472
2036999514,29cyclictest0-21swapper/220:14:482
2036899515,28cyclictest0-21swapper/117:39:451
2036899513,43cyclictest0-21swapper/121:07:291
2036599515,27cyclictest0-21swapper/018:29:390
20365995121,13cyclictest0-21swapper/021:34:350
141362513,42sleep00-21swapper/018:17:060
141362513,42sleep00-21swapper/018:17:060
7452503,40sleep00-21swapper/020:12:140
294872503,9sleep00-21swapper/021:25:300
2037099504,38cyclictest0-21swapper/320:09:343
2037099502,43cyclictest0-21swapper/319:09:573
2037099502,42cyclictest0-21swapper/318:54:493
2037099502,42cyclictest0-21swapper/318:54:493
2036999504,26cyclictest0-21swapper/222:39:342
2036999504,24cyclictest0-21swapper/220:21:572
2036899505,29cyclictest0-21swapper/118:24:281
2036899504,38cyclictest0-21swapper/120:19:231
2036899504,29cyclictest0-21swapper/119:20:001
2036899503,41cyclictest16627-21crond20:54:211
20368995019,14cyclictest0-21swapper/117:49:501
2036599506,37cyclictest0-21swapper/017:59:410
2036599505,28cyclictest0-21swapper/017:24:460
2036599504,29cyclictest0-21swapper/022:29:390
2036599504,28cyclictest0-21swapper/022:09:530
2036599504,28cyclictest0-21swapper/021:09:400
2036599504,27cyclictest0-21swapper/019:24:250
20365995033,10cyclictest23681-21tune2fs17:29:500
20365995033,10cyclictest23681-21tune2fs17:29:500
195282503,40sleep00-21swapper/021:03:130
195282503,40sleep00-21swapper/021:03:130
180722503,41sleep00-21swapper/022:19:360
110292503,41sleep00-21swapper/020:36:330
319462497,35sleep10-21swapper/120:09:411
22482493,10sleep00-21swapper/017:53:200
2037099494,12cyclictest0-21swapper/318:29:403
20370994922,22cyclictest0-21swapper/321:04:383
2037099492,41cyclictest0-21swapper/320:49:383
2036999495,24cyclictest0-21swapper/219:04:402
2036999494,24cyclictest0-21swapper/219:09:382
2036899494,29cyclictest0-21swapper/119:54:491
2036899494,29cyclictest0-21swapper/119:24:411
2036899494,29cyclictest0-21swapper/119:05:051
2036899494,29cyclictest0-21swapper/118:34:381
20368994931,10cyclictest18923-21gltestperf19:34:461
20368994931,10cyclictest18923-21gltestperf19:34:461
2036899493,41cyclictest0-21swapper/122:09:401
2036599495,27cyclictest0-21swapper/022:04:250
2036599494,28cyclictest0-21swapper/020:44:350
2036599494,27cyclictest0-21swapper/019:14:370
2036599494,27cyclictest0-21swapper/017:59:280
20365994930,12cyclictest16243-21unixbench_singl20:49:540
188452493,40sleep00-21swapper/018:26:210
37622483,38sleep00-21swapper/020:20:040
307392483,39sleep00-21swapper/020:06:130
283622483,38sleep00-21swapper/020:01:220
283062483,10sleep00-21swapper/018:45:110
25862484,9sleep00-21swapper/021:40:300
2037099483,40cyclictest0-21swapper/320:24:423
2037099483,40cyclictest0-21swapper/319:54:473
2037099483,40cyclictest0-21swapper/318:19:413
2037099483,12cyclictest0-21swapper/319:34:473
2037099483,12cyclictest0-21swapper/319:34:473
2037099482,21cyclictest0-21swapper/320:19:583
2036999484,27cyclictest0-21swapper/221:43:582
2036899484,28cyclictest0-21swapper/121:44:541
2036899484,28cyclictest0-21swapper/121:44:541
2036899484,28cyclictest0-21swapper/118:30:021
2036899483,39cyclictest29596-21sshd21:26:541
2036899483,28cyclictest0-21swapper/119:29:451
20368994815,12cyclictest6222-21telnet19:09:381
2036599484,28cyclictest0-21swapper/018:54:560
2036599484,28cyclictest0-21swapper/018:54:560
2036599484,27cyclictest0-21swapper/021:44:490
2036599484,27cyclictest0-21swapper/021:44:490
2036599484,27cyclictest0-21swapper/019:34:590
2036599484,27cyclictest0-21swapper/019:34:590
2036599484,27cyclictest0-21swapper/019:29:400
20365994819,13cyclictest0-21swapper/022:14:460
20365994812,30cyclictest0-21swapper/017:42:050
116522483,38sleep00-21swapper/020:41:450
97472473,38sleep00-21swapper/021:55:370
254082473,39sleep00-21swapper/019:51:500
231362472,39sleep10-21swapper/119:48:171
20370994730,11cyclictest23443-21needreboot21:09:443
2037099473,40cyclictest0-21swapper/322:04:493
2037099473,39cyclictest0-21swapper/322:34:513
2037099473,39cyclictest0-21swapper/321:49:403
2037099473,38cyclictest0-21swapper/322:24:333
2037099473,38cyclictest0-21swapper/318:34:493
20370994724,7cyclictest11864-21latency_hist20:44:223
2036899474,28cyclictest0-21swapper/118:55:021
2036899474,28cyclictest0-21swapper/118:55:021
2036899474,25cyclictest0-21swapper/118:14:381
2036899474,25cyclictest0-21swapper/118:14:381
2036899474,13cyclictest0-21swapper/121:09:291
2036899473,28cyclictest0-21swapper/120:44:351
20368994719,12cyclictest0-21swapper/120:39:581
20368994716,12cyclictest0-21swapper/122:44:331
273642462,39sleep00-21swapper/017:37:430
270472463,37sleep00-21swapper/021:19:460
20370994632,9cyclictest30870-21cut21:29:373
20370994630,10cyclictest21088-21head22:29:293
2037099462,27cyclictest0-21swapper/320:44:443
2036899464,26cyclictest0-21swapper/118:59:441
2036899464,24cyclictest28899-21runrttasks18:49:381
2036899463,38cyclictest0-21swapper/121:16:191
2036899463,36cyclictest1138-21snmpd21:44:191
20368994618,13cyclictest0-21swapper/119:14:381
20368994616,13cyclictest0-21swapper/120:24:231
20368994614,12cyclictest0-21swapper/118:04:471
2036599464,35cyclictest0-21swapper/020:54:560
20365994629,11cyclictest11101-21proc_pri18:09:540
2037099453,36cyclictest0-21swapper/322:14:173
2037099453,14cyclictest0-21swapper/321:34:313
20370994529,10cyclictest9154-21cut19:14:423
2037099452,38cyclictest0-21swapper/321:22:543
2036899454,34cyclictest0-21swapper/121:20:541
20368994519,8cyclictest20555-21cat17:24:301
194522452,37sleep10-21swapper/121:02:131
194522452,37sleep10-21swapper/121:02:131
2037099446,29cyclictest0-21swapper/322:14:313
2037099444,33cyclictest0-21swapper/319:44:353
2036899444,34cyclictest0-21swapper/122:44:181
2036599444,32cyclictest26210-21turbostat22:44:170
2037099434,33cyclictest0-21swapper/320:04:503
2036999434,12cyclictest0-21swapper/220:03:212
2036599435,32cyclictest0-21swapper/022:44:390
2037099424,32cyclictest0-21swapper/319:44:193
20370994226,10cyclictest8028-21fschecks_count18:04:493
2037099422,36cyclictest0-21swapper/322:24:083
25322412,33sleep30-21swapper/321:39:483
20370994124,10cyclictest8214-21tr21:54:343
2037099404,29cyclictest26346-21cat22:44:183
2037099402,33cyclictest0-21swapper/317:35:003
2036899404,31cyclictest0-21swapper/122:21:521
195212402,33sleep30-21swapper/321:03:083
195212402,33sleep30-21swapper/321:03:083
283582392,31sleep10-21swapper/120:01:191
2037099394,28cyclictest28868-21memory17:39:543
2037099382,23cyclictest0-21swapper/322:04:133
20369993815,7cyclictest20341-21latency_hist17:24:302
20370993610,9cyclictest7150irq/45-ahci17:24:293
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional