You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-11-22 - 09:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot6s.osadl.org (updated Fri Nov 22, 2024 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
14793991006,13cyclictest0-21swapper/022:11:530
14793999233,11cyclictest30106-21grep18:17:260
14799999119,13cyclictest0-21swapper/319:03:203
109292910,3sleep041ktimersoftd/017:42:070
1479999904,66cyclictest0-21swapper/320:57:103
1479999903,27cyclictest15524-21unixbench_singl18:52:263
1479399904,12cyclictest1305-21cut17:22:160
1479999895,59cyclictest0-21swapper/318:32:133
1479999894,26cyclictest0-21swapper/317:38:073
37832880,7sleep23782-21cat18:32:032
1479999884,64cyclictest0-21swapper/317:32:153
1479699883,77cyclictest11662-21munin-node19:52:151
1479699883,77cyclictest11662-21munin-node19:52:151
1479999874,75cyclictest0-21swapper/319:01:503
1479999874,63cyclictest0-21swapper/317:12:083
1479999874,63cyclictest0-21swapper/317:12:083
1479999874,25cyclictest0-21swapper/318:17:043
1479999873,66cyclictest0-21swapper/318:42:203
14799998720,48cyclictest0-21swapper/317:42:153
14799998717,13cyclictest0-21swapper/321:57:183
14799998716,14cyclictest0-21swapper/318:01:533
1479699873,29cyclictest7771-21diskstats20:47:001
1479399875,27cyclictest0-21swapper/021:50:100
1479399875,27cyclictest0-21swapper/021:50:100
1479999864,62cyclictest0-21swapper/317:02:203
1479999864,61cyclictest0-21swapper/320:02:043
1479699863,76cyclictest0-21swapper/117:07:211
1479999854,64cyclictest0-21swapper/320:12:233
1479999854,64cyclictest0-21swapper/317:08:023
14799998525,9cyclictest2691-21yum-updatesd-he17:26:543
14799998522,55cyclictest29707-21cpuspeed_turbos20:27:043
14799998515,13cyclictest0-21swapper/320:26:443
1479699854,73cyclictest0-21swapper/120:12:131
14796998531,47cyclictest10111-21timerwakeupswit21:57:181
1479699853,75cyclictest0-21swapper/119:27:071
14796998527,51cyclictest31094-21cpuspeed_turbos18:22:051
1479999845,58cyclictest0-21swapper/321:31:153
14799998419,48cyclictest0-21swapper/318:16:263
1479699845,71cyclictest3163-21ls19:32:201
1479699843,26cyclictest0-21swapper/120:58:101
14796998425,52cyclictest10055-21cpuspeed_turbos20:52:001
1479999835,63cyclictest0-21swapper/322:02:133
1479999834,72cyclictest0-21swapper/321:42:163
1479999834,70cyclictest0-21swapper/318:37:033
14799998324,51cyclictest20679-21fschecks_time21:12:043
14799998324,51cyclictest20679-21fschecks_time21:12:043
14799998318,46cyclictest0-21swapper/320:51:473
14799998314,13cyclictest0-21swapper/320:53:433
1479699833,10cyclictest18814-21missed_timers16:52:221
1479399837,32cyclictest0-21swapper/022:01:450
1479999824,71cyclictest0-21swapper/321:03:433
1479999824,23cyclictest0-21swapper/319:47:093
1479999824,21cyclictest0-21swapper/321:31:563
1479699823,72cyclictest0-21swapper/120:27:041
1479699823,71cyclictest25232-21yum-updatesd-he21:26:461
14796998229,47cyclictest24769-21runrttasks19:12:081
14796998229,47cyclictest24769-21runrttasks19:12:081
14796998222,10cyclictest15368-21cpuspeed_turbos16:47:101
14796998220,15cyclictest0-21swapper/118:31:521
14796998220,15cyclictest0-21swapper/118:31:521
14796998220,10cyclictest26583-21cpuspeed_turbos19:17:031
1479999814,61cyclictest0-21swapper/316:47:303
1479999814,57cyclictest0-21swapper/319:53:563
1479999814,57cyclictest0-21swapper/319:53:563
1479999814,52cyclictest0-21swapper/318:08:123
1479999813,58cyclictest0-21swapper/321:08:463
14799998115,13cyclictest0-21swapper/321:51:593
14799998113,13cyclictest0-21swapper/317:47:123
1479699813,71cyclictest0-21swapper/118:44:261
14796998125,9cyclictest3727-21switchtime20:37:181
14796998125,12cyclictest394-21gltestperf20:32:051
14796998125,12cyclictest394-21gltestperf20:32:051
14796998121,11cyclictest4839-21needreboot18:32:151
14796998120,9cyclictest17971-21unixbench-2d18:57:251
14799998025,48cyclictest16043-21unixbench_multi19:57:253
14799998021,52cyclictest3443-21unixbench_singl19:32:223
14796998031,42cyclictest28973-21grep21:32:041
1479699803,71cyclictest0-21swapper/118:07:051
1479699803,70cyclictest16345-21taskset21:02:171
1479699803,36cyclictest26690-21gltestperf18:12:111
1479699803,33cyclictest1304-21runrttasks19:59:561
1479699803,25cyclictest5094-21df_abs20:42:021
1479699803,10cyclictest18303-21python20:02:191
14796998021,10cyclictest6597-21fschecks_count21:52:021
14796998019,9cyclictest3229-21cpuspeed_turbos17:27:081
14796998016,11cyclictest5800-21cpuspeed_turbos17:32:071
14796998014,14cyclictest0-21swapper/117:57:121
1479999794,67cyclictest0-21swapper/319:26:503
14799997924,48cyclictest0-21swapper/321:37:083
14799997913,13cyclictest0-21swapper/317:52:453
14799997913,13cyclictest0-21swapper/317:52:453
1479699794,68cyclictest0-21swapper/121:16:571
1479699794,12cyclictest0-21swapper/119:47:091
14796997930,43cyclictest9265-21missed_timers17:37:211
1479699793,9cyclictest15483-21unixbench_multi18:52:261
1479699793,7cyclictest19320-21kworker/u8:018:37:031
1479699793,69cyclictest0-21swapper/122:05:291
1479699793,69cyclictest0-21swapper/119:07:081
1479699793,69cyclictest0-21swapper/117:22:101
1479999785,51cyclictest0-21swapper/318:48:183
1479999784,66cyclictest0-21swapper/322:12:143
1479999784,25cyclictest0-21swapper/318:27:053
1479999784,25cyclictest0-21swapper/318:27:053
1479999784,23cyclictest0-21swapper/318:02:023
1479999783,68cyclictest0-21swapper/321:48:213
1479999783,68cyclictest0-21swapper/321:48:213
14799997824,47cyclictest5676-21gltestperf20:42:083
1479699783,26cyclictest0-21swapper/121:42:241
1479699783,24cyclictest0-21swapper/117:51:041
14796997822,10cyclictest17469-21unixbench_singl17:52:301
14796997822,10cyclictest17469-21unixbench_singl17:52:301
1479999774,22cyclictest0-21swapper/320:16:593
1479999773,23cyclictest0-21swapper/317:27:193
14799997717,12cyclictest0-21swapper/321:21:263
1479699773,68cyclictest0-21swapper/122:11:381
1479699773,67cyclictest0-21swapper/121:07:211
1479699773,67cyclictest0-21swapper/120:21:581
1479699773,67cyclictest0-21swapper/116:57:261
14796997723,10cyclictest0-21swapper/121:27:071
14796997722,10cyclictest28428-21fschecks_time17:12:121
14796997722,10cyclictest28428-21fschecks_time17:12:121
14796997720,9cyclictest1304-21runrttasks18:49:111
14796997719,9cyclictest7180-21df_abs19:42:061
14796997718,9cyclictest5005-21fschecks_time19:37:081
14796997713,12cyclictest0-21swapper/121:11:571
14796997713,12cyclictest0-21swapper/121:11:571
1479999769,9cyclictest98550irq/46-eth019:11:593
1479999769,9cyclictest98550irq/46-eth019:11:593
1479999764,51cyclictest0-21swapper/316:58:003
1479999764,21cyclictest0-21swapper/320:36:583
1479999764,19cyclictest0-21swapper/319:07:203
1479999763,23cyclictest0-21swapper/317:17:163
14799997620,11cyclictest14424-21gltestperf22:07:073
14799997615,12cyclictest0-21swapper/319:17:013
1479699763,67cyclictest14786-21cyclictest18:18:531
1479699763,27cyclictest0-21swapper/117:42:121
14796997623,9cyclictest29106-21cpuspeed_turbos19:22:021
14796997623,8cyclictest17722-21sort22:12:171
14796997617,9cyclictest26718-21cat20:21:481
1479999757,58cyclictest0-21swapper/319:26:553
1479999754,23cyclictest0-21swapper/318:22:103
1479999753,23cyclictest0-21swapper/320:31:483
1479999753,23cyclictest0-21swapper/320:31:483
14799997514,12cyclictest0-21swapper/320:07:153
14799997512,12cyclictest0-21swapper/316:52:143
1479699753,65cyclictest0-21swapper/121:36:561
1479699753,31cyclictest21184-21df_abs18:02:071
1479699753,27cyclictest1283-21snmpd17:18:031
1479699753,20cyclictest0-21swapper/119:02:031
14796997520,9cyclictest1304-21runrttasks20:08:311
1479999745,15cyclictest0-21swapper/321:26:343
1479999744,17cyclictest0-21swapper/319:45:173
1479999734,27cyclictest0-21swapper/316:46:563
14799997312,12cyclictest0-21swapper/319:37:093
1479699733,33cyclictest0-21swapper/117:06:551
14796997322,8cyclictest5184-21unixbench_multi21:47:251
14796997322,8cyclictest5184-21unixbench_multi21:47:251
1479899667,35cyclictest0-21swapper/220:21:482
14798996315,12cyclictest0-21swapper/218:47:082
314062613,12sleep20-21swapper/217:17:232
75772593,49sleep00-21swapper/017:34:420
30012564,11sleep20-21swapper/221:45:402
248642564,11sleep00-21swapper/021:21:550
14798995638,11cyclictest16701-21df18:57:062
61372553,46sleep00-21swapper/019:38:410
310042553,45sleep00-21swapper/019:25:590
253362553,45sleep20-21swapper/217:07:082
14798995535,12cyclictest8920-21tune2fs17:37:152
1479399556,29cyclictest0-21swapper/021:31:440
1479399555,12cyclictest0-21swapper/019:07:330
1479399554,13cyclictest0-21swapper/019:32:180
14793995526,13cyclictest0-21swapper/018:57:130
78822542,11sleep20-21swapper/221:53:292
327042543,10sleep00-21swapper/018:22:470
307382543,45sleep21283-21snmpd19:22:302
262662544,11sleep20-21swapper/220:17:402
198132543,44sleep00-21swapper/016:56:420
14798995435,11cyclictest11746-21tune2fs22:02:032
14793995422,15cyclictest0-21swapper/019:17:070
114242543,10sleep20-21swapper/219:51:492
9802533,44sleep00-21swapper/019:29:260
78082533,42sleep00-21swapper/021:52:310
155732533,42sleep00-21swapper/021:02:040
1479899534,24cyclictest0-21swapper/220:36:562
14798995336,10cyclictest14449-21tune2fs18:52:102
1479399534,13cyclictest0-21swapper/020:32:070
1479399534,13cyclictest0-21swapper/020:32:070
1479399534,10cyclictest7638-21wc18:37:240
14793995321,10cyclictest0-21swapper/019:02:160
87102522,10sleep20-21swapper/219:44:232
271612526,12sleep00-21swapper/017:08:470
156982523,11sleep20-21swapper/222:11:352
151632524,11sleep20-21swapper/217:49:322
1479899524,29cyclictest0-21swapper/222:01:432
1479899524,29cyclictest0-21swapper/217:26:552
14798995233,12cyclictest16631-21grep22:12:002
1479399525,28cyclictest0-21swapper/017:17:310
1479399524,28cyclictest0-21swapper/018:52:220
14793995234,11cyclictest7623-21grep19:42:110
131962523,43sleep00-21swapper/018:49:270
74062514,11sleep20-21swapper/217:32:312
56692513,42sleep00-21swapper/018:35:200
304632514,11sleep20-21swapper/218:21:282
278002513,41sleep20-21swapper/218:14:432
244399510,4rtkit-daemon2442-21rtkit-daemon18:27:050
244399510,4rtkit-daemon2442-21rtkit-daemon18:27:050
232402512,10sleep20-21swapper/219:08:312
223572513,11sleep20-21swapper/220:12:042
14798995134,11cyclictest31700-21grep18:22:112
14798995132,11cyclictest11383-21tune2fs17:42:122
1479399514,42cyclictest0-21swapper/021:07:220
1479399514,28cyclictest0-21swapper/020:52:030
1479399514,28cyclictest0-21swapper/020:37:100
1479399514,28cyclictest0-21swapper/018:03:110
14793995122,12cyclictest0-21swapper/020:07:070
14793995121,9cyclictest29117-21latency_hist20:26:480
138142513,40sleep00-21swapper/019:55:050
138142513,40sleep00-21swapper/019:55:050
81222503,10sleep20-21swapper/218:39:092
60392505,11sleep20-21swapper/219:37:382
251972502,11sleep20-21swapper/221:26:172
155912503,40sleep00-21swapper/019:57:190
1479899504,28cyclictest0-21swapper/218:07:152
1479899504,28cyclictest0-21swapper/217:27:062
1479899504,26cyclictest0-21swapper/220:27:032
14798995032,11cyclictest19615-21cpuspeed_turbos20:07:062
14798995015,12cyclictest0-21swapper/218:46:522
1479399505,27cyclictest0-21swapper/017:27:050
1479399505,26cyclictest0-21swapper/016:57:250
1479399504,27cyclictest0-21swapper/017:47:070
1479399504,27cyclictest0-21swapper/016:47:580
1479399504,26cyclictest0-21swapper/022:11:440
1479399504,26cyclictest0-21swapper/021:32:080
1479399504,25cyclictest0-21swapper/020:31:180
14793995021,12cyclictest0-21swapper/019:12:110
14793995021,12cyclictest0-21swapper/019:12:110
14793995020,13cyclictest0-21swapper/020:46:580
14793995020,12cyclictest0-21swapper/018:12:230
14793995019,13cyclictest0-21swapper/021:37:130
14793995019,12cyclictest0-21swapper/021:20:150
14793995018,14cyclictest0-21swapper/020:03:330
66382492,10sleep20-21swapper/220:42:482
251892493,40sleep00-21swapper/018:08:320
181372494,11sleep20-21swapper/220:02:172
164552492,11sleep20-21swapper/220:01:282
1479899496,26cyclictest0-21swapper/220:31:592
1479899496,26cyclictest0-21swapper/220:31:592
1479899495,27cyclictest0-21swapper/221:26:562
1479899494,36cyclictest31066-21yum-updatesd-he19:27:032
1479899494,27cyclictest0-21swapper/221:47:032
1479899494,27cyclictest0-21swapper/221:47:032
1479899494,27cyclictest0-21swapper/221:32:042
1479899494,27cyclictest0-21swapper/220:52:202
14798994932,11cyclictest15827-21hwlatdetect21:02:072
14798994918,13cyclictest0-21swapper/221:16:582
1479399494,27cyclictest0-21swapper/021:58:540
1479399494,27cyclictest0-21swapper/021:12:140
1479399494,27cyclictest0-21swapper/021:12:140
1479399494,26cyclictest0-21swapper/017:12:190
1479399494,26cyclictest0-21swapper/017:12:190
1479399493,41cyclictest25497-21cat20:17:120
1479399493,27cyclictest0-21swapper/018:42:280
1479399493,26cyclictest0-21swapper/020:57:180
14793994917,12cyclictest0-21swapper/017:53:090
14793994917,12cyclictest0-21swapper/017:53:090
14793994916,13cyclictest0-21swapper/017:02:260
298272482,11sleep20-21swapper/217:15:382
298272482,11sleep20-21swapper/217:15:382
195692485,10sleep20-21swapper/221:11:382
1479899485,33cyclictest0-21swapper/217:51:542
1479899485,33cyclictest0-21swapper/217:51:542
1479899484,27cyclictest0-21swapper/221:12:182
1479899484,27cyclictest0-21swapper/221:12:182
1479899484,27cyclictest0-21swapper/219:52:242
1479899484,27cyclictest0-21swapper/219:52:242
1479899484,27cyclictest0-21swapper/217:02:152
1479899484,27cyclictest0-21swapper/216:52:142
1479899484,27cyclictest0-21swapper/216:51:572
1479899484,26cyclictest0-21swapper/219:06:512
14798994817,13cyclictest0-21swapper/216:57:142
1479399485,25cyclictest0-21swapper/017:57:040
1479399484,26cyclictest0-21swapper/017:41:540
1479399484,23cyclictest3091-21latency_hist21:46:450
144452482,11sleep20-21swapper/221:00:542
285012475,10sleep20-21swapper/219:21:172
1479899474,27cyclictest0-21swapper/218:02:142
1479899474,26cyclictest0-21swapper/221:37:082
1479899474,26cyclictest0-21swapper/219:12:172
1479899474,26cyclictest0-21swapper/219:12:172
1479899474,25cyclictest0-21swapper/217:58:102
14798994720,11cyclictest555-21yum-updatesd-he18:27:052
14798994720,11cyclictest555-21yum-updatesd-he18:27:052
1479399474,26cyclictest0-21swapper/020:12:050
94512463,11sleep20-21swapper/220:51:342
1479399464,25cyclictest0-21swapper/020:43:290
14793994627,11cyclictest10438-21missed_timers19:47:150
37532452,9sleep20-21swapper/219:35:442
144882443,6sleep00-21swapper/016:43:250
1305724010,18sleep20-21swapper/216:42:102
1479699373,10cyclictest0-21swapper/116:46:571
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional