You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-27 - 15:19

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack7slot3s.osadl.org (updated Sat Jul 27, 2024 12:43:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
303322940,2sleep20-21swapper/210:14:412
284122840,3sleep30-21swapper/309:28:413
142712820,2sleep3495199cyclictest11:19:113
175672810,2sleep00-21swapper/012:03:330
247252800,1sleep00-21swapper/008:08:080
494899746,43cyclictest25667-21ps08:08:330
494899741,60cyclictest0-21swapper/009:58:370
4951997329,26cyclictest17497-21sed12:03:313
495099727,25cyclictest0-21swapper/212:03:232
4948997045,9cyclictest2370-21grep11:03:380
145962700,2sleep30-21swapper/311:59:293
494899688,34cyclictest20685-21grep11:28:080
494899688,34cyclictest20685-21grep11:28:080
494899686,42cyclictest0-21swapper/007:13:230
4951996731,15cyclictest2395-21sed08:33:363
4951996729,19cyclictest12727-21if_err_wlan009:03:303
494999667,10cyclictest7950irq/56-dwc_otg09:48:201
494899666,48cyclictest0-21swapper/009:33:130
241952660,1sleep10-21swapper/109:23:361
241952660,1sleep10-21swapper/109:23:361
4951996531,13cyclictest25456-21sed08:08:283
4951996529,17cyclictest19069-21sh11:25:233
4951996529,17cyclictest19069-21sh11:25:233
4951996528,17cyclictest30646-21ps10:58:383
495199652,12cyclictest0-21swapper/309:48:203
494999652,8cyclictest19696-21ssh09:18:201
4949996515,18cyclictest8050irq/56-dwc_otg_11:48:201
494899655,44cyclictest7912-21sed10:28:310
4951996427,15cyclictest2484-21rm10:21:213
494899643,45cyclictest13249-21grep09:53:090
4951996331,15cyclictest11335-21sensors07:28:373
4951996330,21cyclictest8151-21ntp_states10:28:353
4951996328,11cyclictest10392-21ssh12:33:563
494899631,22cyclictest101ktimersoftd/007:28:080
494899628,50cyclictest101ktimersoftd/010:23:080
4948996249,4cyclictest12588-21sort09:03:280
494899624,22cyclictest66150kworker/u8:012:23:210
4948996241,14cyclictest101ktimersoftd/010:39:160
494899623,39cyclictest27191-21aten_rbpower_en09:28:230
4951996133,17cyclictest18565-21/usr/sbin/munin09:58:373
494999619,7cyclictest8050irq/56-dwc_otg_09:53:181
494999613,14cyclictest0-21swapper/112:18:221
494899614,34cyclictest10504-21apt-get07:28:180
4948996119,22cyclictest8577-21idleruntime-cro12:33:080
208402610,2sleep30-21swapper/309:18:393
4951996030,17cyclictest21625-21/usr/sbin/munin11:28:303
494999606,8cyclictest8150irq/56-dwc_otg_10:58:241
494899606,43cyclictest6887-21ssh11:50:160
494899601,30cyclictest0-21swapper/010:33:180
4951995932,17cyclictest25657-21ssh09:25:403
4951995932,17cyclictest25657-21ssh09:25:403
4951995931,13cyclictest5174-21ssh09:42:113
4951995922,21cyclictest0-21swapper/310:23:313
494899596,44cyclictest0-21swapper/010:48:220
494899595,35cyclictest9940-21timerandwakeup12:33:370
494899593,44cyclictest0-21swapper/011:55:230
4948995923,5cyclictest0-21swapper/011:08:210
495199585,19cyclictest8150irq/56-dwc_otg_09:43:143
4951995827,12cyclictest16407-21ssh10:39:193
4951995826,17cyclictest824750kworker/u8:211:17:363
4951995733,12cyclictest14260-21/usr/sbin/munin09:53:303
4951995727,7cyclictest23326-21df08:03:253
4951995727,12cyclictest3439-21ssh12:26:093
4951995726,22cyclictest13919-21ssh10:36:583
495099575,14cyclictest21026-21chrt10:03:182
494899574,5cyclictest20941-21rm12:08:200
4951995632,14cyclictest10537-21/usr/sbin/munin08:58:223
4951995627,10cyclictest31953-21latency_hist08:28:083
4951995625,13cyclictest31431-21/usr/sbin/munin09:33:283
495099563,8cyclictest8050irq/56-dwc_otg_11:03:212
495099561,17cyclictest0-21swapper/211:43:192
494999564,9cyclictest7950irq/56-dwc_otg11:23:221
494999564,9cyclictest7950irq/56-dwc_otg11:23:221
494999561,9cyclictest0-21swapper/107:18:211
494999561,9cyclictest0-21swapper/107:18:211
494899569,35cyclictest0-21swapper/008:58:190
4948995627,12cyclictest3880-21df10:23:250
4948995624,19cyclictest16315-21fschecks_count09:13:260
494899561,45cyclictest13108-21zcat07:33:380
4948995612,27cyclictest0-21swapper/009:38:190
4951995529,15cyclictest30510-21ssh11:38:593
4951995520,12cyclictest8150irq/56-dwc_otg_12:28:323
494899555,32cyclictest25800-21ps11:33:350
4948995538,5cyclictest101ktimersoftd/011:41:400
4948995535,13cyclictest101ktimersoftd/011:58:210
4948995535,10cyclictest101ktimersoftd/008:27:410
4948995532,9cyclictest14078-21latency09:53:280
494899552,28cyclictest4407-21grep08:38:390
494899550,40cyclictest31046-21ssh12:19:530
4951995430,14cyclictest28423-21ssh10:55:553
4951995429,10cyclictest3855-21ssh11:06:443
4951995423,20cyclictest8150irq/56-dwc_otg_11:09:313
494899549,21cyclictest25641-21ssh09:25:380
494899549,21cyclictest25641-21ssh09:25:380
4948995434,4cyclictest21081-21ls07:58:090
4948995434,4cyclictest21081-21ls07:58:090
4948995434,10cyclictest101ktimersoftd/010:06:430
4948995432,4cyclictest0-21swapper/009:18:240
4948995424,6cyclictest0-21swapper/011:43:200
4948995412,39cyclictest101ktimersoftd/011:28:220
4948995410,26cyclictest22511-21sshd07:58:400
495199532,9cyclictest8150irq/56-dwc_otg_07:58:193
4951995329,11cyclictest10981-21ssh11:55:193
4951995327,22cyclictest6659-21ssh11:49:503
4951995327,13cyclictest22447-21ssh12:09:003
4951995326,13cyclictest22505-21ssh10:04:003
4951995323,11cyclictest21721-21diskmemload10:47:493
4951995320,20cyclictest8150irq/56-dwc_otg_12:14:333
4951995319,8cyclictest27843-21ssh11:36:373
494999533,10cyclictest8150irq/56-dwc_otg_10:18:201
494899539,28cyclictest9568-21latency_hist09:48:090
4948995336,4cyclictest101ktimersoftd/010:58:340
4948995334,9cyclictest101ktimersoftd/010:55:510
494899533,34cyclictest10556-21sh11:14:500
494899533,31cyclictest30471-21ssh10:14:570
4948995325,14cyclictest153722sleep009:09:220
4948995322,19cyclictest0-21swapper/008:44:120
4948995322,19cyclictest0-21swapper/008:44:120
4951995225,12cyclictest24301-21ssh10:50:063
4951995225,11cyclictest3311-21ssh11:46:133
4951995224,11cyclictest14697-21ssh12:39:263
4951995224,10cyclictest31801-21runrttasks10:17:433
4951995223,12cyclictest8050irq/56-dwc_otg_10:12:173
494899526,43cyclictest15849-21rm12:41:360
494899525,37cyclictest28191-21ssh12:17:100
494899524,31cyclictest0-21swapper/010:08:200
494899523,34cyclictest29782-21chrt08:19:310
494899521,5cyclictest16407-21munin-run11:23:080
4951995126,13cyclictest32486-21ssh12:22:363
4951995124,10cyclictest8797-21sh07:23:223
494899516,41cyclictest0-21swapper/007:38:200
4948995129,6cyclictest0-21swapper/008:33:350
4951995024,7cyclictest8150irq/56-dwc_otg_07:23:083
4951995024,7cyclictest8150irq/56-dwc_otg_07:23:083
494999508,25cyclictest30862-21ssh09:33:131
494999507,27cyclictest0-21swapper/111:53:231
494899502,40cyclictest0-21swapper/008:16:440
4951994937,8cyclictest28528-21apt-get08:18:233
4951994925,15cyclictest16098-21wget09:13:223
4951994922,10cyclictest8150irq/56-dwc_otg_07:18:093
4951994921,10cyclictest0-21swapper/308:49:423
495099493,8cyclictest0-21swapper/209:18:202
4951994835,11cyclictest16715-21/usr/sbin/munin07:43:333
4951994832,11cyclictest14158-21wget07:38:203
4951994823,12cyclictest10249-21chrt08:57:583
4951994821,12cyclictest4717-21chrt08:41:283
495099481,15cyclictest13140-21uniq11:58:262
494999489,24cyclictest0-21swapper/109:58:211
4948994822,16cyclictest19544-21timerandwakeup10:43:360
4951994727,7cyclictest13125-21sensors_temp07:33:383
4951994720,11cyclictest15570-21runrttasks09:11:473
495099472,22cyclictest0-21swapper/211:56:362
4949994716,12cyclictest1481-21/usr/sbin/munin08:33:371
4951994632,11cyclictest19603-21grep07:53:233
4951994632,11cyclictest19603-21grep07:53:233
4951994631,12cyclictest27533-21/usr/sbin/munin08:13:353
4951994631,11cyclictest18413-21ntp_states07:48:353
4948994625,6cyclictest0-21swapper/008:30:510
4951994532,11cyclictest741-21ls08:28:403
4951994520,11cyclictest6380-21chrt08:44:343
4951994520,11cyclictest6380-21chrt08:44:343
495099452,10cyclictest0-21swapper/210:43:182
494999457,25cyclictest0-21swapper/110:48:221
494999456,23cyclictest700-21ssh12:23:141
494999452,8cyclictest8150irq/56-dwc_otg_09:38:181
4948994525,7cyclictest0-21swapper/007:46:560
44472453,34sleep00-21swapper/007:10:160
494999449,13cyclictest8050irq/56-dwc_otg_08:08:351
494999448,22cyclictest0-21swapper/107:53:211
494999448,22cyclictest0-21swapper/107:53:211
494999446,26cyclictest0-21swapper/109:13:211
4949994416,9cyclictest0-21swapper/112:03:211
494899441,5cyclictest0-21swapper/007:48:210
4948994413,22cyclictest0-21swapper/008:55:100
494899441,26cyclictest7585-21ntpq08:48:320
495099437,23cyclictest0-21swapper/208:58:222
494999437,24cyclictest0-21swapper/108:38:221
4949994317,5cyclictest6671-21latency_hist08:48:091
4949994317,5cyclictest6671-21latency_hist08:48:091
4949994312,21cyclictest0-21swapper/112:28:501
494999431,17cyclictest13022-21open_inodes07:33:351
270112430,5sleep1494999cyclictest12:14:571
495099423,12cyclictest0-21swapper/209:13:212
494999429,13cyclictest0-21swapper/111:08:211
494999427,23cyclictest0-21swapper/108:03:231
494999421,7cyclictest0-21swapper/111:03:241
4949994215,5cyclictest30573-21fschecks_count08:23:241
494999421,21cyclictest3558-21ssh10:23:101
494999421,16cyclictest0-21swapper/111:38:401
4949994211,20cyclictest0-21swapper/111:17:521
4948994218,10cyclictest81162sleep007:20:180
4948994218,10cyclictest81162sleep007:20:180
104642420,2sleep10-21swapper/112:34:051
495099419,20cyclictest0-21swapper/210:53:402
495099413,5cyclictest0-21swapper/210:33:342
4950994119,5cyclictest20706-21vmstat07:53:402
4950994119,5cyclictest20706-21vmstat07:53:402
494999417,22cyclictest0-21swapper/111:58:211
494999411,5cyclictest6197-21wget09:43:231
133032410,2sleep20-21swapper/209:03:402
495099407,21cyclictest0-21swapper/208:18:242
4950994010,14cyclictest427650ssh12:27:442
4950994010,12cyclictest8050irq/56-dwc_otg_12:08:202
494999406,23cyclictest0-21swapper/107:28:141
494999401,8cyclictest8589-21apt-get07:23:171
494999401,27cyclictest26506-21sh10:09:301
494999401,16cyclictest28270-21ssh10:55:341
4950993930,5cyclictest301ktimersoftd/208:23:172
494999399,23cyclictest0-21swapper/110:04:041
494999392,21cyclictest21274-21idleruntime11:28:261
4949993918,4cyclictest1860250wget10:43:211
4949993913,6cyclictest0-21swapper/108:58:211
494999391,23cyclictest31920-21ssh10:17:581
494999391,22cyclictest7779-21/usr/sbin/munin10:28:291
494999391,12cyclictest25716-21ssh11:33:331
494999390,11cyclictest22441-21ssh12:08:591
13172391,4sleep21325-21rm09:37:022
495099386,4cyclictest0-21swapper/211:30:022
495099383,11cyclictest0-21swapper/210:38:182
495099381,6cyclictest29-21rcuc/208:08:212
494999387,4cyclictest14266-21unixbench_singl12:38:401
494999386,4cyclictest7950irq/56-dwc_otg08:28:221
4949993815,11cyclictest12772-21basename11:18:221
68342371,33sleep20-21swapper/211:50:112
495099376,12cyclictest0-21swapper/212:13:202
4950993720,5cyclictest9858-21ssh11:13:402
4950993719,4cyclictest8050irq/56-dwc_otg_10:08:182
4950993712,8cyclictest0-21swapper/212:41:402
494999378,5cyclictest8050irq/56-dwc_otg_09:03:231
494999371,19cyclictest0-21swapper/109:28:231
495099362,19cyclictest9204-21ssh12:33:262
4950993616,5cyclictest769-21grep08:28:412
495099361,25cyclictest14583-21timerandwakeup09:53:352
494999366,10cyclictest8050irq/56-dwc_otg_07:43:361
4949993613,7cyclictest825-21ssh11:43:231
494999361,11cyclictest17647-21ssh10:42:031
495099354,16cyclictest17132-21sort11:23:262
495099354,16cyclictest17132-21sort11:23:262
4950993526,4cyclictest0-21swapper/210:58:212
495099351,6cyclictest0-21swapper/209:48:352
4950993511,5cyclictest1235450wget07:33:202
494999352,20cyclictest0-21swapper/108:53:381
494999351,25cyclictest13930-21ssh10:36:591
494999351,13cyclictest8150irq/56-dwc_otg_08:13:421
495099345,5cyclictest7950irq/56-dwc_otg11:33:242
495099342,10cyclictest0-21swapper/207:13:212
495099341,19cyclictest6817-21ls08:48:092
495099341,19cyclictest6817-21ls08:48:092
4950993410,7cyclictest8617-21aten_rbpower_cu07:23:192
494999347,9cyclictest8150irq/56-dwc_otg_08:03:081
494999346,7cyclictest0-21swapper/109:08:211
495099336,7cyclictest31-21ksoftirqd/209:58:242
495099336,6cyclictest22351-21grep10:48:222
495099333,21cyclictest15273-21grep09:08:402
495099331,8cyclictest5184-21fschecks_time12:28:272
495099331,29cyclictest16226-21cut07:43:242
495099331,22cyclictest5449-21ssh11:08:312
44452333,21sleep30-21swapper/307:10:143
495099326,6cyclictest8150irq/56-dwc_otg_08:53:262
495099325,5cyclictest7950irq/56-dwc_otg07:28:382
495099324,7cyclictest0-21swapper/208:48:262
495099323,3cyclictest0-21swapper/210:21:112
494999321,7cyclictest5729-21proc_pri07:13:361
494999321,12cyclictest8476-21latency_hist08:53:091
495099316,5cyclictest8150irq/56-dwc_otg_09:43:092
495099315,13cyclictest8150irq/56-dwc_otg_08:33:382
495099312,3cyclictest0-21swapper/211:38:192
495099312,21cyclictest0-21swapper/208:16:542
495099311,18cyclictest4196-21kernelversion10:23:302
494999312,3cyclictest8050irq/56-dwc_otg_07:48:381
494999311,6cyclictest8150irq/56-dwc_otg_07:38:201
495099308,6cyclictest13393-21ntp_kernel_err11:18:312
495099303,11cyclictest8150irq/56-dwc_otg_07:48:242
495099302,13cyclictest8050irq/56-dwc_otg_12:18:282
495099301,6cyclictest8050irq/56-dwc_otg_07:38:342
495099301,5cyclictest23183-21aten_rbpower_en08:03:242
495099301,22cyclictest0-21swapper/207:18:252
495099301,22cyclictest0-21swapper/207:18:252
495099301,19cyclictest24525-21timerwakeupswit09:23:402
495099301,19cyclictest24525-21timerwakeupswit09:23:402
4950993010,5cyclictest7950irq/56-dwc_otg08:38:402
4949993016,12cyclictest30126-21cat08:23:081
495099296,4cyclictest0-21swapper/209:44:192
495099292,6cyclictest7950irq/56-dwc_otg10:28:242
495099291,23cyclictest21831-21latency07:58:262
44342293,20sleep20-21swapper/207:10:052
495099286,10cyclictest7950irq/56-dwc_otg09:28:222
45202283,16sleep10-21swapper/107:11:141
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional