You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-11-25 - 14:21

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack7slot3s.osadl.org (updated Mon Nov 25, 2024 00:43:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1770222840,4sleep217564-21ls19:14:122
281492890,3sleep128145-21latency_hist23:24:131
197722810,3sleep00-21swapper/000:39:440
197722810,3sleep00-21swapper/000:39:440
252682780,4sleep025263-21ls23:19:330
17795997812,22cyclictest101ktimersoftd/000:29:240
15972740,2sleep20-21swapper/219:59:122
36292720,1sleep20-21swapper/223:34:242
17795996843,6cyclictest14891-21taskset00:34:260
97172670,2sleep30-21swapper/320:19:343
17795996649,5cyclictest101ktimersoftd/022:04:300
175862640,2sleep30-21swapper/323:09:333
40632610,4sleep04058-21ssh23:34:340
1779599616,41cyclictest19775-21sort22:29:300
1779599601,39cyclictest13368-21cpuspeed23:04:280
173922603,48sleep30-21swapper/319:12:283
1779599596,32cyclictest0-21swapper/019:59:260
17795995936,6cyclictest8150irq/56-dwc_otg_22:49:240
1779599591,45cyclictest0-21swapper/023:54:210
1779599583,44cyclictest0-21swapper/021:48:270
17795995820,25cyclictest8828-21unixbench_singl00:24:410
1779599572,45cyclictest0-21swapper/022:44:260
1779599571,48cyclictest0-21swapper/000:19:310
44082560,5sleep21779799cyclictest22:08:582
210632560,2sleep20-21swapper/222:30:272
1779599565,4cyclictest0-21swapper/022:39:240
1779599564,38cyclictest0-21swapper/000:04:120
1779599563,42cyclictest0-21swapper/020:29:250
1779599562,41cyclictest13-21rcuc/023:24:280
1779599562,41cyclictest13-21rcuc/023:24:280
17795995621,13cyclictest25671-21latency19:34:330
17795995621,13cyclictest25671-21latency19:34:330
1779599561,37cyclictest0-21swapper/021:54:130
17795995611,8cyclictest8050irq/56-dwc_otg_21:54:280
17795995611,8cyclictest8050irq/56-dwc_otg_21:54:280
1779599561,18cyclictest18133-21latency_hist20:44:130
1779599555,36cyclictest9-21ksoftirqd/019:44:310
1779599553,38cyclictest0-21swapper/022:59:270
17795995533,5cyclictest8941-21apt-get22:59:120
17795995530,10cyclictest101ktimersoftd/021:14:280
17795995530,10cyclictest101ktimersoftd/021:14:280
1779599552,40cyclictest0-21swapper/021:09:270
1779599551,39cyclictest0-21swapper/021:29:120
17795995439,4cyclictest8410-21ntpq21:29:350
17795995425,13cyclictest8150irq/56-dwc_otg_22:19:300
1779899537,8cyclictest8150irq/56-dwc_otg_23:59:243
17795995334,5cyclictest23138-21wget22:34:290
1779599533,35cyclictest886-21ls22:04:120
1779599532,29cyclictest21810-21fschecks_count19:24:290
1779699524,29cyclictest60-21kswapd023:24:221
1779699524,29cyclictest60-21kswapd023:24:221
17795995238,8cyclictest0-21swapper/023:54:130
17795995232,4cyclictest18194-21acpi20:44:230
17795995232,4cyclictest18194-21acpi20:44:230
1779599522,39cyclictest0-21swapper/019:19:260
17795995223,26cyclictest22990-21grep20:54:400
1779599521,40cyclictest1120-21ntpq00:14:370
17796995121,4cyclictest19582-21latency_hist19:19:121
17795995128,2cyclictest0-21swapper/023:29:240
17795995128,13cyclictest101ktimersoftd/000:07:560
17795995127,12cyclictest101ktimersoftd/023:09:290
17795995126,7cyclictest101ktimersoftd/021:39:260
17795995126,7cyclictest101ktimersoftd/021:39:260
17795995124,7cyclictest32125-21munin-run19:54:120
1779599511,40cyclictest0-21swapper/022:09:340
1779599511,39cyclictest0-21swapper/023:18:110
1779599511,35cyclictest0-21swapper/020:24:390
1779599511,26cyclictest754-21/usr/sbin/munin19:54:410
17795995111,4cyclictest19510-21mktemp19:19:120
1779599504,33cyclictest0-21swapper/023:44:260
17795995025,11cyclictest7620-21grep20:14:280
1779599502,36cyclictest0-21swapper/020:24:070
17795995019,22cyclictest451-21ssh21:19:240
1779599501,28cyclictest0-21swapper/022:14:280
1779599501,28cyclictest0-21swapper/022:14:280
1779899498,10cyclictest11280-21ssh23:44:243
17795994928,5cyclictest19099-21cron22:29:120
17795994920,14cyclictest101ktimersoftd/019:29:390
17795994920,14cyclictest101ktimersoftd/019:29:390
1779599491,38cyclictest0-21swapper/020:52:290
1779799481,7cyclictest15777-21ssh22:24:252
1779699485,30cyclictest7950irq/56-dwc_otg00:24:241
1779599483,6cyclictest0-21swapper/020:59:230
1779599482,3cyclictest0-21swapper/020:34:250
1779599481,37cyclictest7024-21latency_hist20:14:130
1779599481,36cyclictest9-21ksoftirqd/019:39:480
1779599481,33cyclictest0-21swapper/000:11:400
1779899471,5cyclictest8150irq/56-dwc_otg_23:04:243
1779599471,28cyclictest7768-21cut23:39:300
1779599462,34cyclictest0-21swapper/021:04:330
17795994620,15cyclictest101ktimersoftd/021:36:590
1779699451,5cyclictest0-21swapper/123:44:221
1779599452,32cyclictest0-21swapper/020:04:480
72782440,2sleep30-21swapper/322:55:443
1779899447,23cyclictest0-21swapper/320:14:183
1779899444,24cyclictest0-21swapper/321:14:273
1779899444,24cyclictest0-21swapper/321:14:273
17797994420,4cyclictest30054-21aten_rbpower_po21:59:272
1779699442,29cyclictest20802-21unixbench-2d19:19:401
1779699441,3cyclictest8150irq/56-dwc_otg_19:34:131
1779699441,3cyclictest8150irq/56-dwc_otg_19:34:131
17796994411,4cyclictest17950-21sh20:44:121
17796994410,24cyclictest0-21swapper/121:29:041
208752430,1sleep10-21swapper/121:46:221
1779899437,24cyclictest0-21swapper/323:24:253
1779899437,24cyclictest0-21swapper/323:24:253
1779899434,9cyclictest0-21swapper/321:29:233
17798994311,9cyclictest8050irq/56-dwc_otg_00:09:233
17797994317,7cyclictest14811-21latency_hist21:39:122
1779699432,4cyclictest3885-21ls23:34:311
35232420,2sleep30-21swapper/322:07:013
236152420,2sleep10-21swapper/120:59:131
1779899427,22cyclictest0-21swapper/319:59:173
1779899426,23cyclictest0-21swapper/322:43:023
17798994222,6cyclictest2697650wget19:39:253
17797994219,4cyclictest29-21rcuc/221:39:342
17797994219,4cyclictest29-21rcuc/221:39:342
1779699421,5cyclictest4996-21timerandwakeup00:19:391
17798994121,5cyclictest1292-21runrttasks23:39:313
17796994119,4cyclictest2736650wget21:09:261
293002400,2sleep30-21swapper/321:58:403
293002400,2sleep30-21swapper/321:58:403
1779899407,20cyclictest0-21swapper/319:44:273
1779799406,22cyclictest0-21swapper/223:05:422
1779699401,25cyclictest0-21swapper/123:39:201
1779899393,5cyclictest8150irq/56-dwc_otg_22:29:403
1779899393,32cyclictest20799-21ssh23:14:273
17797993922,4cyclictest18272-21latency_hist00:39:132
17797993913,7cyclictest131-21systemd-journal21:59:122
17797993913,7cyclictest131-21systemd-journal21:59:122
1779699395,17cyclictest8150irq/56-dwc_otg_23:34:121
1779699391,29cyclictest0-21swapper/123:54:241
141932390,2sleep21779799cyclictest00:33:262
1779899381,23cyclictest0-21swapper/320:44:253
1779899381,23cyclictest0-21swapper/320:44:253
1779799385,21cyclictest31-21ksoftirqd/222:44:242
17796993817,5cyclictest1459750wget20:34:261
1779699381,21cyclictest11296-21aten_rbpower_en00:29:251
1779899376,20cyclictest37-21rcuc/300:05:193
1779899373,5cyclictest7950irq/56-dwc_otg23:19:363
17798993717,4cyclictest24745-21sh21:51:543
17798993715,6cyclictest8150irq/56-dwc_otg_00:39:253
17798993715,6cyclictest8150irq/56-dwc_otg_00:39:253
1779799378,14cyclictest0-21swapper/223:03:052
1779799371,25cyclictest19035-21ls00:39:342
1779799371,25cyclictest19035-21ls00:39:342
1779799371,24cyclictest29374-21ls23:24:382
1779799371,24cyclictest29374-21ls23:24:382
1779799371,20cyclictest5648-21ssh22:09:382
17796993716,5cyclictest25720-21fschecks_count00:04:301
1779699371,4cyclictest7950irq/56-dwc_otg20:24:221
1779699371,26cyclictest5954-21awk22:54:341
1779699371,21cyclictest0-21swapper/122:29:241
1779899361,21cyclictest39-21ksoftirqd/321:39:233
1779899361,21cyclictest39-21ksoftirqd/321:39:233
1779899361,10cyclictest2006250ssh23:56:343
17798993610,9cyclictest7950irq/56-dwc_otg00:24:363
1779799369,6cyclictest8150irq/56-dwc_otg_00:19:122
1779799367,5cyclictest19013-21grep23:54:392
1779799364,20cyclictest8050irq/56-dwc_otg_20:54:392
1779799363,21cyclictest0-21swapper/222:17:432
1779799363,21cyclictest0-21swapper/222:17:432
17797993615,6cyclictest10952-21/usr/sbin/munin20:24:312
17797993614,5cyclictest1292-21runrttasks20:11:342
1779699367,22cyclictest0-21swapper/122:24:251
1779699364,5cyclictest7950irq/56-dwc_otg19:39:411
17796993621,6cyclictest7950irq/56-dwc_otg22:19:241
17796993616,5cyclictest23090-21sh23:59:561
17796993613,6cyclictest1292-21runrttasks21:31:081
1779699361,15cyclictest29805-21apt-config21:59:131
1779699361,15cyclictest29805-21apt-config21:59:131
1779899357,15cyclictest0-21swapper/319:54:293
1779899356,24cyclictest0-21swapper/322:44:263
1779899354,9cyclictest39-21ksoftirqd/321:36:393
1779899354,24cyclictest8150irq/56-dwc_otg_19:24:253
1779899354,17cyclictest7950irq/56-dwc_otg22:10:043
1779899354,13cyclictest8150irq/56-dwc_otg_00:24:123
1779899353,26cyclictest8150irq/56-dwc_otg_23:34:273
17798993516,16cyclictest0-21swapper/322:59:243
17798993514,5cyclictest7116-21apt-config20:14:133
17798993514,17cyclictest0-21swapper/322:14:283
17798993514,17cyclictest0-21swapper/322:14:283
1779899351,24cyclictest2834-21timerwakeupswit22:49:403
17798993510,8cyclictest37-21rcuc/322:24:253
1779799357,13cyclictest8050irq/56-dwc_otg_22:37:422
1779799350,25cyclictest0-21swapper/221:04:292
1779699359,9cyclictest0-21swapper/122:14:341
1779699359,9cyclictest0-21swapper/122:14:341
1779699355,22cyclictest0-21swapper/122:44:241
1779699351,7cyclictest29403-21df00:09:261
1779699351,6cyclictest20940-21grep23:14:301
17796993514,5cyclictest1292-21runrttasks22:06:571
17796993514,4cyclictest1292-21runrttasks22:42:221
17796993513,15cyclictest11204-21ssh23:00:501
1779899349,11cyclictest0-21swapper/323:50:333
1779899348,8cyclictest8050irq/56-dwc_otg_21:59:193
1779899348,24cyclictest0-21swapper/319:19:173
1779899343,7cyclictest0-21swapper/322:19:253
1779899343,4cyclictest8050irq/56-dwc_otg_19:29:383
1779899343,4cyclictest8050irq/56-dwc_otg_19:29:383
1779899343,2cyclictest0-21swapper/300:29:243
1779899342,12cyclictest8150irq/56-dwc_otg_20:09:133
1779799349,6cyclictest7950irq/56-dwc_otg00:09:392
17797993419,12cyclictest775-21ssh23:29:392
17797993412,5cyclictest0-21swapper/223:19:362
1779799341,22cyclictest7950irq/56-dwc_otg23:41:182
1779799341,22cyclictest12668-21ls22:19:332
1779799341,18cyclictest768-21fschecks_time21:19:282
1779699345,20cyclictest7950irq/56-dwc_otg00:39:291
1779699345,20cyclictest7950irq/56-dwc_otg00:39:291
17796993421,9cyclictest0-21swapper/121:19:291
17796993420,4cyclictest8150irq/56-dwc_otg_23:09:281
17796993417,8cyclictest8050irq/56-dwc_otg_23:07:561
17796993416,5cyclictest2896-21dhclient-script00:17:261
1779699341,5cyclictest8050irq/56-dwc_otg_19:24:241
17796993411,12cyclictest0-21swapper/121:43:441
17796993411,12cyclictest0-21swapper/121:43:441
1779899335,6cyclictest8050irq/56-dwc_otg_19:19:123
1779899333,14cyclictest8150irq/56-dwc_otg_00:14:283
1779899332,8cyclictest0-21swapper/320:29:233
17798993315,11cyclictest1292-21runrttasks20:54:253
1779799336,16cyclictest32716-21latency_hist21:19:132
1779799336,16cyclictest32716-21latency_hist21:19:132
1779799335,5cyclictest7950irq/56-dwc_otg20:04:122
1779799334,18cyclictest8150irq/56-dwc_otg_23:49:132
17797993311,9cyclictest8150irq/56-dwc_otg_22:39:232
1779799331,16cyclictest0-21swapper/200:01:362
1779699331,19cyclictest0-21swapper/121:01:411
1779699331,15cyclictest0-21swapper/120:05:131
17796993311,10cyclictest0-21swapper/120:19:121
17796993310,12cyclictest0-21swapper/123:54:131
107302330,1sleep20-21swapper/220:24:122
1779899327,23cyclictest0-21swapper/320:39:273
1779899327,15cyclictest0-21swapper/320:59:253
1779899325,24cyclictest4141-21ssh21:24:253
17798993210,8cyclictest7950irq/56-dwc_otg00:35:013
1779799329,11cyclictest0-21swapper/223:09:232
17797993219,4cyclictest8150irq/56-dwc_otg_00:05:262
1779799321,7cyclictest19501-21latency_hist19:19:122
17797993215,4cyclictest8930-21latency_hist20:19:122
17797993214,5cyclictest1292-21runrttasks20:33:012
17797993213,5cyclictest301ktimersoftd/223:14:182
1779799321,20cyclictest17647-21dpkg23:54:132
1779699325,25cyclictest26444-21ls22:39:121
1779699324,12cyclictest0-21swapper/122:51:511
17796993215,5cyclictest11392-21sh21:34:271
17796993214,8cyclictest193902chrt20:44:441
17796993214,8cyclictest193902chrt20:44:441
1779699321,22cyclictest30519-21latency21:59:331
1779699321,21cyclictest376-21kernelversion19:54:351
1779699321,21cyclictest26518-21timerwakeupswit21:04:381
1779699321,19cyclictest12776-21taskset20:29:251
1779699321,14cyclictest0-21swapper/121:52:311
1779899318,8cyclictest8150irq/56-dwc_otg_21:09:263
1779899317,10cyclictest39-21ksoftirqd/323:30:183
1779899316,5cyclictest8050irq/56-dwc_otg_22:34:313
1779899316,4cyclictest8150irq/56-dwc_otg_21:20:173
1779899316,12cyclictest0-21swapper/321:47:063
1779899315,7cyclictest381ktimersoftd/319:34:373
1779899315,7cyclictest381ktimersoftd/319:34:373
1779799319,8cyclictest7950irq/56-dwc_otg21:53:362
1779799312,20cyclictest0-21swapper/200:19:312
17797993121,7cyclictest14890-21sort20:34:312
1779799312,15cyclictest7950irq/56-dwc_otg00:24:362
17797993116,6cyclictest4923-21ssh22:53:452
1779699316,6cyclictest7950irq/56-dwc_otg20:49:401
1779699315,10cyclictest7950irq/56-dwc_otg20:10:521
1779699311,6cyclictest7950irq/56-dwc_otg19:59:251
17796993113,3cyclictest0-21swapper/100:34:411
17796993111,10cyclictest131-21systemd-journal19:45:461
174002313,21sleep10-21swapper/119:12:341
1779899307,8cyclictest8150irq/56-dwc_otg_20:36:123
1779799304,5cyclictest31-21ksoftirqd/221:44:322
1779799304,11cyclictest8150irq/56-dwc_otg_20:59:342
1779799302,4cyclictest5366-21unixbench_singl21:24:432
1779799302,15cyclictest0-21swapper/219:39:322
1779799302,12cyclictest8969-21rm21:29:422
1779799301,6cyclictest3933-21fschecks_time20:04:302
1779699309,4cyclictest0-21swapper/122:11:101
1779699301,11cyclictest0-21swapper/119:34:421
1779699301,11cyclictest0-21swapper/119:34:421
1779899295,4cyclictest8150irq/56-dwc_otg_19:53:363
1779899294,6cyclictest8050irq/56-dwc_otg_21:04:243
1779899291,17cyclictest0-21swapper/320:25:493
1779799297,12cyclictest8150irq/56-dwc_otg_19:29:292
1779799297,12cyclictest8150irq/56-dwc_otg_19:29:292
1779799297,12cyclictest0-21swapper/220:44:122
1779799295,4cyclictest8150irq/56-dwc_otg_19:19:312
1779799291,26cyclictest31480-21ls19:49:392
17797992911,4cyclictest0-21swapper/222:56:042
1779699292,18cyclictest0-21swapper/120:22:441
17796992911,4cyclictest0-21swapper/121:17:021
17796992911,4cyclictest0-21swapper/121:17:021
207972280,4sleep337-21rcuc/320:49:373
1779799287,15cyclictest0-21swapper/221:09:312
1779799284,7cyclictest21649-21aten_rbpower_vo19:24:262
1779799283,13cyclictest18466-21fschecks_count20:44:292
1779799283,13cyclictest18466-21fschecks_count20:44:292
1779799282,14cyclictest0-21swapper/219:34:552
1779799282,14cyclictest0-21swapper/219:34:552
1779799271,9cyclictest291962/usr/sbin/munin19:44:322
1779699271,17cyclictest0-21swapper/119:52:271
1779799264,4cyclictest7950irq/56-dwc_otg20:49:222
165432254,11sleep00-21swapper/019:09:340
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional