You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-11-23 - 20:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot3s.osadl.org (updated Sat Nov 23, 2024 12:43:38)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1234221730,3sleep21639099cyclictest10:24:572
1234221730,3sleep21639099cyclictest10:24:572
54562960,2sleep20-21swapper/211:02:042
54562960,2sleep20-21swapper/211:02:042
1638899957,43cyclictest0-21swapper/007:34:250
16388998337,5cyclictest8150irq/56-dwc_otg_10:29:240
69622810,10sleep18050irq/56-dwc_otg_08:14:421
204372790,2sleep20-21swapper/211:21:332
16388997837,32cyclictest1292-21runrttasks10:44:220
1638899776,56cyclictest0-21swapper/010:59:220
1638899776,56cyclictest0-21swapper/010:59:220
10202770,5sleep01638899cyclictest12:19:320
324182760,4sleep0101ktimersoftd/009:20:020
324182760,4sleep0101ktimersoftd/009:20:020
277112760,2sleep10-21swapper/110:00:201
75072750,2sleep00-21swapper/010:19:270
156682750,3sleep35317-1kworker/u9:010:29:413
1638999741,47cyclictest49550wget11:39:261
1638899741,53cyclictest29111-21ssh11:34:260
1638899731,53cyclictest9715-21fschecks_time08:24:280
1638999704,48cyclictest8150irq/56-dwc_otg_12:29:301
1638999701,5cyclictest8050irq/56-dwc_otg_10:24:421
1638999701,5cyclictest8050irq/56-dwc_otg_10:24:421
16389997010,39cyclictest7950irq/56-dwc_otg07:44:281
16388997032,4cyclictest0-21swapper/010:49:210
1638899683,48cyclictest26952-21ssh09:59:370
1638899681,48cyclictest10704-21wget11:09:240
16388996732,4cyclictest0-21swapper/010:09:230
1638899671,31cyclictest20154-21latency_hist08:54:110
1638999661,56cyclictest3232-21ssh10:59:271
1638999661,56cyclictest3232-21ssh10:59:271
1638999651,5cyclictest20212-21/usr/sbin/munin08:54:381
1638999651,50cyclictest30984-21/usr/sbin/munin09:19:391
1638999651,50cyclictest30984-21/usr/sbin/munin09:19:391
1638999651,49cyclictest27514-21/usr/sbin/munin09:14:371
1638999651,45cyclictest7950irq/56-dwc_otg12:24:231
1638899652,43cyclictest26793-21unixbench_singl09:09:390
16388996516,31cyclictest9650irq/80-mmc009:29:120
16388996516,31cyclictest9650irq/80-mmc009:29:120
1638899651,48cyclictest22423-21latency_hist09:54:120
1638899651,48cyclictest22423-21latency_hist09:54:120
1638899651,39cyclictest6119-21fschecks_time08:14:300
1638999644,42cyclictest8050irq/56-dwc_otg_09:09:211
1638999642,4cyclictest1700-21sed12:19:411
1638999642,42cyclictest22926-21taskset10:40:301
1638899643,51cyclictest0-21swapper/012:29:250
1638899632,36cyclictest13363-21grep09:39:390
1638899631,47cyclictest23623-21grep07:34:120
1638899631,36cyclictest467-21unixbench_singl10:54:430
254152620,2sleep10-21swapper/107:39:121
1638999616,39cyclictest0-21swapper/111:37:321
1638999615,23cyclictest17906-21ssh10:34:261
1638999614,40cyclictest19443-21fschecks_count09:49:311
1638999614,40cyclictest19443-21fschecks_count09:49:311
1638999612,51cyclictest14236-21ssh12:34:571
1638999612,51cyclictest14236-21ssh12:34:571
1638999611,8cyclictest15786-21vmstat10:29:421
1638999611,45cyclictest15895-21unixbench_multi08:39:381
1638999606,32cyclictest0-21swapper/107:49:421
1638899606,23cyclictest0-21swapper/007:14:240
1638899604,41cyclictest5181-21unixbench_singl10:14:450
1638999595,40cyclictest7950irq/56-dwc_otg10:51:131
1638999595,37cyclictest8150irq/56-dwc_otg_07:29:121
1638999592,4cyclictest0-21swapper/110:04:431
1638999592,40cyclictest0-21swapper/107:39:321
1638999591,7cyclictest0-21swapper/109:34:321
1638999591,4cyclictest20722-21apt-get12:04:261
1638999591,3cyclictest8050irq/56-dwc_otg_09:54:271
1638999588,32cyclictest8150irq/56-dwc_otg_11:59:291
1638999584,45cyclictest8050irq/56-dwc_otg_10:54:251
1638999584,41cyclictest0-21swapper/110:16:321
1638999582,6cyclictest0-21swapper/109:49:111
1638999581,5cyclictest14986-21ssh11:56:421
1638999581,4cyclictest12179-21ssh11:10:121
1638999581,4cyclictest0-21swapper/111:53:581
1638999581,39cyclictest0-21swapper/111:29:451
16389995810,12cyclictest8150irq/56-dwc_otg_10:44:231
16388995842,4cyclictest7378-21ls11:04:320
16388995823,5cyclictest8150irq/56-dwc_otg_12:34:350
16388995823,5cyclictest8150irq/56-dwc_otg_12:34:350
1638899581,39cyclictest19281-21sed07:19:400
1638899581,22cyclictest0-21swapper/008:29:210
1638999576,36cyclictest183350kworker/u9:210:13:421
1638999575,5cyclictest7950irq/56-dwc_otg07:59:331
1638999573,5cyclictest26530-21sh12:10:221
1638999573,5cyclictest26530-21sh12:10:221
1638899574,12cyclictest0-21swapper/011:44:230
1638899572,30cyclictest0-21swapper/011:19:120
1638899571,31cyclictest5932-21grep12:24:420
1638999564,41cyclictest0-21swapper/109:25:191
1638999563,4cyclictest8050irq/56-dwc_otg_11:04:251
1638999562,46cyclictest8150irq/56-dwc_otg_12:40:271
1638899562,36cyclictest0-21swapper/010:34:450
1638899561,6cyclictest8150irq/56-dwc_otg_11:54:250
16388995615,23cyclictest22073-21sh10:39:370
1638999551,5cyclictest0-21swapper/108:34:391
1638999551,46cyclictest0-21swapper/112:18:541
1638999551,40cyclictest7950irq/56-dwc_otg11:21:151
1638899555,8cyclictest24854-21ssh12:09:240
1638899555,8cyclictest24854-21ssh12:09:240
16388995531,5cyclictest25593-21aten_rbpower_vo07:39:250
1638899552,46cyclictest0-21swapper/009:54:450
1638899551,25cyclictest2304450ssh11:24:380
1638999543,42cyclictest0-21swapper/108:05:451
1638999542,4cyclictest7950irq/56-dwc_otg11:46:081
1638999541,6cyclictest8438-21sed09:34:121
1638999541,6cyclictest8438-21sed09:34:121
1638999541,39cyclictest8150irq/56-dwc_otg_09:44:121
16388995428,5cyclictest21254-21grep12:04:320
16388995423,5cyclictest8150irq/56-dwc_otg_09:24:380
1638999533,3cyclictest7950irq/56-dwc_otg11:17:181
1638999532,42cyclictest0-21swapper/109:00:561
1638999531,4cyclictest0-21swapper/108:29:251
1638899539,25cyclictest17592-21sh11:59:380
1638899537,7cyclictest0-21swapper/007:24:240
1638899534,27cyclictest31846-21cat07:54:350
16388995327,5cyclictest17236-21fschecks_time12:39:310
16388995323,14cyclictest1292-21runrttasks08:44:370
16388995323,14cyclictest1292-21runrttasks08:44:370
1638899532,27cyclictest13323-21fschecks_time08:34:300
1638899531,49cyclictest0-21swapper/010:09:110
1638899531,28cyclictest0-21swapper/009:14:280
1638999522,40cyclictest8050irq/56-dwc_otg_11:26:401
1638999521,5cyclictest8521-21sort10:19:421
1638899523,5cyclictest0-21swapper/007:49:250
1638899522,34cyclictest0-21swapper/011:39:230
1638899522,28cyclictest28084-21/usr/sbin/munin07:44:360
16389995110,38cyclictest18467-21fschecks_count07:19:291
16388995129,6cyclictest8050irq/56-dwc_otg_08:04:330
1638899512,28cyclictest22622-21grep08:59:320
16388995121,7cyclictest11233-21fschecks_count10:24:300
16388995121,7cyclictest11233-21fschecks_count10:24:300
1638899511,28cyclictest16050-21fschecks_count09:44:300
1638999501,6cyclictest21866-21/usr/sbin/munin07:29:241
1638999501,6cyclictest17041-21runrttasks08:44:301
1638999501,6cyclictest17041-21runrttasks08:44:301
1638999501,3cyclictest8150irq/56-dwc_otg_09:06:391
1638999499,37cyclictest17290-21switchtime07:14:371
1638999492,44cyclictest0-21swapper/108:24:281
1638999491,44cyclictest19076-21ntpq08:49:321
16388994922,8cyclictest12004-21latency_hist09:39:110
16388994922,5cyclictest12250-21modprobe11:54:110
1638899491,25cyclictest18550-21ssh11:19:300
158462493,10sleep00-21swapper/007:10:400
1638999488,37cyclictest8630-21/usr/sbin/munin08:19:411
1638899487,5cyclictest27194-21diskmemload12:14:260
1638899481,33cyclictest0-21swapper/011:32:150
1639199472,5cyclictest7950irq/56-dwc_otg09:39:223
1638999471,6cyclictest0-21swapper/107:54:341
1638999469,34cyclictest4452-21missed_timers08:09:321
1638899462,30cyclictest0-21swapper/008:22:240
1638899454,9cyclictest8150irq/56-dwc_otg_09:04:250
1639199447,23cyclictest0-21swapper/308:09:243
1639199447,23cyclictest0-21swapper/307:54:223
1639099447,25cyclictest0-21swapper/210:04:242
16388994417,15cyclictest0-21swapper/008:39:380
49242432,4sleep30-21swapper/309:28:433
1639199437,24cyclictest0-21swapper/309:29:163
1639199437,24cyclictest0-21swapper/309:29:163
1639099437,23cyclictest0-21swapper/210:39:252
1638899432,25cyclictest0-21swapper/008:00:520
128182430,5sleep312815-21ssh11:54:273
111082430,18sleep28150irq/56-dwc_otg_08:29:122
1639099427,23cyclictest0-21swapper/209:29:162
1639099427,23cyclictest0-21swapper/209:29:162
1639099422,23cyclictest0-21swapper/208:39:232
1638899421,23cyclictest131-21systemd-journal08:54:120
323182410,2sleep20-21swapper/210:54:362
278472410,6sleep21639099cyclictest07:44:322
1639199417,24cyclictest0-21swapper/309:09:243
1639099415,15cyclictest0-21swapper/208:54:242
1639099411,21cyclictest16660-21ssh10:32:072
1638899417,8cyclictest8050irq/56-dwc_otg_08:09:220
108262410,2sleep20-21swapper/210:24:122
257202400,6sleep31639199cyclictest09:59:013
1639199407,23cyclictest0-21swapper/310:59:243
1639199407,23cyclictest0-21swapper/310:59:243
1639099407,23cyclictest0-21swapper/211:14:272
16390994018,5cyclictest4713-21sh10:14:392
134432400,2sleep20-21swapper/209:39:402
174602391,31sleep217593-21ls08:44:382
174602391,31sleep217593-21ls08:44:382
16391993925,4cyclictest8150irq/56-dwc_otg_10:24:243
16391993925,4cyclictest8150irq/56-dwc_otg_10:24:243
1639099396,23cyclictest0-21swapper/208:09:242
1639099390,7cyclictest8050irq/56-dwc_otg_11:59:132
1639199388,12cyclictest8050irq/56-dwc_otg_10:24:123
1639199387,24cyclictest0-21swapper/310:54:273
1639199387,12cyclictest8050irq/56-dwc_otg_09:14:153
1639199386,23cyclictest0-21swapper/307:39:243
16391993812,14cyclictest8888-21cpuspeed09:34:333
1639099387,24cyclictest0-21swapper/207:39:242
1639099387,23cyclictest0-21swapper/209:09:242
16390993811,5cyclictest29597-21processes11:34:342
41222371,32sleep20-21swapper/209:26:412
273432370,1sleep20-21swapper/212:11:532
273432370,1sleep20-21swapper/212:11:532
1639199379,14cyclictest39-21ksoftirqd/307:39:113
1639199374,25cyclictest4661-21ssh12:24:253
16391993715,11cyclictest3792-21apt-config10:14:123
16391993713,6cyclictest39-21ksoftirqd/310:54:113
1639099371,5cyclictest31251-21diskstats09:19:282
1639099371,5cyclictest31251-21diskstats09:19:282
16390993712,5cyclictest31-21ksoftirqd/211:29:112
128972370,1sleep20-21swapper/211:11:422
1639199369,9cyclictest7950irq/56-dwc_otg11:59:393
1639199361,17cyclictest0-21swapper/311:24:383
16390993620,13cyclictest19084-21unixbench_multi10:34:442
16390993616,6cyclictest0-21swapper/211:04:372
16390993614,7cyclictest31-21ksoftirqd/209:14:272
1639199359,15cyclictest8150irq/56-dwc_otg_11:24:123
1639199357,14cyclictest8150irq/56-dwc_otg_08:29:313
1639199352,9cyclictest8726-21ssh12:29:253
1639199352,14cyclictest8150irq/56-dwc_otg_12:39:123
1639199352,14cyclictest8150irq/56-dwc_otg_12:39:123
1639199351,16cyclictest37-21rcuc/307:49:393
16391993511,11cyclictest0-21swapper/310:39:293
1639099357,25cyclictest0-21swapper/208:14:182
1639099357,23cyclictest0-21swapper/207:54:222
1639099353,17cyclictest8150irq/56-dwc_otg_10:49:322
16390993520,6cyclictest31-21ksoftirqd/212:04:412
1639099351,23cyclictest24558-21switchtime07:34:392
16390993511,5cyclictest7950irq/56-dwc_otg12:34:442
16390993511,5cyclictest7950irq/56-dwc_otg12:34:442
16390993510,12cyclictest0-21swapper/212:39:352
1639199345,20cyclictest26138-21ssh09:59:243
1639199345,17cyclictest0-21swapper/312:19:113
1639199341,5cyclictest8150irq/56-dwc_otg_11:44:233
16391993415,5cyclictest37-21rcuc/309:49:193
16391993415,5cyclictest37-21rcuc/309:49:193
16391993412,7cyclictest39-21ksoftirqd/312:24:113
16391993410,14cyclictest0-21swapper/308:14:183
16391993410,12cyclictest37-21rcuc/309:49:083
1639099343,21cyclictest8050irq/56-dwc_otg_09:54:442
1639099342,23cyclictest31-21ksoftirqd/209:04:232
1639099342,14cyclictest0-21swapper/211:44:302
1639099341,17cyclictest25818-21/usr/sbin/munin10:44:382
16390993410,4cyclictest0-21swapper/212:25:072
28832330,2sleep22923-21switchtime08:04:382
1639199339,9cyclictest7950irq/56-dwc_otg09:19:343
1639199339,9cyclictest7950irq/56-dwc_otg09:19:343
1639199337,17cyclictest0-21swapper/311:40:213
1639199336,7cyclictest8050irq/56-dwc_otg_12:09:413
1639199336,7cyclictest8050irq/56-dwc_otg_12:09:413
1639199335,17cyclictest37-21rcuc/307:44:403
1639199334,18cyclictest39-21ksoftirqd/308:39:363
1639199333,16cyclictest37-21rcuc/309:01:143
1639199331,22cyclictest10496-21ls11:09:123
1639199331,18cyclictest8150irq/56-dwc_otg_08:54:283
1639199331,18cyclictest39-21ksoftirqd/312:40:383
1639099337,7cyclictest7950irq/56-dwc_otg09:49:322
1639099337,7cyclictest7950irq/56-dwc_otg09:49:322
1639099337,14cyclictest8050irq/56-dwc_otg_11:40:392
1639099333,4cyclictest8050irq/56-dwc_otg_12:31:202
1639099332,18cyclictest8050irq/56-dwc_otg_08:54:112
1639099331,13cyclictest8150irq/56-dwc_otg_12:19:302
1639199326,5cyclictest8050irq/56-dwc_otg_12:09:123
1639199324,18cyclictest37-21rcuc/311:37:303
16391993226,4cyclictest39-21ksoftirqd/310:38:333
1639199322,13cyclictest0-21swapper/311:50:473
1639199321,4cyclictest0-21swapper/307:19:243
16391993214,11cyclictest2618-21missed_timers08:04:323
1639199321,3cyclictest8150irq/56-dwc_otg_10:09:253
1639099327,12cyclictest8050irq/56-dwc_otg_10:14:112
1639099324,3cyclictest8150irq/56-dwc_otg_12:14:292
1639099322,8cyclictest8050irq/56-dwc_otg_08:34:112
1639099321,18cyclictest0-21swapper/209:35:332
1639199315,18cyclictest37-21rcuc/309:06:343
16391993124,5cyclictest381ktimersoftd/311:14:263
16391993114,10cyclictest37-21rcuc/311:10:313
1639199311,22cyclictest19427-21timerwakeupswit08:49:393
16391993110,6cyclictest39-21ksoftirqd/307:34:113
1639099317,15cyclictest0-21swapper/211:49:252
1639099311,19cyclictest19137-21timerandwakeup07:19:392
16390993111,12cyclictest30655-21latency_hist07:54:122
1639199307,10cyclictest37-21rcuc/307:26:123
1639199304,21cyclictest24772-21runrttasks10:44:223
16391993014,5cyclictest29925-21fschecks_time10:04:283
16391993010,4cyclictest0-21swapper/311:30:013
1639099309,4cyclictest0-21swapper/209:44:132
1639099308,4cyclictest0-21swapper/210:00:572
1639099301,8cyclictest21640-21idleruntime-cro07:29:112
1639099301,15cyclictest14172-21grep08:34:412
1639099301,14cyclictest0-21swapper/211:55:212
1639199298,5cyclictest8150irq/56-dwc_otg_08:49:113
1639199298,5cyclictest8150irq/56-dwc_otg_08:49:113
1639199297,16cyclictest0-21swapper/308:24:123
1639199295,4cyclictest8050irq/56-dwc_otg_08:34:353
1639099298,4cyclictest0-21swapper/211:33:132
1639099291,17cyclictest0-21swapper/207:59:212
1639099284,12cyclictest8050irq/56-dwc_otg_08:19:442
1639199277,4cyclictest9481-21wget08:24:253
1639199272,12cyclictest8150irq/56-dwc_otg_07:59:323
1639099272,12cyclictest0-21swapper/207:14:252
158852279,11sleep20-21swapper/207:11:112
157832273,14sleep10-21swapper/107:09:561
152712272,15sleep30-21swapper/307:09:463
1639199261,14cyclictest131-21systemd-journal07:18:043
1639099263,13cyclictest0-21swapper/207:33:482
1639099241,13cyclictest22012-21/usr/sbin/munin08:59:292
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional