You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-11-21 - 21:29

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack7slot3s.osadl.org (updated Thu Nov 21, 2024 12:43:38)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2271525130,3sleep20-21swapper/207:09:252
2271525130,3sleep20-21swapper/207:09:252
152302900,5sleep32432399cyclictest12:39:203
152302900,5sleep32432399cyclictest12:39:203
5172840,2sleep20-21swapper/211:38:442
24320998421,5cyclictest22603-21unixbench-2d09:44:370
24320998421,5cyclictest22603-21unixbench-2d09:44:370
24320998319,13cyclictest0-21swapper/010:34:210
101982830,2sleep30-21swapper/309:24:283
6962820,2sleep3381ktimersoftd/310:01:163
283542820,5sleep12432199cyclictest07:24:281
24320998125,5cyclictest8150irq/56-dwc_otg_11:39:400
24320998017,7cyclictest6405-21cut07:54:230
2432099801,27cyclictest24525-21tr12:09:320
2432199773,39cyclictest0-21swapper/112:39:221
2432199773,39cyclictest0-21swapper/112:39:221
24320997623,4cyclictest8050irq/56-dwc_otg_11:09:390
24320997619,4cyclictest24904-21missed_timers10:39:300
2432299741,53cyclictest8639-21apt-get11:04:232
2432299741,51cyclictest19950-21apt-get12:04:222
2432099741,22cyclictest0-21swapper/009:14:350
2432099741,22cyclictest0-21swapper/009:14:350
2432099741,15cyclictest0-21swapper/010:32:500
24320997322,6cyclictest17930-21munin-run09:39:100
24320997320,3cyclictest0-21swapper/007:59:340
24320997320,3cyclictest0-21swapper/007:59:340
24320997317,6cyclictest8050irq/56-dwc_otg_08:34:280
2432099731,24cyclictest2769-21ssh09:14:110
2432299723,62cyclictest0-21swapper/207:14:132
2432299721,50cyclictest8154-21apt-get07:59:222
2432299721,50cyclictest8154-21apt-get07:59:222
2432099712,28cyclictest15370-21cut12:39:230
2432099712,28cyclictest15370-21cut12:39:230
24320997118,4cyclictest8050irq/56-dwc_otg_10:01:010
2432099711,31cyclictest12046-21apt11:54:100
2432099706,5cyclictest22899-21grep08:39:280
2432099701,7cyclictest20052-21aten_rbpower_po12:04:240
24320997016,14cyclictest1292-21runrttasks12:25:510
2432299691,59cyclictest22634-21/usr/sbin/munin08:39:212
2432099698,14cyclictest0-21swapper/011:05:560
2432099695,6cyclictest0-21swapper/007:44:210
2432299681,46cyclictest16329-21ls12:39:362
2432299681,46cyclictest16329-21ls12:39:362
24320996819,14cyclictest15563-21ssh11:58:410
24320996816,48cyclictest0-21swapper/010:25:440
2432299671,43cyclictest18346-21ssh12:01:332
24320996728,14cyclictest26488-21ssh11:29:200
2432099671,5cyclictest8364-21latency_hist11:04:100
24320996711,15cyclictest0-21swapper/010:09:370
2432299661,53cyclictest29648-21ssh11:34:042
2432299661,51cyclictest29449-21sshd08:55:472
2432299661,43cyclictest26302-21ssh12:12:072
2432299651,51cyclictest18252-21ssh11:17:252
24321996525,25cyclictest16234-21ssh10:25:541
24321996524,20cyclictest30556-21ssh12:17:521
24321996522,18cyclictest1377-21awk11:39:291
24321996520,23cyclictest24763-21sh11:25:511
24320996511,13cyclictest0-21swapper/009:28:160
2432299641,47cyclictest10654-21ntp_states08:04:362
2432299641,41cyclictest1625-21ssh11:39:322
24321996426,19cyclictest11376-21chrt08:07:311
24321996422,26cyclictest15002-21chrt08:17:491
2432099642,24cyclictest0-21swapper/010:14:430
24320996414,11cyclictest0-21swapper/008:53:170
2432099641,26cyclictest0-21swapper/011:17:160
2432299631,50cyclictest8304-21ssh11:04:082
2432299631,50cyclictest30104-21ssh10:48:002
2432299631,49cyclictest13203-21sshd08:12:472
2432299631,42cyclictest16909-21ssh09:36:362
24320996319,4cyclictest13574-21runrttasks09:30:540
2432099631,6cyclictest131-21systemd-journal10:57:590
2432099631,14cyclictest0-21swapper/007:52:210
2432099631,13cyclictest29172-21ssh12:15:070
24320996311,16cyclictest0-21swapper/010:20:150
24320996311,16cyclictest0-21swapper/010:20:150
2432399621,26cyclictest0-21swapper/307:44:233
2432299624,42cyclictest8150irq/56-dwc_otg_09:47:372
2432299624,42cyclictest8150irq/56-dwc_otg_09:47:372
24321996238,18cyclictest0-21swapper/107:14:131
24321996227,14cyclictest21681-21df_inode09:44:251
24321996227,14cyclictest21681-21df_inode09:44:251
2432099629,12cyclictest0-21swapper/009:39:310
2432099626,3cyclictest8050irq/56-dwc_otg_12:04:100
2432099626,14cyclictest3842-21taskset10:06:000
24320996233,6cyclictest28031-21fschecks_time10:44:290
24320996219,28cyclictest0-21swapper/007:14:130
2432299611,50cyclictest10501-21ssh10:17:432
2432299611,44cyclictest6356-21ssh12:28:222
2432299611,43cyclictest7391-21ls07:54:372
24321996126,19cyclictest27269-21ssh09:52:341
24321996123,17cyclictest6222-21chrt11:44:551
24321996122,15cyclictest2072-21ssh12:22:551
24321996119,21cyclictest8150irq/56-dwc_otg_11:34:281
24320996113,10cyclictest1965-21ssh12:22:430
2432099611,20cyclictest466-21rs:main0
2432299602,45cyclictest0-21swapper/210:08:072
2432299601,45cyclictest18235-21ssh09:39:232
2432299601,42cyclictest24521-21diskstats10:39:262
24321996024,23cyclictest17210-21ssh11:14:571
24321996022,26cyclictest23106-21sh10:36:561
24321996022,19cyclictest8050irq/56-dwc_otg_08:39:251
24320996036,4cyclictest28202-21runrttasks09:54:240
2432299591,45cyclictest14555-21sh11:12:152
2432299591,42cyclictest11676-21ssh11:53:242
24321995925,20cyclictest11682-21ssh11:53:251
24321995924,18cyclictest20844-21latency_hist10:34:101
24321995924,17cyclictest9221-21ssh12:31:071
24321995919,20cyclictest8997-21/usr/sbin/munin10:14:361
2432299581,48cyclictest741-21ssh12:20:272
2432299581,46cyclictest32536-21ssh10:50:422
2432299581,44cyclictest2703-21diskmemload11:44:572
2432299581,40cyclictest9216-21ssh12:31:072
2432299581,38cyclictest26385-21ssh09:50:172
2432299581,29cyclictest13322-21ssh10:21:392
2432299581,29cyclictest13322-21ssh10:21:392
24321995823,20cyclictest13845-21ssh10:23:091
24321995823,20cyclictest13845-21ssh10:23:091
24321995823,15cyclictest12730-21ssh11:09:321
24321995822,16cyclictest6104-21latency_hist07:54:111
2432099582,53cyclictest0-21swapper/007:34:100
2432399573,40cyclictest0-21swapper/307:14:133
2432299571,39cyclictest7950irq/56-dwc_otg10:58:402
24321995728,12cyclictest1692-21ssh10:03:561
24321995726,16cyclictest32547-21ssh10:50:431
24321995725,18cyclictest26684-21ssh10:42:281
24321995725,17cyclictest26455-21ssh12:12:251
24321995723,17cyclictest18208-21ssh09:39:201
24322995616,30cyclictest17878-1kworker/u9:210:38:352
2432299561,44cyclictest14800-21taskset08:15:122
2432299561,40cyclictest4552-21apt-get07:49:212
2432299561,31cyclictest0-21swapper/209:09:212
24321995626,9cyclictest6973-21ls07:54:311
24321995622,12cyclictest3255-21ssh09:14:251
24321995622,12cyclictest3255-21ssh09:14:251
24320995628,11cyclictest8150irq/56-dwc_otg_12:29:400
2432299554,40cyclictest8050irq/56-dwc_otg_11:25:582
2432299551,44cyclictest0-21swapper/212:15:122
2432299551,43cyclictest14610-21ssh09:33:562
2432299551,38cyclictest20827-21/usr/sbin/munin08:34:202
2432299551,35cyclictest16127-21ssh10:25:342
24321995527,12cyclictest8154-21apt-get07:59:211
24321995527,12cyclictest8154-21apt-get07:59:211
24321995523,14cyclictest11384-21ssh09:25:181
24321995520,16cyclictest21717-21ssh12:05:361
24321995520,13cyclictest5035-21latency_hist10:09:101
24321995519,13cyclictest14170-21ssh11:55:461
24321995513,31cyclictest16795-21sh09:36:161
2432099551,40cyclictest26133-21/usr/sbin/munin07:19:230
2432099551,34cyclictest11209-21/usr/sbin/munin12:34:320
282482540,4sleep228239-21aten_rbpower_cu09:54:302
2432299541,42cyclictest561-21ssh10:00:532
2432299541,37cyclictest20796-21ssh11:20:032
24321995425,12cyclictest30593-21ssh09:58:051
24321995424,15cyclictest9041-21sh09:22:361
24321995420,25cyclictest19279-21ssh12:03:301
24321995419,17cyclictest5359-21/usr/sbin/munin10:09:241
2432099543,20cyclictest0-21swapper/008:19:230
24320995419,20cyclictest0-21swapper/007:24:300
2432299531,48cyclictest27960-21apt-get07:24:232
2432299531,41cyclictest2703-21diskmemload12:36:532
2432299531,41cyclictest26425-21cat08:49:242
2432299531,38cyclictest2703-21diskmemload11:58:332
2432299531,38cyclictest0-21swapper/209:19:552
2432299531,32cyclictest3510-21ssh09:14:282
2432299531,32cyclictest3510-21ssh09:14:282
24321995322,16cyclictest2480-21taskset09:11:401
24321995322,12cyclictest13692-21ssh12:36:521
24321995317,20cyclictest3939-21ps12:24:371
24321995316,21cyclictest2703-21diskmemload11:20:421
2432299521,40cyclictest854-21chrt09:09:022
2432299521,36cyclictest5253-21apt-get10:09:232
24321995222,13cyclictest10663-21ssh11:06:231
24321995219,12cyclictest27695-21taskset08:52:461
24321995216,10cyclictest8150irq/56-dwc_otg_10:44:301
24320995227,5cyclictest0-21swapper/011:44:330
24320995224,6cyclictest30053-21wget08:59:230
2432099521,30cyclictest26017-21apt08:49:100
2432299518,28cyclictest4310-21apt07:49:102
2432299511,47cyclictest32220-21/usr/sbin/munin07:34:312
2432299511,47cyclictest30481-21/usr/sbin/munin08:59:292
2432299511,47cyclictest1776-21switchtime07:39:352
2432299511,47cyclictest16867-21sshd08:22:472
2432299511,46cyclictest17438-21/usr/sbin/munin08:24:292
24321995124,13cyclictest31280-21sshd07:33:471
24321995119,10cyclictest8150irq/56-dwc_otg_10:58:431
24321995115,9cyclictest0-21swapper/109:31:141
2432399509,25cyclictest9100-21/usr/sbin/munin11:04:293
2432299501,46cyclictest29749-21munin-node07:29:202
2432299501,40cyclictest12516-21ssh09:28:272
2432299501,36cyclictest19666-21ssh10:31:252
24321995022,13cyclictest27662-21chrt07:23:391
24321995016,15cyclictest29656-21taskset08:58:261
2432399495,19cyclictest8150irq/56-dwc_otg_10:09:323
2432299491,45cyclictest26147-21apt-get07:19:212
2432299491,35cyclictest25887-21runrttasks08:47:452
24321994920,17cyclictest6767-21ssh11:00:311
24321994917,11cyclictest8150irq/56-dwc_otg_09:09:041
24321994917,10cyclictest8150irq/56-dwc_otg_11:31:251
2432099493,26cyclictest30956-21wget10:49:240
24320994927,5cyclictest6816-21cut09:19:300
2432099491,27cyclictest28832-21tr08:54:320
2432099491,27cyclictest11796-21grep08:09:250
2432399487,27cyclictest19970-21ssh12:04:233
24323994819,8cyclictest20839-21apt-get08:34:213
2432299481,44cyclictest19597-21/usr/sbin/munin08:29:302
24321994822,7cyclictest20839-21apt-get08:34:221
24321994816,8cyclictest0-21swapper/107:43:551
2432099481,29cyclictest0-21swapper/011:19:280
24321994733,11cyclictest19045-21apt-get08:29:211
24321994724,16cyclictest16660-21taskset08:20:521
24321994721,16cyclictest13201-21chrt08:12:461
24321994718,13cyclictest4280-21chrt07:48:591
24321994716,10cyclictest0-21swapper/107:36:281
2432099472,24cyclictest0-21swapper/007:34:400
24320994714,10cyclictest0-21swapper/008:29:230
2432099461,30cyclictest26002-21ssh11:28:470
24323994516,19cyclictest9139-21timerandwakeup10:14:373
24321994517,12cyclictest25651-21chrt08:44:421
24321994515,10cyclictest0-21swapper/109:00:531
2432399447,25cyclictest0-21swapper/311:19:243
2432399447,24cyclictest0-21swapper/308:14:243
2432399442,25cyclictest8150irq/56-dwc_otg_09:30:563
24323994417,13cyclictest8150irq/56-dwc_otg_10:09:113
2432399437,23cyclictest0-21swapper/310:19:283
2432399437,23cyclictest0-21swapper/310:19:283
2432399436,21cyclictest8150irq/56-dwc_otg_11:34:283
24321994328,12cyclictest18140-21ls08:24:401
2379424324,13sleep00-21swapper/007:10:540
2379424324,13sleep00-21swapper/007:10:540
2432399428,16cyclictest22193-21/usr/sbin/munin09:44:323
2432399428,16cyclictest22193-21/usr/sbin/munin09:44:323
2432399427,23cyclictest0-21swapper/311:29:223
2432399427,23cyclictest0-21swapper/310:39:223
2432399426,22cyclictest15745-21ssh11:14:163
24323994215,11cyclictest8150irq/56-dwc_otg_11:09:353
2432099427,18cyclictest9-21ksoftirqd/008:14:290
24320994218,5cyclictest30296-21fschecks_count11:34:280
24320994218,4cyclictest17292-21aten_rbpower_en08:24:280
2432399416,11cyclictest8050irq/56-dwc_otg_08:04:423
2432399415,26cyclictest0-21swapper/307:19:363
24323994128,4cyclictest8150irq/56-dwc_otg_08:39:273
24323994111,17cyclictest8347-21/usr/sbin/munin07:59:243
24323994111,17cyclictest8347-21/usr/sbin/munin07:59:243
24320994125,4cyclictest8050irq/56-dwc_otg_07:39:200
2432099411,9cyclictest11082-21grep08:04:420
24320994117,12cyclictest0-21swapper/009:06:570
2432399406,25cyclictest0-21swapper/310:34:233
2432399404,6cyclictest8150irq/56-dwc_otg_09:19:223
2432399402,5cyclictest8150irq/56-dwc_otg_11:49:243
2432399402,20cyclictest8150irq/56-dwc_otg_07:49:263
24323994013,16cyclictest381ktimersoftd/309:52:463
2432399401,25cyclictest0-21swapper/309:34:213
24323994011,17cyclictest1369-21/usr/sbin/munin11:39:293
2432399391,28cyclictest31733-21ls07:34:243
227062395,22sleep10-21swapper/107:09:251
227062395,22sleep10-21swapper/107:09:251
2432399386,18cyclictest8150irq/56-dwc_otg_12:12:133
24323993814,11cyclictest29190-21ssh12:15:093
2432399381,22cyclictest8150irq/56-dwc_otg_11:04:103
24323993812,11cyclictest3398-21/usr/sbin/munin09:14:273
24323993812,11cyclictest3398-21/usr/sbin/munin09:14:273
2432399379,17cyclictest381ktimersoftd/312:01:403
2432399377,25cyclictest0-21swapper/307:39:223
2432399377,17cyclictest29452-21chrt07:28:283
2432399376,11cyclictest989-21ssh10:53:103
2432399375,22cyclictest12243-21ls12:34:443
2432399375,15cyclictest8150irq/56-dwc_otg_11:56:143
2432399374,18cyclictest8150irq/56-dwc_otg_09:39:263
24323993716,5cyclictest8150irq/56-dwc_otg_07:54:373
2432399371,26cyclictest0-21swapper/309:09:533
24323993712,13cyclictest3690-21ssh10:56:093
24323993711,15cyclictest16136-21ssh10:25:373
2432399369,3cyclictest0-21swapper/310:48:023
24323993617,4cyclictest7950irq/56-dwc_otg12:28:253
2432399360,20cyclictest8150irq/56-dwc_otg_11:25:573
2432399354,19cyclictest27315-21kworker/u8:012:23:033
2432399354,11cyclictest8150irq/56-dwc_otg_07:33:553
2432399354,10cyclictest0-21swapper/310:33:533
24323993515,4cyclictest28937-21ntp_kernel_pll_09:54:413
24323993513,8cyclictest381ktimersoftd/312:31:313
2432399345,18cyclictest645-21runrttasks09:06:183
24323993410,14cyclictest6250-21ssh11:44:583
2432399336,17cyclictest0-21swapper/308:54:243
2432399332,19cyclictest27735-21taskset08:53:173
2432399325,16cyclictest18529-21seq08:25:573
2432399322,22cyclictest8050irq/56-dwc_otg_08:09:393
2432399317,16cyclictest16926-21taskset08:23:353
2432399301,15cyclictest25660-21chrt08:44:483
2432399301,15cyclictest0-21swapper/308:32:093
225352295,14sleep322612-21tr07:09:233
225352295,14sleep322612-21tr07:09:233
2432399281,15cyclictest0-21swapper/308:59:233
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional