You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-11-25 - 11:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot6s.osadl.org (updated Thu Aug 29, 2024 00:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
32725911810,5ptp4l241ktimersoftd/100:55:171
383521040,3sleep00-21swapper/003:44:460
128352990,11sleep0111rcuc/000:54:470
326602930,7sleep132656-21grep05:45:061
3272591780,2ptp4l241ktimersoftd/101:24:551
13694997211,29cyclictest874-21diskmemload04:14:210
13694996519,19cyclictest874-21diskmemload05:58:510
13694996418,19cyclictest1179-21apt-get02:59:380
3272591620,1ptp4l241ktimersoftd/106:24:271
3272591620,1ptp4l241ktimersoftd/103:41:281
13694996219,18cyclictest14158-21ssh03:58:410
13694996218,22cyclictest874-21diskmemload05:01:510
13694996116,22cyclictest874-21diskmemload03:31:530
13694996018,15cyclictest19933-21ssh06:14:030
13694996017,19cyclictest30781-21kworker/u4:204:26:500
13694996014,26cyclictest23558-21/usr/sbin/munin06:19:390
13694995918,19cyclictest13501-21ssh05:20:220
13694995918,19cyclictest13501-21ssh05:20:220
13694995918,18cyclictest24172-21ssh04:54:090
13694995917,18cyclictest1707-21ssh05:48:200
13694995915,21cyclictest12693-21apt-get03:14:390
13694995914,24cyclictest15503-21rm04:41:540
13694995834,14cyclictest16761-21apt-get03:19:360
13694995817,19cyclictest19465-21ssh05:29:340
13694995815,18cyclictest19181-21sh04:04:490
13694995726,17cyclictest874-21diskmemload03:39:290
13694995717,14cyclictest7281-21runrttasks01:57:180
13694995715,19cyclictest3353-21kworker/u4:205:13:320
13694995715,19cyclictest15438-21kworker/u4:006:08:300
13694995714,23cyclictest26819-21sh04:55:590
13694995714,18cyclictest5876-21ssh04:29:460
13694995713,22cyclictest8766-21ssh05:14:540
13694995710,28cyclictest316292sleep003:39:180
13694995710,28cyclictest288202sleep002:46:530
3272591560,1ptp4l241ktimersoftd/103:38:291
1369499568,15cyclictest0-21swapper/002:24:320
13694995616,16cyclictest3360-21cat01:49:250
13694995616,16cyclictest20697-21sh03:24:390
13694995615,17cyclictest1774-21seq05:05:340
13694995615,17cyclictest1774-21seq05:05:340
13694995615,17cyclictest11344-21taskset04:36:020
13694995615,17cyclictest10258-21rm03:53:170
13694995615,16cyclictest24003-21if_enp4s005:34:480
13694995614,18cyclictest18310-21taskset01:07:120
13694995614,17cyclictest26392-21cat02:40:000
13694995614,17cyclictest1258-21taskset04:24:190
13694995611,26cyclictest288172sleep001:31:130
13694995520,11cyclictest874-21diskmemload06:02:190
13694995515,16cyclictest30630-21cat02:50:000
13694995514,17cyclictest9804-21bc02:04:350
13694995514,17cyclictest9804-21bc02:04:350
13694995514,17cyclictest19281-21cat01:09:430
13694995514,17cyclictest14740-21if_enp1s002:14:430
13694995514,17cyclictest14740-21if_enp1s002:14:430
13694995514,17cyclictest10919-21sh03:11:030
13694995514,15cyclictest2368-21ssh05:49:320
13694995513,22cyclictest874-21diskmemload05:41:400
13694995513,18cyclictest22351-21taskset01:15:040
13694995511,25cyclictest7032sleep002:57:440
13694995511,25cyclictest310772sleep001:37:540
13694995510,27cyclictest94712sleep002:03:080
13694995510,27cyclictest176932sleep005:26:000
13694995510,26cyclictest50142sleep001:50:400
13694995510,26cyclictest286872sleep004:16:330
3272591540,3ptp4l9034-21kworker/1:006:03:051
3272591540,3ptp4l20747-21kworker/1:205:22:021
3272591540,3ptp4l20747-21kworker/1:205:22:021
13694995434,11cyclictest26815-21apt-get06:24:410
13694995414,16cyclictest31461-21apt-config01:39:250
13694995414,16cyclictest25164-21wc01:24:380
13694995411,24cyclictest244542sleep002:35:240
13694995410,26cyclictest48812sleep003:04:310
13694995410,26cyclictest180812sleep002:22:250
13694995410,25cyclictest226802sleep002:34:010
3272591520,3ptp4l30837-21kworker/1:103:06:461
3272591520,1ptp4l241ktimersoftd/106:05:291
13703995211,8cyclictest25-21ksoftirqd/103:17:591
3272591510,3ptp4l30837-21kworker/1:103:12:391
13694995118,15cyclictest22673-21sh06:17:120
3272591500,3ptp4l9237-21kworker/1:204:06:431
3272591500,1ptp4l241ktimersoftd/106:10:511
3272591500,1ptp4l241ktimersoftd/104:33:421
3272591500,1ptp4l241ktimersoftd/104:26:291
3272591500,1ptp4l241ktimersoftd/104:24:241
3272591500,1ptp4l241ktimersoftd/102:34:061
13694995028,14cyclictest18157-21snmp_o5powerctl04:44:580
3272591490,2ptp4l15815-21kworker/1:201:17:431
3272591490,1ptp4l241ktimersoftd/105:41:521
3272591490,1ptp4l241ktimersoftd/105:38:201
3272591490,1ptp4l241ktimersoftd/104:41:311
3272591490,1ptp4l241ktimersoftd/104:13:381
3272591490,1ptp4l241ktimersoftd/103:51:101
3272591490,1ptp4l241ktimersoftd/103:04:171
1370399496,11cyclictest25-21ksoftirqd/106:14:491
1370399496,11cyclictest25-21ksoftirqd/103:54:441
13694994924,16cyclictest22994-21apt-get01:19:350
3272591480,1ptp4l241ktimersoftd/106:25:101
3272591480,1ptp4l241ktimersoftd/105:25:231
3272591480,1ptp4l241ktimersoftd/105:11:541
3272591480,1ptp4l241ktimersoftd/105:01:541
3272591480,1ptp4l241ktimersoftd/104:56:321
3272591480,1ptp4l241ktimersoftd/104:52:411
3272591480,1ptp4l241ktimersoftd/104:45:111
3272591480,1ptp4l241ktimersoftd/104:15:421
3272591480,1ptp4l241ktimersoftd/103:59:561
3272591480,1ptp4l241ktimersoftd/103:45:531
3272591480,1ptp4l241ktimersoftd/101:54:401
1370399486,11cyclictest25-21ksoftirqd/105:08:021
1370399486,11cyclictest25-21ksoftirqd/105:08:021
1370399486,10cyclictest25-21ksoftirqd/103:20:471
1370399485,11cyclictest25-21ksoftirqd/105:31:311
13694994829,10cyclictest14787-21apt-get03:59:390
3272591470,1ptp4l241ktimersoftd/105:14:291
3272591470,1ptp4l241ktimersoftd/103:28:591
3272591470,1ptp4l241ktimersoftd/102:44:561
3272591470,1ptp4l241ktimersoftd/100:59:451
1370399475,11cyclictest25-21ksoftirqd/105:55:561
249412460,5sleep113692-21cyclictest02:39:251
1370399464,11cyclictest25-21ksoftirqd/102:14:401
1370399464,11cyclictest25-21ksoftirqd/102:14:401
3272591450,1ptp4l241ktimersoftd/101:30:431
1370399456,10cyclictest25-21ksoftirqd/104:35:021
13694994513,18cyclictest15759-21chrt01:04:090
3272591440,1ptp4l241ktimersoftd/103:32:311
3272591440,1ptp4l241ktimersoftd/102:41:051
3272591440,1ptp4l241ktimersoftd/102:09:511
3272591440,1ptp4l241ktimersoftd/101:53:341
3272591440,1ptp4l241ktimersoftd/101:47:041
1370399446,13cyclictest25-21ksoftirqd/101:19:461
1370399443,10cyclictest25-21ksoftirqd/105:49:511
13694994418,21cyclictest12893-21irqstats02:09:460
3272591430,1ptp4l241ktimersoftd/102:24:271
3272591410,1ptp4l241ktimersoftd/102:51:261
3272591410,1ptp4l241ktimersoftd/102:21:561
3272591410,1ptp4l241ktimersoftd/101:39:341
3272591410,1ptp4l241ktimersoftd/101:11:471
3272591400,1ptp4l241ktimersoftd/101:35:141
13703994013,9cyclictest25-21ksoftirqd/102:55:101
3272591380,1ptp4l241ktimersoftd/102:00:511
1370399385,11cyclictest25-21ksoftirqd/102:04:501
1370399385,11cyclictest25-21ksoftirqd/102:04:501
1370399363,16cyclictest25-21ksoftirqd/101:04:341
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional