OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails

Click here to display the system's profile data.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot7s.osadl.org (updated Thu Apr 03, 2025 00:44:17)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1324108	99	3848	20,3823	cyclictest	1417308	-21	kworker/2:0+events	00:35:00	2
1324108	99	2667	12,2650	cyclictest	1359305	-21	kworker/2:1+events	21:10:15	2
1324101	99	2640	13,2623	cyclictest	1373494	-21	kworker/0:2+events	22:00:18	0
1324101	99	2570	12,2554	cyclictest	1389199	-21	kworker/0:2+events	22:43:24	0
1324111	99	2543	8,2530	cyclictest	1417188	-21	kworker/3:2+events	00:35:22	3
1324108	99	2502	12,2486	cyclictest	1408300	-21	kworker/2:0+events	00:00:20	2
1324101	99	2495	12,2480	cyclictest	1351349	-21	kworker/0:2+events	20:38:16	0
1324111	99	2494	12,2479	cyclictest	1384077	-21	kworker/3:2+events	22:41:33	3
1324111	99	2490	12,2475	cyclictest	1338842	-21	kworker/3:1+events	20:03:08	3
1324111	99	2490	12,2474	cyclictest	1346602	-21	kworker/3:2+events	21:22:45	3
1324111	99	2487	12,2471	cyclictest	1371072	-21	kworker/3:0+events	21:51:59	3
1324108	99	2486	12,2470	cyclictest	1340171	-21	kworker/2:2+events	20:21:08	2
1324111	99	2480	9,2469	cyclictest	1378313	-21	kworker/3:2+events	22:10:11	3
1324111	99	2463	12,2448	cyclictest	1390191	-21	kworker/3:2+events	23:00:19	3
1324106	99	2446	12,2430	cyclictest	1398763	-21	kworker/1:1+events	23:21:00	1
1324111	99	2426	8,2415	cyclictest	1346602	-21	kworker/3:2+events	21:30:17	3
1324111	99	2412	12,2396	cyclictest	1360865	-21	kworker/3:1+events	21:05:18	3
1324106	99	2404	10,2391	cyclictest	1337274	-21	kworker/1:0+events	19:50:16	1
1324108	99	2401	12,2385	cyclictest	1330012	-21	kworker/2:0+events	19:45:18	2
1324106	99	2387	12,2372	cyclictest	1395652	-21	kworker/1:2+events	23:31:37	1
1324111	99	2369	12,2354	cyclictest	1406431	-21	kworker/3:2+events	23:52:25	3
1324106	99	2329	12,2314	cyclictest	1379042	-21	kworker/1:2+events	22:35:50	1
1324111	99	2302	11,2287	cyclictest	1394978	-21	kworker/3:1+events	23:22:08	3
1324111	99	2286	11,2272	cyclictest	1394978	-21	kworker/3:1+events	23:25:55	3
1324108	99	2278	10,2264	cyclictest	1398663	-21	kworker/2:0+events	23:20:15	2
1324101	99	2274	11,2259	cyclictest	1331634	-21	kworker/0:2+events	19:34:16	0
1324111	99	2273	11,2258	cyclictest	1346602	-21	kworker/3:2+events	20:33:17	3
1324101	99	2273	11,2259	cyclictest	1343573	-21	kworker/0:1+events	20:14:10	0
1324101	99	2273	11,2259	cyclictest	1343573	-21	kworker/0:1+events	20:14:10	0
1324111	99	2272	11,2258	cyclictest	1390191	-21	kworker/3:2+events	22:54:12	3
1324101	99	2272	11,2258	cyclictest	1365696	-21	kworker/0:1+events	21:25:25	0
1324101	99	2272	11,2257	cyclictest	1340261	-21	kworker/0:2+events	20:22:42	0
1324101	99	2271	11,2257	cyclictest	1385623	-21	kworker/0:2+events	22:31:38	0
1324108	99	2270	10,2258	cyclictest	1406001	-21	kworker/2:2+events	23:50:10	2
1324101	99	2270	10,2256	cyclictest	1359119	-21	kworker/0:2+events	21:01:52	0
1324111	99	2268	11,2253	cyclictest	1357606	-21	kworker/3:0+events	20:58:48	3
1324111	99	2268	11,2253	cyclictest	1346602	-21	kworker/3:2+events	20:49:14	3
1324101	99	2268	10,2254	cyclictest	1411706	-21	kworker/0:0+events	00:27:47	0
1324111	99	2267	10,2254	cyclictest	1379043	-21	kworker/3:0+events	22:15:13	3
1324111	99	2265	11,2251	cyclictest	1346602	-21	kworker/3:2+events	20:23:04	3
1324101	99	2265	10,2252	cyclictest	1380340	-21	kworker/0:2+events	22:14:26	0
1324111	99	2264	11,2249	cyclictest	1364046	-21	kworker/3:0+events	21:14:48	3
1324111	99	2262	8,2250	cyclictest	1394978	-21	kworker/3:1+events	23:11:33	3
1324111	99	2262	10,2249	cyclictest	1390191	-21	kworker/3:2+events	22:58:20	3
1324111	99	2262	10,2249	cyclictest	1353001	-21	kworker/3:0+events	20:41:41	3
1324101	99	2262	9,2249	cyclictest	1327517	-21	kworker/0:0+events	19:46:51	0
1324111	99	2261	11,2247	cyclictest	1349822	-21	kworker/3:1+events	20:37:55	3
1324101	99	2261	10,2248	cyclictest	1369205	-21	kworker/0:0+events	21:32:12	0
1324101	99	2261	10,2248	cyclictest	1351349	-21	kworker/0:2+events	20:46:13	0
1324111	99	2260	10,2248	cyclictest	1387590	-21	kworker/3:1+events	22:48:48	3
1324108	99	2260	8,2248	cyclictest	1394813	-21	kworker/2:2+events	23:05:14	2
1324111	99	2258	11,2244	cyclictest	1390191	-21	kworker/3:2+events	23:06:42	3
1324101	99	2258	10,2245	cyclictest	1340261	-21	kworker/0:2+events	19:58:11	0
1324111	99	2257	11,2243	cyclictest	1330506	-21	kworker/3:2+events	19:44:13	3
1324111	99	2256	11,2241	cyclictest	1383036	-21	kworker/3:1+events	22:28:33	3
1324111	99	2256	10,2242	cyclictest	1343307	-21	kworker/3:0+events	20:13:00	3
1324111	99	2256	10,2242	cyclictest	1343307	-21	kworker/3:0+events	20:13:00	3
1324101	99	2256	11,2242	cyclictest	1411706	-21	kworker/0:0+events	00:34:38	0
1324101	99	2255	11,2241	cyclictest	1389199	-21	kworker/0:2+events	22:55:42	0
1324111	99	2254	10,2241	cyclictest	1394978	-21	kworker/3:1+events	23:44:53	3
1324108	99	2254	11,2241	cyclictest	1391552	-21	kworker/2:1+events	23:00:42	2
1324108	99	2254	10,2241	cyclictest	1352774	-21	kworker/2:2+events	20:47:19	2
1324111	99	2253	11,2239	cyclictest	1417188	-21	kworker/3:2+events	00:28:33	3
1324101	99	2253	11,2238	cyclictest	1341973	-21	kworker/0:0+events	20:07:44	0
1324111	99	2252	11,2238	cyclictest	1335678	-21	kworker/3:0+events	19:55:55	3
1324108	99	2250	10,2237	cyclictest	1366019	-21	kworker/2:0+events	21:38:41	2
1324111	99	2247	10,2234	cyclictest	1319152	-21	kworker/3:0+events	19:25:15	3
1324101	99	2247	11,2233	cyclictest	1398493	-21	kworker/0:1+events	23:19:53	0
1324101	99	2244	8,2233	cyclictest	1359119	-21	kworker/0:2+events	21:07:11	0
1324101	99	2241	9,2230	cyclictest	1365696	-21	kworker/0:1+events	21:20:30	0
1324101	99	2238	10,2225	cyclictest	1378732	-21	kworker/0:0+events	22:07:52	0
1324108	99	2233	7,2223	cyclictest	1350009	-21	kworker/2:0+events	20:34:05	2
1324101	99	2223	9,2210	cyclictest	1373494	-21	kworker/0:2+events	21:54:38	0
1324101	99	2222	10,2208	cyclictest	1375157	-21	kworker/0:1+events	21:59:35	0
1324111	99	2219	9,2207	cyclictest	1394978	-21	kworker/3:1+events	23:31:58	3
1324108	99	2217	11,2203	cyclictest	1340171	-21	kworker/2:2+events	20:28:43	2
1324101	99	2216	10,2202	cyclictest	1413341	-21	kworker/0:1+events	00:13:46	0
1324106	99	2210	11,2195	cyclictest	1372959	-21	kworker/1:0+events	22:05:58	1
1324108	99	2209	10,2196	cyclictest	1389934	-21	kworker/2:2+events	22:55:18	2
1324101	99	2208	4,2201	cyclictest	1371102	-21	kworker/0:1+events	21:41:19	0
1324101	99	2208	10,2195	cyclictest	1389199	-21	kworker/0:2+events	23:45:15	0
1324108	99	2206	7,2196	cyclictest	1323828	-21	kworker/2:1+events	19:24:29	2
1324106	99	2201	11,2187	cyclictest	1415300	-21	kworker/1:0+events	00:29:42	1
1324108	99	2199	8,2188	cyclictest	1380459	-21	kworker/2:1+events	22:42:18	2
1324108	99	2199	10,2185	cyclictest	1373360	-21	kworker/2:0+events	22:02:31	2
1324101	99	2199	10,2186	cyclictest	1389199	-21	kworker/0:2+events	22:46:53	0
1324108	99	2196	10,2183	cyclictest	1360945	-21	kworker/2:0+events	21:05:40	2
1324111	99	2194	11,2179	cyclictest	1394978	-21	kworker/3:1+events	23:16:50	3
1324101	99	2192	9,2179	cyclictest	1382004	-21	kworker/0:1+events	22:19:02	0
1324101	99	2188	10,2174	cyclictest	1349710	-21	kworker/0:1+events	20:29:07	0
1324101	99	2187	10,2174	cyclictest	1387547	-21	kworker/0:1+events	22:50:45	0
1324106	99	2182	9,2170	cyclictest	1341827	-21	kworker/1:2+events	20:08:29	1
1324106	99	2182	11,2167	cyclictest	1379042	-21	kworker/1:2+events	22:33:09	1
1324106	99	2180	10,2167	cyclictest	1376578	-21	kworker/1:2+events	21:58:26	1
1324106	99	2180	10,2167	cyclictest	1332081	-21	kworker/1:0+events	19:41:30	1
1324106	99	2178	11,2164	cyclictest	1332081	-21	kworker/1:0+events	19:32:25	1
1324106	99	2178	10,2165	cyclictest	1418911	-21	kworker/1:1+events	00:37:41	1
1324111	99	2177	9,2165	cyclictest	1411292	-21	kworker/3:0+events	00:03:50	3
1324111	99	2177	8,2166	cyclictest	1394978	-21	kworker/3:1+events	23:35:47	3
1324106	99	2177	11,2162	cyclictest	1381888	-21	kworker/1:0+events	22:21:39	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-07-29 - 23:00