OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 792 highest latencies:

System rack7slot2.osadl.org (updated Sat Nov 23, 2024 12:44:08)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2178723	99	103	95,6	cyclictest	2296680	-21	kworker/u4:3+events_unbound	11:31:18	1
2178722	99	79	32,44	cyclictest	2204677	-21	fschecks_count	08:50:20	0
2178723	99	76	36,9	cyclictest	2356754	-21	grep	12:30:02	1
2178722	99	76	42,31	cyclictest	2267142	-21	systemd	10:36:05	0
2178723	99	74	33,8	cyclictest	2236376	-21	netstat	09:50:28	1
2178722	99	74	68,4	cyclictest	2224256	-21	kworker/u4:9+events_unbound	09:40:59	0
2178722	99	74	68,4	cyclictest	2224256	-21	kworker/u4:9+events_unbound	09:40:58	0
2178722	99	73	33,7	cyclictest	0	-21	swapper/0	07:55:29	0
2178723	99	72	36,4	cyclictest	0	-21	swapper/1	11:45:30	1
2178722	99	72	38,5	cyclictest	2305806	-21	aten_r7power_vo	11:30:13	0
2178722	99	72	37,6	cyclictest	2291981	-21	diskmemload	11:10:42	0
2178722	99	72	32,38	cyclictest	2213880	-21	mailstats	09:15:37	0
2178723	99	71	35,33	cyclictest	2240401	-21	unixbench_multi	09:55:39	1
2178722	99	71	32,9	cyclictest	2206017	-21	fschecks_time	08:55:19	0
2178722	99	71	32,8	cyclictest	2219719	-21	cut	09:25:20	0
2178722	99	70	36,6	cyclictest	2357025	-21	grep	12:30:19	0
2178722	99	69	34,8	cyclictest	2276344	-21	ntp_kernel_pll_	10:50:28	0
2178723	99	68	38,5	cyclictest	2287156	-21	wc	11:05:17	1
2178722	99	68	35,31	cyclictest	2196521	-21	kworker/u4:6-rpciod	08:36:40	0
2178722	99	68	33,4	cyclictest	0	-21	swapper/0	10:40:28	0
2178723	99	67	60,5	cyclictest	2308093	-21	kworker/u4:8+events_unbound	11:56:21	1
2178723	99	67	30,6	cyclictest	2258900	-21	cron	10:24:59	1
2178722	99	67	28,10	cyclictest	2233605	-21	sort	09:45:43	0
2178722	99	66	56,6	cyclictest	2178720	-21	cyclictest	12:27:45	0
2178722	99	66	31,5	cyclictest	0	-21	swapper/0	08:15:27	0
2178723	99	65	57,6	cyclictest	2250630	-21	kworker/u4:10+events_unbound	10:20:02	1
2178722	99	65	49,14	cyclictest	2337952	-21	kworker/u4:0+events_unbound	12:36:29	0
2178723	99	64	55,6	cyclictest	2237800	-21	kworker/u4:12+events_unbound	10:11:03	1
2178723	99	64	35,4	cyclictest	0	-21	swapper/1	07:25:23	1
2178723	99	64	30,6	cyclictest	2318452	-21	latency_hist	11:45:01	1
2178722	99	63	42,15	cyclictest	0	-21	swapper/0	11:00:33	0
2178722	99	63	29,6	cyclictest	2178869	-21	apt-key	07:10:02	0
2178723	99	61	52,7	cyclictest	2178654	-21	kworker/u4:2+events_unbound	07:10:22	1
2178723	99	61	51,7	cyclictest	2178658	-21	kworker/u4:8+events_unbound	08:10:30	1
2178722	99	59	51,6	cyclictest	2227674	-21	kworker/u4:2+events_unbound	10:01:02	0
2178723	99	57	48,7	cyclictest	395	-21	systemd-logind	11:11:12	1
2178723	99	57	47,8	cyclictest	0	-21	swapper/1	10:40:12	1
2178722	99	57	37,17	cyclictest	2246023	-21	fschecks_time	10:05:21	0
2178723	99	56	48,6	cyclictest	2195259	-21	kworker/u4:1+events_unbound	08:25:01	1
2178723	99	55	47,5	cyclictest	2314117	-21	latency_hist	11:40:02	1
2178722	99	55	47,6	cyclictest	2204246	-21	kworker/u4:8+events_unbound	09:05:48	0
2178722	99	55	37,16	cyclictest	2184275	-21	fschecks_count	07:30:21	0
2178723	99	54	45,6	cyclictest	2187662	-21	kworker/u4:17+events_unbound	07:55:28	1
2178722	99	54	32,19	cyclictest	2188089	-21	fschecks_count	07:45:20	0
2178723	99	53	45,5	cyclictest	2292788	-21	kworker/u4:2+events_unbound	11:16:16	1
2178722	99	53	45,6	cyclictest	2308093	-21	kworker/u4:8+events_unbound	11:41:18	0
2178722	99	53	44,7	cyclictest	2328897	-21	sshd	11:56:19	0
2178722	99	52	37,9	cyclictest	2195275	-21	modprobe	08:15:01	0
2178722	99	52	29,21	cyclictest	2348915	-21	gltestperf	12:20:22	0
2178723	99	51	46,3	cyclictest	2204244	-21	kworker/u4:4+events_unbound	08:50:44	1
2178723	99	51	42,7	cyclictest	2178657	-21	kworker/u4:7+events_unbound	08:00:30	1
2178723	99	51	40,8	cyclictest	2280544	-21	unixbench-2d	10:55:39	1
2178722	99	51	44,5	cyclictest	2323003	-21	aten2__	11:50:20	0
2178722	99	51	43,6	cyclictest	2166229	-21	kworker/u4:1+events_unbound	07:40:26	0
2178722	99	51	42,6	cyclictest	2292787	-21	kworker/u4:1+events_unbound	11:21:15	0
2178722	99	51	31,17	cyclictest	0	-21	swapper/0	09:20:27	0
2178722	99	51	29,19	cyclictest	2203433	-21	fschecks_count	08:45:17	0
2178723	99	50	43,5	cyclictest	2210402	-21	sshd	09:10:37	1
2178723	99	50	43,5	cyclictest	2204248	-21	kworker/u4:10+events_unbound	09:20:54	1
2178723	99	50	43,5	cyclictest	2202708	-21	switchtime	08:40:36	1
2178723	99	50	43,5	cyclictest	2178655	-21	kworker/u4:3+events_unbound	07:20:00	1
2178723	99	50	41,6	cyclictest	0	-21	swapper/1	12:20:14	1
2178722	99	50	42,5	cyclictest	0	-21	swapper/0	11:45:39	0
2178722	99	50	41,7	cyclictest	379	-21	dbus-daemon	11:26:15	0
2178722	99	50	40,8	cyclictest	2179088	-21	aten_r7power_vo	07:10:20	0
2178722	99	50	38,9	cyclictest	2180227	-21	aten2__	07:15:15	0
2178723	99	49	43,4	cyclictest	2246594	-21	sendmail_mailqu	10:05:39	1
2178723	99	49	39,8	cyclictest	2336330	-21	netstat	12:05:25	1
2178722	99	49	42,5	cyclictest	2336685	-21	/usr/sbin/munin	12:05:39	0
2178722	99	49	41,5	cyclictest	2262847	-21	fschecks_time	10:30:23	0
2178722	99	49	41,5	cyclictest	0	-21	swapper/0	12:15:13	0
2178722	99	49	40,7	cyclictest	2288520	-21	sshd	11:06:12	0
2178723	99	48	41,5	cyclictest	2233437	-21	sendmail_mailqu	09:45:42	1
2178723	99	48	37,9	cyclictest	2345206	-21	sendmail_mailtr	12:15:39	1
2178722	99	48	38,7	cyclictest	2203034	-21	grep	08:45:01	0
2178722	99	48	28,18	cyclictest	2331536	-21	aten_r7power_cu	12:00:18	0
2178723	99	47	40,5	cyclictest	2260221	-21	grep	10:25:39	1
2178723	99	47	40,5	cyclictest	2206519	-21	switchtime	08:55:35	1
2178723	99	47	39,6	cyclictest	2245560	-21	latency_hist	10:05:02	1
2178723	99	47	39,6	cyclictest	2193661	-21	sendmail_mailqu	08:05:35	1
2178723	99	47	39,5	cyclictest	2273290	-21	unixbench_singl	10:45:41	1
2178723	99	47	39,5	cyclictest	2195685	-21	fschecks_count	08:15:22	1
2178722	99	47	40,4	cyclictest	0	-21	swapper/0	09:00:38	0
2178722	99	47	39,6	cyclictest	2237801	-21	kworker/u4:13+events_unbound	10:26:06	0
2178722	99	47	39,5	cyclictest	2199223	-21	wc	08:30:02	0
2178722	99	47	39,5	cyclictest	2178720	-21	cyclictest	11:40:00	0
2178722	99	47	37,7	cyclictest	2240348	-21	unixbench-2d	09:55:40	0
2178722	99	47	28,17	cyclictest	0	-21	swapper/0	09:35:10	0
2178723	99	46	40,4	cyclictest	0	-21	swapper/1	07:35:25	1
2178723	99	46	39,5	cyclictest	2332122	-21	ld	12:00:26	1
2178723	99	46	37,6	cyclictest	2182601	-21	modprobe	07:25:00	1
2178723	99	46	37,6	cyclictest	2182587	-21	kworker/u4:13+events_unbound	07:30:26	1
2178722	99	46	40,4	cyclictest	2249159	-21	df_abs	10:10:22	0
2178722	99	46	38,5	cyclictest	2193621	-21	grep	08:05:34	0
2178722	99	46	37,6	cyclictest	2236158	-21	fschecks_time	09:50:25	0
2178723	99	45	38,5	cyclictest	2323136	-21	aten_r7power_vo	11:50:22	1
2178723	99	45	38,5	cyclictest	2267637	-21	kworker/u4:2-rpciod	10:50:32	1
2178723	99	45	34,9	cyclictest	37	-21	kcompactd0	11:00:19	1
2178722	99	45	35,7	cyclictest	2222863	-21	gltestperf	09:30:28	0
2178723	99	44	38,4	cyclictest	2362435	-21	sed	12:35:42	1
2178723	99	44	37,4	cyclictest	0	-21	swapper/1	09:25:39	1
2178723	99	44	34,8	cyclictest	2305374	-21	ssh	11:30:00	1
2178723	99	44	34,7	cyclictest	2178748	-21	latency_hist	07:10:01	1
2178723	99	44	33,9	cyclictest	2226969	-21	grep	09:35:39	1
2178722	99	44	37,5	cyclictest	2181770	-21	fschecks_count	07:20:20	0
2178722	99	44	36,6	cyclictest	2275486	-21	latency_hist	10:50:01	0
2178722	99	44	34,6	cyclictest	0	-21	swapper/0	10:20:22	0
2178723	99	43	37,4	cyclictest	2241237	-21	kworker/u4:3-rpciod	10:35:12	1
2178723	99	43	36,5	cyclictest	2357529	-21	kernelversion	12:30:25	1
2178723	99	43	36,5	cyclictest	2209179	-21	grep	09:05:38	1
2178723	99	43	34,7	cyclictest	2213420	-21	sh	09:15:21	1
2178723	99	43	33,8	cyclictest	0	-21	swapper/1	08:30:40	1
2178722	99	43	37,4	cyclictest	2212774	-21	latency_hist	09:15:01	0
2178722	99	43	36,5	cyclictest	2185610	-21	fschecks_time	07:35:19	0
2178722	99	43	35,6	cyclictest	0	-21	swapper/0	07:50:27	0
2178722	99	43	33,8	cyclictest	2294653	-21	acpi	11:15:13	0
2178722	99	43	33,7	cyclictest	2340320	-21	fschecks_time	12:10:21	0
2178723	99	42	36,4	cyclictest	2343896	-21	idleruntime-cro	12:15:00	1
2178723	99	42	36,4	cyclictest	2299528	-21	switchtime	11:20:39	1
2178723	99	42	36,4	cyclictest	2232236	-21	idleruntime-cro	09:45:00	1
2178723	99	42	36,4	cyclictest	2232236	-21	idleruntime-cro	09:45:00	1
2178723	99	42	34,4	cyclictest	0	-21	swapper/1	10:30:16	1
2178722	99	42	32,7	cyclictest	0	-21	swapper/0	08:20:40	0
2178723	99	41	34,5	cyclictest	2190029	-21	timerwakeupswit	07:50:36	1
2178723	99	41	32,7	cyclictest	2223402	-21	switchtime	09:30:45	1
2178723	99	41	32,7	cyclictest	2187500	-21	timerwakeupswit	07:40:37	1
2178723	99	41	27,11	cyclictest	2199250	-21	ls	08:30:01	1
2178723	99	40	32,5	cyclictest	2196521	-21	kworker/u4:6-rpciod	09:00:18	1
2178722	99	40	30,8	cyclictest	2199345	-21	/usr/sbin/munin	08:30:16	0
2178722	99	40	30,7	cyclictest	2281674	-21	sshd	10:57:36	0
2178722	99	40	30,7	cyclictest	0	-21	swapper/0	07:25:24	0
2178722	99	40	26,11	cyclictest	2252557	-21	fschecks_count	10:15:21	0
2178723	99	39	33,4	cyclictest	2201359	-21	sendmail_mailqu	08:35:37	1
2178723	99	38	30,6	cyclictest	2203642	-21	kernelversion	08:45:20	1
2178722	99	38	30,5	cyclictest	2191702	-21	aten_r7power_cu	08:00:15	0
2178723	99	36	29,4	cyclictest	0	-21	swapper/1	07:45:21	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17