OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackcslot4s.osadl.org (updated Mon Sep 16, 2024 12:44:18)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
10623	2	316	247,57	sleep2	0	-21	swapper/2	07:05:40	2
11205	2	305	218,70	sleep1	0	-21	swapper/1	07:09:39	1
11066	2	251	202,35	sleep0	0	-21	swapper/0	07:08:26	0
10881	2	248	196,38	sleep3	0	-21	swapper/3	07:06:46	3
21733	2	146	0,4	sleep2	11442	99	cyclictest	11:15:00	2
2780	2	52	0,9	sleep1	19	-21	ksoftirqd/1	09:15:17	1
19238	2	51	0,1	sleep0	0	-21	swapper/0	11:10:00	0
11444	99	27	0,24	cyclictest	1454	-21	python3	08:00:00	3
11444	99	26	1,22	cyclictest	24855	-21	latency_hist	07:40:01	3
11444	99	25	17,6	cyclictest	29799	-21	pidof	09:02:45	3
11442	99	24	2,15	cyclictest	23861	-21	taskset	08:50:08	2
11444	99	23	1,19	cyclictest	23267	-21	python3	08:50:00	3
11444	99	23	1,18	cyclictest	19995	-40	apt-check	12:25:05	3
11444	99	23	0,20	cyclictest	25361	-40	apt-check	07:40:06	3
11442	99	23	14,6	cyclictest	24896	-21	id	07:40:00	2
11444	99	22	1,18	cyclictest	21406	-21	python3	11:15:00	3
11442	99	22	2,14	cyclictest	6344	-21	apt-get	08:10:12	2
11442	99	22	2,13	cyclictest	24167	-21	apt-get	11:20:13	2
11442	99	22	17,3	cyclictest	23235	-21	apt-get	08:50:01	2
11442	99	22	16,3	cyclictest	26578	-21	sendmail	12:40:00	2
11437	99	22	9,7	cyclictest	19	-21	ksoftirqd/1	07:55:55	1
11437	99	22	13,6	cyclictest	10937	-21	tune2fs	08:20:13	1
11437	99	22	10,3	cyclictest	19	-21	ksoftirqd/1	07:34:23	1
11437	99	22	0,8	cyclictest	22316	-21	grep	08:45:20	1
11433	99	22	14,5	cyclictest	14076	-21	sensors_temp	10:55:24	0
11433	99	22	13,6	cyclictest	17610	-21	expr	12:20:13	0
11433	99	22	13,6	cyclictest	17610	-21	expr	12:20:13	0
4210	2	21	0,10	sleep2	25	-21	ksoftirqd/2	09:20:00	2
11444	99	21	14,5	cyclictest	14409	-21	ls	07:15:13	3
11444	99	21	1,3	cyclictest	28202	-21	munin-run	11:29:59	3
11444	99	21	13,6	cyclictest	22560	-21	cat	11:15:17	3
11444	99	21	13,6	cyclictest	19584	-21	snmp_o5powerctl	07:25:22	3
11444	99	21	13,6	cyclictest	12516	-21	tr	07:10:19	3
11444	99	21	1,17	cyclictest	19408	-21	python3	12:25:00	3
11444	99	21	1,17	cyclictest	19408	-21	python3	12:24:59	3
11444	99	21	0,19	cyclictest	3855	-21	munin-run	10:35:00	3
11442	99	21	9,8	cyclictest	25509	-21	apt-get	07:40:15	2
11442	99	21	2,13	cyclictest	26299	-21	apt-get	11:25:12	2
11442	99	21	2,13	cyclictest	14273	-21	apt-get	07:15:13	2
11442	99	21	16,3	cyclictest	1482	-21	gpgv	08:00:01	2
11442	99	21	14,5	cyclictest	4430	-21	awk	08:05:14	2
11442	99	21	14,5	cyclictest	28714	-21	awk	10:15:20	2
11442	99	21	14,5	cyclictest	24252	-21	wc	10:05:18	2
11442	99	21	14,5	cyclictest	17233	-21	sed	11:05:01	2
11442	99	21	13,6	cyclictest	13052	-21	date	12:10:00	2
11442	99	21	10,7	cyclictest	12581	-21	date	08:25:00	2
11437	99	21	2,14	cyclictest	8483	-21	apt-get	08:15:13	1
11437	99	21	1,7	cyclictest	19	-21	ksoftirqd/1	10:09:05	1
11437	99	21	1,6	cyclictest	30455	-21	latency_hist	11:35:00	1
11437	99	21	14,4	cyclictest	26186	-21	cut	10:10:15	1
11437	99	21	10,3	cyclictest	19	-21	ksoftirqd/1	09:09:37	1
11433	99	21	9,8	cyclictest	15215	-21	apt-get	11:00:13	0
11433	99	21	6,13	cyclictest	11	1	rcu_preempt	08:50:01	0
11433	99	21	16,3	cyclictest	5620	-21	grep	11:50:21	0
11433	99	21	15,4	cyclictest	20802	-21	ntp_states	12:25:22	0
11433	99	21	14,5	cyclictest	26329	-21	pmu-power	07:40:22	0
11433	99	21	14,5	cyclictest	23957	-21	grep	07:35:20	0
11433	99	21	14,5	cyclictest	12686	-21	wc	08:25:00	0
11433	99	21	13,6	cyclictest	9480	-21	threads	10:45:24	0
11433	99	21	13,6	cyclictest	17960	-21	ntpq	09:50:19	0
11433	99	21	0,5	cyclictest	0	-21	swapper/0	10:10:27	0
11444	99	20	16,2	cyclictest	18958	-21	munin-run	08:40:00	3
11444	99	20	16,2	cyclictest	15464	-21	latency	08:30:16	3
11444	99	20	16,2	cyclictest	1130	-21	runrttasks	10:55:14	3
11444	99	20	15,3	cyclictest	29801	-21	sh	10:19:59	3
11444	99	20	14,4	cyclictest	27923	-21	idleruntime-cro	09:00:01	3
11444	99	20	14,3	cyclictest	3858	-21	runrttasks	09:18:01	3
11444	99	20	14,3	cyclictest	31846	-21	runrttasks	09:06:58	3
11444	99	20	1,3	cyclictest	24079	-21	python3	12:35:01	3
11444	99	20	13,5	cyclictest	24291	-21	expr	11:20:13	3
11444	99	20	13,5	cyclictest	23761	-21	cat	10:05:14	3
11444	99	20	13,5	cyclictest	20644	-21	awk	09:55:24	3
11444	99	20	13,5	cyclictest	16567	-21	expr	07:20:13	3
11444	99	20	12,6	cyclictest	7343	-21	cat	11:55:16	3
11444	99	20	12,6	cyclictest	18354	-21	sed	09:50:25	3
11444	99	20	12,5	cyclictest	5635	-21	snmp_o5powerctl	11:50:22	3
11444	99	20	10,7	cyclictest	839	-21	dbus-daemon	12:35:01	3
11442	99	20	2,12	cyclictest	19873	-40	apt-check	12:25:09	2
11442	99	20	2,12	cyclictest	19485	-21	apt-get	11:10:13	2
11442	99	20	2,11	cyclictest	13625	-21	munin-node	10:20:13	2
11442	99	20	13,5	cyclictest	937	-21	sed	10:25:23	2
11442	99	20	13,5	cyclictest	18498	-21	sed	07:25:00	2
11442	99	20	13,5	cyclictest	14989	-21	sed	09:45:01	2
11442	99	20	13,5	cyclictest	14989	-21	sed	09:45:00	2
11442	99	20	12,6	cyclictest	3568	-21	sed	11:45:23	2
11442	99	20	12,6	cyclictest	28734	-21	cat	09:00:16	2
11442	99	20	12,6	cyclictest	22927	-21	ntpq	12:30:21	2
11442	99	20	11,6	cyclictest	12447	-21	systemctl	10:55:00	2
11442	99	20	1,13	cyclictest	21499	-21	apt-get	10:00:17	2
11437	99	20	2,3	cyclictest	19	-21	ksoftirqd/1	09:30:00	1
11437	99	20	2,12	cyclictest	4361	-21	apt-get	09:20:11	1
11437	99	20	1,7	cyclictest	19	-21	ksoftirqd/1	11:45:15	1
11437	99	20	1,7	cyclictest	19	-21	ksoftirqd/1	09:40:13	1
11437	99	20	1,7	cyclictest	19	-21	ksoftirqd/1	09:40:13	1
11437	99	20	1,5	cyclictest	30570	-21	apt-get	11:35:11	1
11437	99	20	14,3	cyclictest	19382	-21	latency_hist	12:25:01	1
11437	99	20	14,3	cyclictest	19382	-21	latency_hist	12:25:01	1
11437	99	20	13,5	cyclictest	28326	-21	cat	10:15:16	1
11437	99	20	12,6	cyclictest	26420	-21	expr	11:25:12	1
11437	99	20	12,6	cyclictest	21894	-21	grep	10:00:20	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17