OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

x86 Intel Atom E3950 @1600 MHz, Linux 5.6.19-rt12 (Profile)

Latency plot of shadow in rack #9, slot #2

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack9slot2s (updated Thu Oct 29, 2020 00:45:46)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
9170	98	373	0,365	rtkit-daemon	0	-21	swapper/2	19:07:45	2
14327	2	167	157,8	sleep7	0	-21	swapper/7	19:08:16	7
11833	2	95	0,0	sleep6	56	-21	ksoftirqd/6	21:36:30	6
11833	2	95	0,0	sleep6	56	-21	ksoftirqd/6	21:36:30	6
14717	99	74	17,46	cyclictest	0	-21	swapper/0	00:10:26	0
14752	99	68	9,33	cyclictest	0	-21	swapper/7	22:00:16	7
14723	99	68	9,29	cyclictest	0	-21	swapper/1	21:20:17	1
14723	99	68	9,29	cyclictest	0	-21	swapper/1	21:20:17	1
8864	2	56	0,1	sleep4	42	-21	ksoftirqd/4	21:35:00	4
14733	99	56	15,25	cyclictest	0	-21	swapper/3	00:15:47	3
14752	99	55	6,11	cyclictest	22760	-21	gltestperf	20:20:07	7
14723	99	55	6,23	cyclictest	15610	-21	gltestperf	19:10:07	1
14723	99	52	51,1	cyclictest	6667	-21	needreboot	19:50:14	1
14723	99	52	0,36	cyclictest	0	-21	swapper/1	21:12:14	1
14752	99	50	49,0	cyclictest	13092	-21	grep	21:00:08	7
14723	99	50	48,1	cyclictest	14806	-21	gltestperf	20:05:05	1
14723	99	48	26,11	cyclictest	0	-21	swapper/1	21:36:44	1
14723	99	48	26,11	cyclictest	0	-21	swapper/1	21:36:44	1
14717	99	47	45,1	cyclictest	31067	-21	grep	21:55:14	0
14752	99	46	10,18	cyclictest	0	-21	swapper/7	21:41:15	7
14743	99	46	44,1	cyclictest	8630	-21	taskset	23:10:13	5
14747	99	45	43,1	cyclictest	19017	-21	fschecks_time	19:15:05	6
14728	99	45	11,20	cyclictest	0	-21	swapper/2	23:41:48	2
14717	99	45	45,0	cyclictest	32576	-21	grep	00:09:59	0
14728	99	44	14,19	cyclictest	0	-21	swapper/2	19:40:40	2
14723	99	44	42,1	cyclictest	14981	-21	gltestperf	22:45:06	1
14752	99	43	43,0	cyclictest	0	-21	swapper/7	21:24:35	7
14752	99	43	43,0	cyclictest	0	-21	swapper/7	21:24:35	7
14752	99	43	40,2	cyclictest	0	-21	swapper/7	21:50:44	7
14743	99	43	41,1	cyclictest	24378	-21	gltestperf	21:50:05	5
14737	99	43	41,1	cyclictest	32640	-21	grep	21:25:00	4
14737	99	43	41,1	cyclictest	32640	-21	grep	21:25:00	4
14733	99	43	41,1	cyclictest	3032	-21	grep	19:45:02	3
14733	99	43	40,2	cyclictest	1694	-21	pmcd	22:33:14	3
14752	99	42	0,1	cyclictest	0	-21	swapper/7	20:03:34	7
14747	99	42	41,1	cyclictest	1115	-21	ksmtuned	00:25:00	6
14743	99	42	39,3	cyclictest	5392	-21	needreboot	21:30:08	5
14733	99	42	41,0	cyclictest	28357	-21	grep	20:30:04	3
14733	99	42	40,1	cyclictest	25439	-21	grep	20:25:05	3
14723	99	42	40,1	cyclictest	30394	-21	gltestperf	23:00:06	1
14723	99	42	40,1	cyclictest	23404	-21	fschecks_time	21:15:05	1
14717	99	42	40,1	cyclictest	5322	-21	grep	21:30:08	0
14737	99	41	10,17	cyclictest	0	-21	swapper/4	20:40:48	4
14723	99	41	41,0	cyclictest	29394	-21	grep	21:55:04	1
14723	99	41	39,1	cyclictest	0	-21	swapper/1	20:40:07	1
14717	99	41	39,1	cyclictest	22750	-21	gltestperf	23:25:05	0
14743	99	40	32,7	cyclictest	13761	-21	cat	21:40:00	5
14743	99	40	32,7	cyclictest	13761	-21	cat	21:40:00	5
14717	99	40	38,1	cyclictest	13084	-21	fschecks_time	23:50:05	0
14752	99	39	38,0	cyclictest	0	-21	swapper/7	20:28:35	7
14747	99	39	37,1	cyclictest	13674	-21	strings	21:00:12	6
14743	99	39	37,1	cyclictest	0	-21	swapper/5	23:00:10	5
14743	99	39	31,8	cyclictest	23975	-21	hwlatdetect	00:00:09	5
14728	99	39	37,1	cyclictest	20517	-21	cat	20:15:09	2
14723	99	39	39,0	cyclictest	0	-21	swapper/1	23:17:04	1
14717	99	39	37,1	cyclictest	18758	-21	gltestperf	23:55:06	0
14747	99	38	38,0	cyclictest	1115	-21	ksmtuned	22:40:15	6
14747	99	38	37,0	cyclictest	0	-21	swapper/6	21:10:04	6
14743	99	38	38,0	cyclictest	0	-21	swapper/5	20:19:34	5
14743	99	38	36,1	cyclictest	32102	-21	ntpq	20:35:15	5
14743	99	38	36,1	cyclictest	1956	-21	ls	00:10:13	5
14743	99	38	0,37	cyclictest	0	-21	swapper/5	19:30:04	5
14733	99	38	38,0	cyclictest	0	-21	swapper/3	21:01:25	3
14733	99	38	37,1	cyclictest	11134	-21	cat	20:00:00	3
14733	99	38	28,3	cyclictest	0	-21	swapper/3	23:10:44	3
14728	99	38	36,1	cyclictest	24153	-21	gltestperf	00:25:06	2
14723	99	38	36,1	cyclictest	26934	-21	cpuspeed_turbos	22:25:04	1
14723	99	38	36,1	cyclictest	25305	-21	find	21:50:17	1
14717	99	38	36,1	cyclictest	10470	-21	unixbench_singl	19:55:15	0
14747	99	37	35,1	cyclictest	7993	-21	wc	19:55:00	6
14747	99	37	35,1	cyclictest	19523	-21	gltestperf	21:45:06	6
14747	99	37	35,1	cyclictest	19523	-21	gltestperf	21:45:06	6
14747	99	37	35,1	cyclictest	1872	-21	gltestperf	00:35:06	6
14747	99	37	35,1	cyclictest	17878	-21	needreboot	22:15:12	6
14743	99	37	37,0	cyclictest	0	-21	swapper/5	22:21:55	5
14743	99	37	36,0	cyclictest	0	-21	swapper/5	19:12:45	5
14743	99	37	0,0	cyclictest	0	-21	swapper/5	19:59:14	5
14737	99	37	9,12	cyclictest	0	-21	swapper/4	21:15:12	4
14737	99	37	37,0	cyclictest	1115	-21	ksmtuned	21:00:12	4
14737	99	37	25,4	cyclictest	0	-21	swapper/4	23:55:14	4
14737	99	37	0,21	cyclictest	0	-21	swapper/4	21:41:07	4
14733	99	37	37,0	cyclictest	0	-21	swapper/3	23:09:54	3
14733	99	37	31,2	cyclictest	0	-21	swapper/3	22:43:44	3
14723	99	37	37,0	cyclictest	26984	-21	kworker/u16:0	23:30:00	1
14723	99	37	36,0	cyclictest	15311	-21	grep	21:05:03	1
14382	2	37	24,8	sleep6	0	-21	swapper/6	19:08:55	6
14752	99	36	34,1	cyclictest	30396	-21	grep	21:55:09	7
14752	99	36	0,35	cyclictest	0	-21	swapper/7	19:35:54	7
14747	99	36	34,1	cyclictest	28112	-21	tr	21:20:03	6
14747	99	36	34,1	cyclictest	28112	-21	tr	21:20:03	6
14743	99	36	36,0	cyclictest	0	-21	swapper/5	23:52:15	5
14743	99	36	34,1	cyclictest	32552	-21	sh	00:10:00	5
14743	99	36	32,3	cyclictest	9801	-21	cpuspeed_turbos	20:55:07	5
14737	99	36	7,15	cyclictest	0	-21	swapper/4	00:11:47	4
14737	99	36	35,1	cyclictest	31073	-21	cpuspeed_turbos	20:35:02	4
14737	99	36	35,0	cyclictest	24360	-21	cut	21:50:05	4
14737	99	36	34,1	cyclictest	13550	-21	timerwakeupswit	23:15:13	4
14737	99	36	10,17	cyclictest	0	-21	swapper/4	22:41:40	4
14733	99	36	34,1	cyclictest	7861	-21	cpuspeed_turbos	23:45:03	3
14733	99	36	34,1	cyclictest	5645	-21	cpuspeed_turbos	19:50:03	3
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2021-04-10 - 20:27