OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the highest latencies:

System rackfslot4s.osadl.org (updated Wed Apr 02, 2025 00:45:59)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
29874	2	131	0,3	chrt	29872	-21	grep	21:10:01	0
29246	2	122	0,2	chrt	29242	-21	sendmail-msp	23:20:02	0
19475	2	121	0,3	chrt	19476	-21	aten2.4_rfpower	19:40:48	0
17044	2	121	0,2	chrt	17029	-21	diskstats	00:01:37	0
11443	2	117	0,3	chrt	11426	-21	ntpq	21:36:46	0
24628	2	115	0,3	chrt	24595	-21	ntpq	22:04:15	0
1324	2	114	0,3	chrt	1323	-21	sed	22:22:38	0
2686	2	109	0,2	chrt	2687	-21	sh	00:37:25	0
13672	2	109	0,4	chrt	13671	-21	perl	21:41:56	0
11081	2	109	0,2	chrt	11082	-21	sh	23:50:41	0
1583	2	108	0,2	chrt	1581	-21	hddtemp_smartct	23:30:51	0
15206	2	108	0,2	chrt	15207	-21	sleep	19:30:56	0
17389	2	103	0,2	chrt	17390	-21	apt-get	20:45:13	0
8101	2	94	0,2	sleep0	8103	-21	sh	23:43:01	0
25299	2	85	0,2	sleep0	25300	-21	cat	22:05:41	0
23750	2	83	0,2	sleep0	23748	-21	aten2.4_rfpower	00:15:36	0
1933	2	83	0,2	sleep0	1936	-21	grep	20:10:54	0
27667	2	82	0,1	sleep0	27671	-21	irqrtprio	22:10:58	0
3981	90	80	6,19	cyclictest	26562	-21	ntpq	21:03:06	0
3981	90	80	16,56	cyclictest	29242	-21	sendmail-msp	23:25:08	0
20292	2	79	0,2	sleep0	20294	-21	cut	21:56:16	0
3981	90	78	6,17	cyclictest	21369	-21	ntpq	23:04:15	0
3981	90	77	9,58	cyclictest	19368	-21	sendmail-msp	23:05:32	0
3981	90	76	12,56	cyclictest	3063	-21	sendmail-msp	21:23:24	0
3981	90	75	5,18	cyclictest	29479	-21	apt-get	20:01:00	0
3981	90	75	4,20	cyclictest	386	-21	ssh	00:33:57	0
3981	90	75	4,19	cyclictest	6441	-21	/usr/sbin/munin	23:40:06	0
3981	90	75	11,55	cyclictest	28927	-21	ssh	00:25:49	0
3981	90	75	11,55	cyclictest	12313	-21	ssh	22:45:36	0
3981	90	74	7,10	cyclictest	7168	-21	memory	20:21:53	0
3981	90	74	6,56	cyclictest	24701	-21	ntpq	23:11:12	0
3981	90	74	5,20	cyclictest	29242	-21	sendmail-msp	23:25:38	0
3981	90	74	5,19	cyclictest	28591	-21	munin-run	00:25:02	0
3981	90	74	5,11	cyclictest	17065	-21	sshd	21:50:22	0
3981	90	74	5,10	cyclictest	3938	-21	apt-get	22:30:47	0
3981	90	74	15,49	cyclictest	7970	-21	if_err_eth0	21:30:59	0
3981	90	74	11,55	cyclictest	32289	-21	sendmail-msp	22:25:20	0
3981	90	74	11,54	cyclictest	9687	-21	sendmail-msp	22:41:07	0
3981	90	74	11,54	cyclictest	3063	-21	sendmail-msp	21:25:32	0
3981	90	74	11,54	cyclictest	18885	-21	mailstats	00:05:30	0
3981	90	73	9,56	cyclictest	25759	-21	timerandwakeup	19:51:32	0
3981	90	73	6,11	cyclictest	9056	-21	sendmail-msp	19:20:40	0
3981	90	73	6,11	cyclictest	29209	-21	apt	20:00:00	0
3981	90	73	5,11	cyclictest	15313	-21	mailstats	21:45:29	0
3981	90	73	4,60	cyclictest	1851	-21	ssh	21:17:11	0
3981	90	73	4,18	cyclictest	14767	-21	sendmail-msp	20:40:18	0
3981	90	73	15,10	cyclictest	32413	-21	latency_hist	22:20:09	0
3981	90	72	9,54	cyclictest	6465	-21	sendmail-msp	23:45:39	0
3981	90	72	8,11	cyclictest	8322	-21	ntpq	22:36:40	0
3981	90	72	7,12	cyclictest	11067	-21	ps	20:31:17	0
3981	90	72	6,56	cyclictest	12352	-21	apt-get	20:35:19	0
3981	90	72	5,12	cyclictest	17560	-21	irqstats	19:35:44	0
3981	90	72	5,11	cyclictest	15038	-21	ntpq	23:56:52	0
3981	90	72	4,20	cyclictest	4678	-21	sshd	20:16:20	0
3981	90	71	5,17	cyclictest	29237	-21	sendmail-msp	20:05:25	0
3981	90	71	5,11	cyclictest	18489	-21	ssh	22:57:19	0
3981	90	71	4,19	cyclictest	7790	-21	ld	19:16:12	0
3981	90	71	4,18	cyclictest	15268	-21	ntp_states	22:51:43	0
3981	90	71	4,12	cyclictest	21503	-21	hddtemp_smartct	00:11:32	0
3981	90	71	15,46	cyclictest	23037	-21	/usr/sbin/munin	20:55:41	0
3981	90	70	6,9	cyclictest	4107	-21	apt-get	19:10:20	0
3981	90	70	5,10	cyclictest	22815	-21	ntpq	19:46:00	0
3981	90	70	4,18	cyclictest	32267	-21	ssh	21:13:47	0
3981	90	69	4,10	cyclictest	12813	-21	ntp_states	19:26:08	0
3981	90	69	13,9	cyclictest	19938	-21	/usr/sbin/munin	20:50:56	0
3981	90	67	5,11	cyclictest	9672	-21	munin-run	20:30:00	0
3981	90	63	7,12	cyclictest	4019	-21	cut	19:10:02	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-02-27 - 12:39