OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #4

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rack3slot4.osadl.org (updated Sat Nov 23, 2024 00:46:37)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1936216	2	2878	2857,10	sleep3	1934203	-21	kworker/3:0+events@ dbs_work_handler	19:05:32	3
1936758	2	612	593,9	sleep1	1936321	-21	kworker/1:4+events@ dbs_work_handler	19:05:49	1
1937237	99	140	62,71	cyclictest	1959422	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	20:15:57	0
1937257	99	117	103,7	cyclictest	1992224	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	21:21:07	3
1937237	99	116	1,64	cyclictest	0	-21	swapper/0	23:20:12	0
1937257	99	114	100,7	cyclictest	1959422	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	20:10:57	3
1937237	99	110	15,65	cyclictest	2028722	-21	kworker/u12:3+rpciod@ rpc_async_schedule	22:29:52	0
1937257	99	109	97,6	cyclictest	1938901	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	19:35:53	3
1937257	99	109	97,6	cyclictest	1938901	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	19:35:53	3
1937250	99	106	88,6	cyclictest	2048493	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	22:16:10	2
1937237	99	105	18,4	cyclictest	643	50	irq/528-eth0-Tx	22:20:30	0
1937250	99	102	80,9	cyclictest	2048493	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	22:31:15	2
1937250	99	102	80,9	cyclictest	2048493	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	22:31:14	2
1937237	99	101	49,32	cyclictest	15	-21	rcuc/0	22:05:27	0
1937237	99	101	26,55	cyclictest	13	-21	ksoftirqd/0	22:35:35	0
1937237	99	100	78,15	cyclictest	2123268	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:26:18	0
1937237	99	100	76,16	cyclictest	1975300	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	21:26:07	0
1937237	99	100	68,23	cyclictest	0	-21	swapper/0	22:45:42	0
1937250	99	99	87,6	cyclictest	2111960	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:56:16	2
1937250	99	97	83,7	cyclictest	2123268	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:31:18	2
1937257	99	96	82,6	cyclictest	2174340	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	00:36:32	3
1937237	99	96	10,55	cyclictest	2104477	-21	kworker/u12:4+events_unbound@ flush_memcg_stats_dwork	22:50:46	0
1937250	99	95	82,6	cyclictest	1940945	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	19:30:53	2
1937237	99	95	1,57	cyclictest	2212410	-21	kworker/u12:3+rpciod@ rpc_async_schedule	00:30:28	0
1937237	99	94	68,19	cyclictest	2028722	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	22:11:09	0
1937237	99	93	17,62	cyclictest	0	-21	swapper/0	21:02:58	0
1937237	99	91	9,54	cyclictest	13	-21	ksoftirqd/0	23:19:59	0
1937237	99	91	2,73	cyclictest	1984860	-21	diskmemload	23:42:45	0
1937237	99	91	1,32	cyclictest	13	-21	ksoftirqd/0	23:35:00	0
1937237	99	90	39,42	cyclictest	0	-21	swapper/0	21:51:43	0
1937237	99	90	39,42	cyclictest	0	-21	swapper/0	21:51:42	0
1937237	99	90	21,53	cyclictest	2067221	-21	ssh	22:19:35	0
1937237	99	89	13,62	cyclictest	13	-21	ksoftirqd/0	20:02:45	0
1937237	99	88	21,4	cyclictest	0	-21	swapper/0	23:55:01	0
1937237	99	88	1,73	cyclictest	15	-21	rcuc/0	00:15:37	0
1937250	99	87	74,6	cyclictest	1952712	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	19:50:54	2
1937237	99	87	20,52	cyclictest	0	-21	swapper/0	00:28:37	0
1937237	99	87	1,71	cyclictest	13	50	ksoftirqd/0	20:07:46	0
1937237	99	87	1,68	cyclictest	13	-21	ksoftirqd/0	21:55:11	0
1937261	99	86	80,3	cyclictest	0	-21	swapper/4	20:15:57	4
1937237	99	86	9,59	cyclictest	644	50	irq/529-eth0-Tx	23:35:22	0
1937237	99	86	50,25	cyclictest	0	-21	swapper/0	22:33:52	0
1937237	99	86	50,25	cyclictest	0	-21	swapper/0	22:33:52	0
1937261	99	85	79,3	cyclictest	0	-21	swapper/4	19:10:50	4
1937257	99	85	72,7	cyclictest	2028722	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	22:36:15	3
1937257	99	85	71,7	cyclictest	2157911	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:52:27	3
1937244	99	85	75,4	cyclictest	2157911	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:58:18	1
1937244	99	85	75,4	cyclictest	2157911	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:58:17	1
1937237	99	85	62,16	cyclictest	1936848	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	19:10:50	0
1937237	99	85	56,12	cyclictest	0	-21	swapper/0	20:20:27	0
1937237	99	85	56,12	cyclictest	0	-21	swapper/0	20:20:27	0
1937237	99	85	39,18	cyclictest	13	-21	ksoftirqd/0	21:30:36	0
1937237	99	85	29,24	cyclictest	644	50	irq/529-eth0-Tx	21:15:28	0
1937244	99	84	70,7	cyclictest	1962421	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	20:30:59	1
1937237	99	84	44,22	cyclictest	0	-21	swapper/0	19:50:39	0
1937237	99	83	16,42	cyclictest	642	50	irq/527-eth0-Tx	00:10:02	0
1937237	99	82	43,24	cyclictest	1984860	-21	diskmemload	21:35:31	0
1937237	99	82	1,59	cyclictest	2229884	-21	sed	00:40:02	0
1937237	99	81	34,39	cyclictest	2111960	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:00:21	0
1937237	99	81	26,3	cyclictest	0	-21	swapper/0	21:40:21	0
1937237	99	81	26,3	cyclictest	0	-21	swapper/0	21:40:21	0
1937237	99	81	0,28	cyclictest	0	-21	swapper/0	21:20:24	0
1937250	99	80	67,6	cyclictest	1975300	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	21:01:04	2
1937237	99	80	24,7	cyclictest	13	-21	ksoftirqd/0	22:00:41	0
1937237	99	80	23,3	cyclictest	643	50	irq/528-eth0-Tx	23:45:33	0
1937237	99	79	27,37	cyclictest	2185986	-21	cron	23:59:59	0
1937237	99	79	27,37	cyclictest	2185986	-21	cron	00:00:00	0
1937237	99	79	18,7	cyclictest	2130182	-21	runrttasks	23:12:12	0
1937237	99	79	18,7	cyclictest	2130182	-21	runrttasks	23:12:11	0
1937237	99	78	29,26	cyclictest	0	-21	swapper/0	00:00:22	0
1937237	99	78	29,26	cyclictest	0	-21	swapper/0	00:00:21	0
1937250	99	77	63,7	cyclictest	1972640	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	20:41:00	2
1937237	99	77	1,28	cyclictest	0	-21	swapper/0	20:30:27	0
1937261	99	76	64,6	cyclictest	2174213	-21	ssh	23:50:06	4
1937257	99	76	63,7	cyclictest	1975300	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	21:46:08	3
1937257	99	76	63,7	cyclictest	1975300	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	21:46:08	3
1937250	99	76	62,7	cyclictest	2151350	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	00:03:44	2
1937250	99	76	62,7	cyclictest	2151350	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	00:03:43	2
1937237	99	76	45,13	cyclictest	642	50	irq/527-eth0-Tx	00:05:41	0
1937237	99	76	45,13	cyclictest	642	50	irq/527-eth0-Tx	00:05:41	0
1937237	99	76	27,33	cyclictest	0	-21	swapper/0	19:45:39	0
1937237	99	76	2,26	cyclictest	0	-21	swapper/0	21:45:31	0
1937237	99	76	2,26	cyclictest	0	-21	swapper/0	21:45:30	0
1937237	99	76	21,5	cyclictest	15	-21	rcuc/0	22:40:54	0
1937237	99	76	21,4	cyclictest	0	-21	swapper/0	23:10:02	0
1937237	99	76	21,4	cyclictest	0	-21	swapper/0	23:10:01	0
1937257	99	75	62,7	cyclictest	2076914	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	22:29:58	3
1937244	99	75	61,7	cyclictest	2028722	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	22:06:10	1
1937237	99	75	31,27	cyclictest	13	-21	ksoftirqd/0	19:35:21	0
1937237	99	75	31,27	cyclictest	13	-21	ksoftirqd/0	19:35:21	0
1937261	99	74	64,5	cyclictest	2076326	-21	ssh	22:26:13	4
1937257	99	74	62,6	cyclictest	2157911	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:36:01	3
1937257	99	74	60,7	cyclictest	1940945	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	20:00:55	3
1937237	99	74	39,25	cyclictest	642	50	irq/527-eth0-Tx	00:25:00	0
1937237	99	74	3,52	cyclictest	0	-21	swapper/0	20:50:29	0
1937237	99	74	27,4	cyclictest	644	50	irq/529-eth0-Tx	22:55:34	0
1937237	99	74	2,58	cyclictest	0	-21	swapper/0	19:15:38	0
1937237	99	74	2,29	cyclictest	1987750	-21	ssh	21:13:13	0
2092002	2	73	0,5	sleep4	2092001	-21	rm	22:40:02	4
1937261	99	73	66,3	cyclictest	0	-21	swapper/4	22:23:45	4
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17