OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #4

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rack3slot4.osadl.org (updated Wed Apr 02, 2025 00:46:19)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3236026	2	2288	2269,9	sleep2	3229158	-21	kworker/2:4+events@ dbs_work_handler	19:05:36	2
3236931	99	121	1,105	cyclictest	0	-21	swapper/0	22:40:55	0
3236931	99	121	1,105	cyclictest	0	-21	swapper/0	22:40:55	0
3236931	99	117	57,40	cyclictest	0	-21	swapper/0	19:10:26	0
3236931	99	114	1,99	cyclictest	3485209	-21	ssh	00:13:02	0
3236931	99	114	1,99	cyclictest	0	-21	swapper/0	21:40:41	0
3236931	99	113	51,22	cyclictest	0	-21	swapper/0	00:35:34	0
3436115	2	110	0,5	sleep2	0	-21	swapper/2	23:29:24	2
3236931	99	110	1,96	cyclictest	0	-21	swapper/0	00:30:40	0
3236931	99	108	61,36	cyclictest	3303080	-21	aten2_r3power_p	21:30:19	0
3236931	99	108	2,61	cyclictest	3472327	-21	/usr/sbin/munin	00:00:23	0
3236931	99	106	2,77	cyclictest	0	-21	swapper/0	19:40:39	0
3236931	99	106	2,77	cyclictest	0	-21	swapper/0	19:40:38	0
3236931	99	106	1,62	cyclictest	13	-21	ksoftirqd/0	22:35:27	0
3236931	99	106	1,62	cyclictest	13	-21	ksoftirqd/0	22:35:27	0
3236931	99	105	40,14	cyclictest	13	-21	ksoftirqd/0	20:15:21	0
3236931	99	105	2,91	cyclictest	0	-21	swapper/0	21:25:39	0
3236931	99	103	42,28	cyclictest	0	-21	swapper/0	19:20:23	0
3236931	99	103	42,28	cyclictest	0	-21	swapper/0	19:20:22	0
3236931	99	103	40,30	cyclictest	3428120	-21	timerwakeupswit	23:20:43	0
3236931	99	103	14,29	cyclictest	3361169	-21	rm	22:20:47	0
3236931	99	102	32,31	cyclictest	3385526	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:50:14	0
3236931	99	102	1,77	cyclictest	0	-21	swapper/0	21:55:43	0
3236931	99	102	1,77	cyclictest	0	-21	swapper/0	21:55:43	0
3236931	99	102	1,60	cyclictest	3433195	-21	ssh	23:26:01	0
3236931	99	101	46,23	cyclictest	0	-21	swapper/0	20:30:15	0
3236931	99	101	46,23	cyclictest	0	-21	swapper/0	20:30:14	0
3236931	99	101	38,55	cyclictest	3356300	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	22:29:15	0
3236931	99	100	1,57	cyclictest	0	-21	swapper/0	23:32:46	0
3236931	99	98	57,20	cyclictest	0	-21	swapper/0	19:20:00	0
3236931	99	97	54,24	cyclictest	142	50	irq/98-imx_mu_c	22:10:25	0
3236931	99	97	42,24	cyclictest	0	-21	swapper/0	20:10:23	0
3236931	99	97	42,24	cyclictest	0	-21	swapper/0	20:10:22	0
3236931	99	97	38,25	cyclictest	15	-21	rcuc/0	21:00:41	0
3236931	99	97	1,59	cyclictest	0	-21	swapper/0	21:13:34	0
3236931	99	96	1,67	cyclictest	3281770	-21	diskmemload	21:15:35	0
3236931	99	95	41,26	cyclictest	3325499	-21	sed	21:50:15	0
3236931	99	95	30,27	cyclictest	3335648	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:30:03	0
3236931	99	95	20,29	cyclictest	3329099	-21	kworker/0:1+pm@ pm_runtime_work	23:00:02	0
3236931	99	95	15,38	cyclictest	13	-21	ksoftirqd/0	23:50:14	0
3236931	99	94	22,38	cyclictest	13	-21	ksoftirqd/0	21:35:18	0
3236931	99	93	6,7	cyclictest	68	-21	kcompactd0	23:15:04	0
3236931	99	93	1,44	cyclictest	3373714	-1	kworker/0:0H+kblockd@ blk_mq_run_work_fn	00:10:00	0
3236931	99	92	38,14	cyclictest	643	50	irq/528-eth0-Tx	22:15:17	0
3236931	99	92	33,22	cyclictest	0	-21	swapper/0	20:00:31	0
3236931	99	92	33,16	cyclictest	3428539	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:40:59	0
3236938	99	91	76,8	cyclictest	3394265	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	23:20:58	1
3236931	99	91	5,59	cyclictest	3419111	-21	kworker/u12:0+flush-179:96@ wb_workfn	23:13:59	0
3236931	99	91	31,20	cyclictest	0	-21	swapper/0	00:20:28	0
3236931	99	90	27,34	cyclictest	14	-21	rcu_preempt	23:02:05	0
3236931	99	90	1,57	cyclictest	13	-21	ksoftirqd/0	23:07:40	0
3236931	99	89	55,24	cyclictest	3294196	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	21:48:39	0
3236931	99	89	55,24	cyclictest	3294196	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	21:48:39	0
3236931	99	89	2,5	cyclictest	3466808	-21	ntpq	23:55:33	0
3236931	99	89	1,38	cyclictest	0	-21	swapper/0	23:35:02	0
3236931	99	88	39,24	cyclictest	0	-21	swapper/0	19:30:31	0
3236931	99	86	52,25	cyclictest	3275693	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	20:57:59	0
3321243	2	79	0,4	sleep1	0	-21	swapper/1	21:46:03	1
3321243	2	79	0,4	sleep1	0	-21	swapper/1	21:46:02	1
3275588	2	79	0,7	chrt	13	-21	ksoftirqd/0	20:51:49	0
3275588	2	79	0,7	chrt	13	-21	ksoftirqd/0	20:51:49	0
3375885	2	78	0,3	sleep2	0	-21	swapper/2	22:35:16	2
3375885	2	78	0,3	sleep2	0	-21	swapper/2	22:35:16	2
3236931	99	78	46,16	cyclictest	3273682	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	22:02:56	0
3236931	99	77	19,24	cyclictest	0	-21	swapper/0	21:20:15	0
3236931	99	75	39,14	cyclictest	3270633	-21	if_err_eth0	20:40:23	0
3236931	99	74	44,17	cyclictest	643	50	irq/528-eth0-Tx	20:20:30	0
3236931	99	74	41,16	cyclictest	3356300	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	22:48:27	0
3236931	99	73	23,22	cyclictest	0	-21	swapper/0	19:35:19	0
3236931	99	72	14,28	cyclictest	13	-21	ksoftirqd/0	00:27:31	0
3236931	99	71	21,4	cyclictest	644	50	irq/529-eth0-Tx	00:20:01	0
3236931	99	70	28,36	cyclictest	15	-21	rcuc/0	22:08:06	0
3236948	99	69	45,7	cyclictest	3356300	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	22:26:53	3
3236931	99	69	30,24	cyclictest	643	50	irq/528-eth0-Tx	23:45:07	0
3403671	2	68	0,14	sleep2	30	-21	ksoftirqd/2	23:00:00	2
3456753	2	66	0,5	sleep2	0	-21	swapper/2	23:47:05	2
3236958	99	66	59,3	cyclictest	0	-21	swapper/5	22:55:13	5
3236931	99	66	2,49	cyclictest	0	-21	swapper/0	19:50:29	0
3236943	99	65	35,7	cyclictest	3337555	-21	kworker/u12:4+events_unbound@ flush_memcg_stats_dwork	22:24:28	2
3236938	99	65	51,7	cyclictest	3273682	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	20:53:57	1
3236938	99	65	51,7	cyclictest	3273682	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	20:53:56	1
3236931	99	65	34,13	cyclictest	0	-21	swapper/0	21:05:27	0
3236931	99	65	29,12	cyclictest	0	-21	swapper/0	20:35:35	0
3236958	99	64	57,3	cyclictest	0	-21	swapper/5	22:01:35	5
3236952	99	64	51,8	cyclictest	3460239	-21	ssh	23:50:17	4
3236948	99	64	18,30	cyclictest	37	-21	ksoftirqd/3	00:20:02	3
3236943	99	64	33,7	cyclictest	3283739	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	21:13:44	2
3236931	99	64	1,47	cyclictest	0	-21	swapper/0	19:45:23	0
3447013	2	63	51,6	sleep5	0	-21	swapper/5	23:38:09	5
3236958	99	63	56,3	cyclictest	0	-21	swapper/5	22:44:45	5
3236958	99	63	56,3	cyclictest	0	-21	swapper/5	22:44:45	5
3236958	99	63	56,3	cyclictest	0	-21	swapper/5	21:50:01	5
3236958	99	63	56,3	cyclictest	0	-21	swapper/5	21:50:01	5
3236938	99	63	49,7	cyclictest	3241335	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	20:10:18	1
3236938	99	63	49,7	cyclictest	3241335	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	20:10:18	1
3236938	99	63	48,8	cyclictest	3404670	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:10:17	1
3236948	99	62	46,7	cyclictest	3335648	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:35:16	3
3236948	99	62	46,7	cyclictest	3335648	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:35:16	3
3316970	2	61	48,5	sleep5	0	-21	swapper/5	21:41:29	5
3294758	2	61	50,4	sleep5	0	-21	swapper/5	21:21:29	5
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17