You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-04-03 - 11:27
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackeslot2.osadl.org (updated Thu Apr 03, 2025 00:43:58)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
216630921050,2sleep30-21swapper/323:20:243
211147321040,1sleep12111475-21ssh22:47:191
19631082410,2sleep30-21swapper/321:10:263
25010913419,2phc2sys0-21swapper/321:19:013
25010912519,2phc2sys0-21swapper/320:06:043
25010912517,3phc2sys0-21swapper/321:34:563
25010912517,2phc2sys0-21swapper/322:05:313
181273399252,12cyclictest0-21swapper/219:10:012
25010912419,3phc2sys0-21swapper/300:23:493
25010912418,3phc2sys0-21swapper/322:52:003
25010912418,2phc2sys0-21swapper/323:59:453
25010912418,2phc2sys0-21swapper/323:28:353
25010912418,2phc2sys0-21swapper/322:22:513
25010912417,2phc2sys0-21swapper/300:16:103
25010912417,2phc2sys0-21swapper/300:16:093
25010912417,2phc2sys0-21swapper/300:05:113
21587632240,2sleep20-21swapper/223:15:582
1812725992421,2cyclictest2234999-21grep00:10:010
25010912318,3phc2sys0-21swapper/323:42:063
25010912318,3phc2sys0-21swapper/323:10:553
25010912318,3phc2sys0-21swapper/322:40:453
25010912318,3phc2sys0-21swapper/322:10:473
25010912318,3phc2sys0-21swapper/321:58:573
25010912318,3phc2sys0-21swapper/300:35:323
25010912318,3phc2sys0-21swapper/300:00:143
25010912317,3phc2sys0-21swapper/320:10:233
25010912317,2phc2sys0-21swapper/323:48:393
25010912317,2phc2sys0-21swapper/323:08:153
25010912317,2phc2sys0-21swapper/322:35:573
25010912317,2phc2sys0-21swapper/322:33:013
25010912317,2phc2sys0-21swapper/321:26:383
25010912317,2phc2sys0-21swapper/321:07:273
25010912317,2phc2sys0-21swapper/320:56:013
25010912317,2phc2sys0-21swapper/320:36:253
25010912317,2phc2sys0-21swapper/320:22:553
25010912317,2phc2sys0-21swapper/319:41:073
25010912317,2phc2sys0-21swapper/319:28:343
25010912317,2phc2sys0-21swapper/319:10:093
25010912316,2phc2sys0-21swapper/321:22:143
1812725992314,5cyclictest2258169-21kthreadcore00:20:250
1812725992313,6cyclictest0-21swapper/022:30:000
25010912217,3phc2sys0-21swapper/323:31:123
25010912217,3phc2sys0-21swapper/322:59:093
25010912217,3phc2sys0-21swapper/322:01:053
25010912217,3phc2sys0-21swapper/321:39:083
25010912217,3phc2sys0-21swapper/321:03:493
25010912217,3phc2sys0-21swapper/320:50:233
25010912217,3phc2sys0-21swapper/320:42:293
25010912217,3phc2sys0-21swapper/319:55:343
25010912217,3phc2sys0-21swapper/319:45:243
25010912217,3phc2sys0-21swapper/319:38:023
25010912217,3phc2sys0-21swapper/319:23:353
25010912217,3phc2sys0-21swapper/319:15:103
25010912217,3phc2sys0-21swapper/300:32:153
25010912217,2phc2sys0-21swapper/320:16:013
224274222218,2sleep20-21swapper/200:13:282
212167122218,2sleep20-21swapper/222:54:202
206046922218,2sleep20-21swapper/222:13:562
201622122218,3sleep30-21swapper/321:41:533
201071722218,2sleep20-21swapper/221:40:252
1812730992219,2cyclictest2152470-21grep23:15:011
1812730992214,3cyclictest0-21swapper/100:20:011
1812730992214,3cyclictest0-21swapper/100:20:001
1812725992212,6cyclictest2153200-21cpuspeed_turbos23:15:160
25010912117,2phc2sys0-21swapper/323:53:583
25010912117,2phc2sys0-21swapper/323:03:033
25010912117,2phc2sys0-21swapper/322:25:093
25010912117,2phc2sys0-21swapper/321:48:013
25010912117,2phc2sys0-21swapper/320:30:023
25010912117,2phc2sys0-21swapper/300:28:263
25010912117,2phc2sys0-21swapper/300:10:143
228050822117,2sleep20-21swapper/200:35:482
227311322117,2sleep20-21swapper/200:33:022
221053722117,2sleep20-21swapper/223:50:592
218247622117,2sleep20-21swapper/223:34:322
217177422117,2sleep20-21swapper/223:26:452
215059922117,2sleep20-21swapper/223:12:112
212260922117,2sleep20-21swapper/222:55:152
211125222117,2sleep20-21swapper/222:47:012
210896422117,2sleep20-21swapper/222:43:582
209950922117,2sleep20-21swapper/222:38:082
207830022117,2sleep20-21swapper/222:23:262
206955722117,2sleep20-21swapper/222:19:122
206935222117,2sleep30-21swapper/322:18:533
204586922117,2sleep20-21swapper/222:00:372
203385422117,2sleep20-21swapper/221:55:232
202839022117,2sleep20-21swapper/221:51:232
199745922117,2sleep20-21swapper/221:31:072
198942822117,2sleep20-21swapper/221:27:302
198561722117,2sleep20-21swapper/221:22:062
197818522117,2sleep20-21swapper/221:19:242
196693922117,2sleep20-21swapper/221:10:512
195429522117,2sleep20-21swapper/221:00:452
188889322117,2sleep20-21swapper/220:10:232
187475522117,2sleep20-21swapper/219:55:242
1812730992118,2cyclictest2234668-21apt-config00:10:001
1812730992118,2cyclictest2161396-21sendmail23:20:001
1812725992118,2cyclictest2100897-21/usr/sbin/munin22:40:010
1812725992110,6cyclictest0-21swapper/022:15:020
25010912017,2phc2sys0-21swapper/323:16:033
25010912017,2phc2sys0-21swapper/321:51:173
25010912017,2phc2sys0-21swapper/320:46:063
25010912017,2phc2sys0-21swapper/320:02:373
25010912017,2phc2sys0-21swapper/319:51:153
223045322017,2sleep20-21swapper/200:04:062
220293622017,2sleep20-21swapper/223:47:572
204985322017,2sleep20-21swapper/222:06:172
201864722017,2sleep20-21swapper/221:45:092
194850322017,2sleep20-21swapper/220:59:042
194230622017,2sleep20-21swapper/220:52:112
193638022017,2sleep20-21swapper/220:48:302
192395022017,2sleep20-21swapper/220:37:562
191804822017,2sleep30-21swapper/320:34:533
191776722017,2sleep20-21swapper/220:31:152
191180922017,2sleep20-21swapper/220:27:102
189424622017,2sleep20-21swapper/220:15:122
188153922017,2sleep20-21swapper/220:01:212
186355322017,2sleep20-21swapper/219:48:472
185744622017,2sleep20-21swapper/219:42:462
185118422017,2sleep20-21swapper/219:35:372
184531122017,2sleep20-21swapper/219:32:562
183276822017,2sleep20-21swapper/219:20:382
182132422017,2sleep20-21swapper/219:15:092
181860822017,2sleep20-21swapper/219:12:482
181273099208,3cyclictest0-21swapper/100:35:191
181272599206,9cyclictest1695-21dbus-daemon21:45:030
1812725992017,2cyclictest2191799-21sendmail23:40:000
1812725992017,2cyclictest2021930-21kworker/u16:3-rpciod00:40:010
1812725992017,2cyclictest1761-21gdbus21:35:020
1812725992012,7cyclictest0-21swapper/021:25:010
1812725992012,6cyclictest0-21swapper/023:55:010
1812730991916,2cyclictest1833469-21gpgconf19:25:021
1812730991911,4cyclictest2265845-21/usr/sbin/munin00:30:201
181272599198,6cyclictest0-21swapper/023:30:020
181272599197,7cyclictest0-21swapper/023:55:200
1812725991916,2cyclictest2253012-21apt-key00:20:010
1812725991916,2cyclictest2253012-21apt-key00:20:010
181272599191,2cyclictest2000478-21/usr/sbin/munin21:35:290
1812730991815,2cyclictest770595-21systemd-journal00:05:021
1812730991815,2cyclictest2082903-21systemd-run22:30:001
1812730991815,2cyclictest0-21swapper/119:40:011
181272599189,7cyclictest0-21swapper/019:20:010
181272599187,6cyclictest0-21swapper/022:35:020
181272599187,6cyclictest0-21swapper/021:10:000
181272599180,16cyclictest2039813-21sendmail22:00:000
924598170,2rtkit-daemon1960687-21diskmemload21:55:571
1812733991714,1cyclictest0-21swapper/223:05:012
181273099179,3cyclictest2018273-21latency_hist21:45:021
1812730991715,1cyclictest1960687-21diskmemload22:43:101
1812730991714,2cyclictest2262106-21systemd00:25:001
1812730991714,2cyclictest2174033-21latency_hist23:30:011
1812730991714,2cyclictest2021874-21systemd-run21:50:001
1812730991714,2cyclictest1696-1atopacctd21:53:241
1812730991713,3cyclictest1734-21rs:main1
1812730991713,3cyclictest0-21swapper/100:30:011
1812730991711,5cyclictest2193492-21irqrtprio23:40:241
1812730991710,3cyclictest2215188-21kthreadcore23:55:241
181272599177,6cyclictest0-21swapper/000:14:040
181272599176,6cyclictest0-21swapper/021:55:010
1812725991714,2cyclictest2182883-21latency_hist23:35:000
1812725991711,5cyclictest1851969-21tail19:40:170
181272599171,15cyclictest0-21swapper/022:40:210
1812725991710,4cyclictest1974983-21grep21:15:250
25010911611,3phc2sys0-21swapper/319:30:403
18843972160,1sleep10-21swapper/120:05:241
1812733991613,1cyclictest0-21swapper/222:33:162
1812733991613,1cyclictest0-21swapper/200:10:002
181273399160,11cyclictest0-21swapper/200:20:012
181273399160,11cyclictest0-21swapper/200:20:002
1812730991613,2cyclictest2191959-21systemd-run23:40:011
1812730991613,2cyclictest2140162-21latency_hist23:05:021
1812730991613,2cyclictest2092463-21aten2.4-expect22:35:161
1812730991613,2cyclictest1982263-21kthreadcore21:20:271
1812730991613,2cyclictest1978674-21systemd-run21:20:001
1812730991613,2cyclictest1969669-21munin-plugin-st21:15:011
1812730991613,2cyclictest1924727-21/usr/sbin/munin20:40:251
1812730991613,2cyclictest1812778-21apt-key19:10:011
1812730991613,2cyclictest0-21swapper/123:00:001
1812730991613,2cyclictest0-21swapper/122:10:001
1812730991612,3cyclictest2175794-21kthreadcore23:30:261
1812730991612,3cyclictest2021930-21kworker/u16:3+nfsiod22:10:351
181273099160,3cyclictest0-21swapper/123:07:511
181272599168,2cyclictest0-21swapper/022:55:140
1812725991613,2cyclictest2065902-21kthreadcore22:15:260
1812725991613,2cyclictest1969907-21munin-plugin-st21:15:020
1812725991613,2cyclictest1936547-21perf20:50:000
1812725991613,2cyclictest1890996-21kthreadcore20:10:280
1812725991613,2cyclictest1696-1atopacctd22:00:470
1812725991612,2cyclictest0-21swapper/022:55:020
181272599160,15cyclictest2167053-21ssh23:20:280
181273399151,8cyclictest0-21swapper/219:30:012
1812733991513,1cyclictest0-21swapper/220:45:012
1812733991513,1cyclictest0-21swapper/200:25:002
1812733991512,1cyclictest0-21swapper/223:40:292
1812733991512,1cyclictest0-21swapper/223:35:212
1812733991512,1cyclictest0-21swapper/221:40:002
1812733991511,2cyclictest0-21swapper/200:26:302
1812733991511,2cyclictest0-21swapper/200:00:012
181273099157,3cyclictest0-21swapper/122:00:231
1812730991512,2cyclictest1991217-21latency_hist21:30:011
1812730991512,2cyclictest1954956-21/usr/sbin/munin21:05:281
1812730991512,2cyclictest0-21swapper/120:40:021
1812730991511,3cyclictest2073262-21kthreadcore22:20:281
1812730991511,3cyclictest2070167-21kworker/u16:0+nfsiod22:32:051
1812730991511,3cyclictest2004600-21kthreadcore21:35:251
1812730991511,3cyclictest1991358-21kworker/u16:2+nfsiod21:33:211
1812730991511,3cyclictest1877517-21kthreadcore20:00:231
1812730991511,3cyclictest1815988-21kthreadcore19:10:251
1812730991510,2cyclictest178850irq/121-eno122:50:041
181272599159,5cyclictest1812723-21cyclictest23:00:200
181272599159,2cyclictest0-21swapper/020:27:300
181272599155,4cyclictest1839225-21sshd19:27:300
181272599151,8cyclictest1882185-21apt-get20:05:170
1812725991513,1cyclictest0-21swapper/022:50:010
1812725991512,2cyclictest2170619-21kworker/u16:0-rpciod23:50:000
1812725991512,2cyclictest1991351-21sh21:30:020
1812725991512,2cyclictest1924547-21sh20:40:010
1812725991512,2cyclictest1812723-21cyclictest23:10:130
1812725991512,2cyclictest1726-21systemd-logind20:25:010
1812725991512,2cyclictest1695-21dbus-daemon20:55:020
1812725991512,2cyclictest0-21swapper/022:10:010
1812725991512,2cyclictest0-21swapper/020:00:010
1812725991512,2cyclictest0-21swapper/019:50:010
1812725991511,3cyclictest1991358-21kworker/u16:2+nfsiod21:48:310
1812725991511,3cyclictest1696-1atopacctd19:20:320
1812725991511,2cyclictest0-21swapper/023:10:000
181272599150,2cyclictest178850irq/121-eno123:40:160
181273099147,5cyclictest770595-21systemd-journal20:32:311
1812730991411,2cyclictest2206996-21kthreadcore23:50:191
1812730991411,2cyclictest2166939-21ptp4l23:20:281
1812730991411,2cyclictest212-21jbd2/sda2-821:00:261
1812730991411,2cyclictest1907436-21irqcore20:25:221
1812730991411,2cyclictest1895364-21irqcore20:15:231
1812730991411,2cyclictest1889318-21irqrtprio20:10:251
1812730991411,2cyclictest1874787-21phc2sys19:55:241
1812730991411,2cyclictest1835026-21kthreadcore19:25:241
1812730991410,3cyclictest2021930-21kworker/u16:3+nfsiod23:47:031
1812730991410,3cyclictest2021930-21kworker/u16:3+nfsiod22:16:431
1812730991410,3cyclictest1901438-21irqrtprio20:20:231
1812730991410,3cyclictest1841041-21irqrtprio19:30:251
181273099140,3cyclictest0-21swapper/119:44:561
181272599145,5cyclictest0-21swapper/000:00:250
181272599145,2cyclictest0-21swapper/020:15:180
181272599141,7cyclictest0-21swapper/000:30:110
181272599141,5cyclictest0-21swapper/000:30:010
1812725991411,2cyclictest2076329-21unixbench-2d22:20:340
1812725991411,2cyclictest1912556-21aten2.4-expect20:30:210
1812725991411,2cyclictest1845869-21aten2.4-expect19:35:170
1812725991411,2cyclictest1695-21dbus-daemon19:15:020
1812725991410,2cyclictest0-21swapper/020:55:300
1812733991311,1cyclictest0-21swapper/223:21:462
1812733991311,1cyclictest0-21swapper/223:10:012
1812733991311,1cyclictest0-21swapper/222:30:002
1812733991310,1cyclictest0-21swapper/220:20:232
1812733991310,1cyclictest0-21swapper/220:05:232
1812733991310,1cyclictest0-21swapper/219:50:202
181273099135,7cyclictest2235270-1ssh00:10:111
1812730991310,2cyclictest1864366-21cstates19:50:221
1812730991310,2cyclictest1827379-21unin-run19:20:021
1812730991310,2cyclictest0-21swapper/119:45:171
181272599131,7cyclictest1839755-21/usr/sbin/munin19:30:240
1812725991310,2cyclictest1930508-21systemd20:45:010
181272599130,8cyclictest1948926-21/usr/sbin/munin21:00:160
181273399121,6cyclictest0-21swapper/221:05:162
181273099129,2cyclictest1944183-21kthreadcore20:55:231
181273099128,3cyclictest1931814-21irqcore20:45:231
181272599129,2cyclictest1877404-21kthreadcore20:00:240
181272599125,2cyclictest11systemd19:55:010
2501091110,2phc2sys0-21swapper/322:45:073
181272599104,1cyclictest1696068-21kworker/0:0+mm_percpu_wq19:10:010
250109180,2phc2sys0-21swapper/323:36:253
250109180,2phc2sys0-21swapper/319:10:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional