You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-04-02 - 08:10
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rackeslot2.osadl.org (updated Wed Apr 02, 2025 00:43:57)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
45027321140,2sleep30-21swapper/300:15:013
40725421100,1sleep00-21swapper/023:45:000
6346121090,2sleep20-21swapper/219:30:332
3139099341,3cyclictest428878-40mandb00:00:010
31391993217,10cyclictest0-21swapper/122:35:011
31391993216,9cyclictest0-21swapper/122:30:011
31391993216,11cyclictest0-21swapper/119:15:021
31391992820,7cyclictest198923-21apt-config21:30:001
31391992711,9cyclictest320860-21kworker/u16:1+nfsiod23:15:491
31390992720,2cyclictest350688-21munin-run23:10:000
31390992716,10cyclictest232853-21kthreadcore21:50:190
31391992617,7cyclictest0-21swapper/121:10:021
31390992620,2cyclictest770595-21systemd-journal22:20:010
31390992615,7cyclictest480575-21latency_hist00:35:010
3139199253,15cyclictest244884-21sh21:56:151
31391992510,8cyclictest320860-21kworker/u16:1+nfsiod23:28:321
25010912518,3phc2sys0-21swapper/322:35:223
25010912518,2phc2sys0-21swapper/323:50:093
25010912518,2phc2sys0-21swapper/322:49:263
25010912518,2phc2sys0-21swapper/322:11:583
25010912518,2phc2sys0-21swapper/321:51:543
25010912518,2phc2sys0-21swapper/321:40:083
3139199249,7cyclictest0-21swapper/123:45:011
31391992421,2cyclictest0-21swapper/100:20:011
3139199241,13cyclictest437470-21ssh00:04:341
25010912418,2phc2sys0-21swapper/321:59:243
25010912417,2phc2sys0-21swapper/323:38:153
25010912417,2phc2sys0-21swapper/323:27:203
25010912417,2phc2sys0-21swapper/321:38:363
25010912417,2phc2sys0-21swapper/321:17:403
25010912417,2phc2sys0-21swapper/319:40:003
25010912417,2phc2sys0-21swapper/300:07:453
3139199235,9cyclictest168399-21diskmemload22:41:271
3139199234,14cyclictest374728-21sh23:21:021
3139199234,13cyclictest168399-21diskmemload23:01:561
31391992315,7cyclictest69961-21grep19:40:001
3139199231,17cyclictest329833-21taskset22:55:121
3139199231,13cyclictest75814-21seq19:42:411
3139199231,13cyclictest487303-21taskset00:36:451
3139199231,13cyclictest470797-21ssh00:28:451
3139199231,13cyclictest465443-21ssh00:20:511
3139199231,13cyclictest447658-21ssh00:11:011
3139199231,13cyclictest398136-21taskset23:39:371
3139199231,13cyclictest350026-21taskset23:09:031
3139199231,13cyclictest225231-21runrttasks21:43:421
3139199231,13cyclictest205112-21taskset21:30:311
3139199231,13cyclictest185410-21taskset21:18:171
3139199231,13cyclictest131617-21taskset20:37:011
3139199231,13cyclictest118820-21taskset20:22:061
3139199231,12cyclictest410642-21ssh23:49:311
3139199230,18cyclictest57761-21taskset19:28:401
3139199230,18cyclictest388360-21seq23:33:061
3139199230,18cyclictest100151-21seq20:04:091
3139199230,13cyclictest258930-21ssh22:08:561
25010912318,3phc2sys0-21swapper/322:16:263
25010912318,3phc2sys0-21swapper/321:14:383
25010912317,3phc2sys0-21swapper/323:44:233
25010912317,3phc2sys0-21swapper/323:20:073
25010912317,3phc2sys0-21swapper/322:51:493
25010912317,3phc2sys0-21swapper/322:42:233
25010912317,2phc2sys0-21swapper/323:56:313
25010912317,2phc2sys0-21swapper/322:55:273
25010912317,2phc2sys0-21swapper/322:08:223
25010912317,2phc2sys0-21swapper/320:57:043
25010912317,2phc2sys0-21swapper/320:38:363
25010912317,2phc2sys0-21swapper/320:27:463
25010912317,2phc2sys0-21swapper/320:16:073
25010912317,2phc2sys0-21swapper/320:16:073
25010912317,2phc2sys0-21swapper/320:13:073
25010912317,2phc2sys0-21swapper/320:06:413
25010912317,2phc2sys0-21swapper/320:04:213
25010912317,2phc2sys0-21swapper/319:55:313
25010912317,2phc2sys0-21swapper/319:52:513
25010912317,2phc2sys0-21swapper/319:43:493
25010912317,2phc2sys0-21swapper/319:20:373
25010912317,2phc2sys0-21swapper/319:10:433
25010912317,2phc2sys0-21swapper/300:16:273
47152122218,2sleep30-21swapper/300:29:533
34894622218,2sleep20-21swapper/223:07:232
31392992219,1cyclictest0-21swapper/220:40:012
3139199225,8cyclictest168399-21diskmemload21:10:041
3139199223,14cyclictest156160-21taskset20:58:571
31391992213,8cyclictest247733-21acpi22:00:141
3139199221,16cyclictest87779-21taskset19:51:131
3139199221,16cyclictest283723-21sh22:20:461
3139199221,16cyclictest125503-21seq20:31:141
3139199221,16cyclictest119474-21taskset20:26:321
3139199221,16cyclictest112685-21taskset20:16:011
3139199221,16cyclictest112685-21taskset20:16:011
3139199221,15cyclictest472091-21ssh00:30:151
3139199221,15cyclictest226998-21ssh21:46:001
3139199221,13cyclictest269167-21aten2.4-expect22:15:171
3139199221,12cyclictest426741-21sh23:56:421
3139199221,12cyclictest356658-21taskset23:10:311
3139199221,12cyclictest329152-21ssh22:54:391
3139199221,12cyclictest265973-21seq22:11:011
3139199221,12cyclictest235715-21ssh21:50:461
3139199221,12cyclictest1992-21runrttasks22:35:351
3139199221,12cyclictest192943-21taskset21:21:091
3139199220,17cyclictest143861-21taskset20:45:471
3139199220,14cyclictest417448-21ssh23:51:131
3139199220,13cyclictest439048-21taskset00:06:301
3139199220,13cyclictest318238-21taskset22:46:181
3139199220,13cyclictest215834-21taskset21:37:541
3139199220,13cyclictest161397-21taskset21:00:261
3139199220,13cyclictest149876-21seq20:50:381
3139199220,13cyclictest100652-21taskset20:06:351
29802322217,3sleep30-21swapper/322:33:303
25352222218,2sleep30-21swapper/322:00:553
25010912217,3phc2sys0-21swapper/323:30:453
25010912217,3phc2sys0-21swapper/323:00:233
25010912217,3phc2sys0-21swapper/322:25:163
25010912217,3phc2sys0-21swapper/322:24:203
25010912217,3phc2sys0-21swapper/321:04:083
25010912217,3phc2sys0-21swapper/320:50:423
25010912217,3phc2sys0-21swapper/320:43:043
25010912217,3phc2sys0-21swapper/320:31:543
25010912217,3phc2sys0-21swapper/319:49:203
25010912217,3phc2sys0-21swapper/319:16:393
25010912217,3phc2sys0-21swapper/300:23:393
19281322218,2sleep30-21swapper/321:20:593
48908522117,2sleep20-21swapper/200:39:342
47781322117,2sleep20-21swapper/200:30:442
4713422117,2sleep20-21swapper/219:20:242
46761622117,2sleep20-21swapper/200:24:152
45743622117,2sleep20-21swapper/200:17:252
44880622117,2sleep20-21swapper/200:12:482
41826222117,2sleep20-21swapper/223:52:282
40460522117,2sleep20-21swapper/223:40:502
39493522117,2sleep20-21swapper/223:35:292
37808122117,2sleep20-21swapper/223:25:552
35859022117,2sleep20-21swapper/223:13:332
32660022117,2sleep20-21swapper/222:50:362
31481922117,2sleep20-21swapper/222:41:222
3139199211,12cyclictest76314-21taskset19:45:081
3139199211,11cyclictest59076-21runrttasks19:30:251
3139199211,11cyclictest39910-21runrttasks19:15:061
3139199211,11cyclictest137848-21taskset20:40:591
3139199210,12cyclictest93787-21taskset19:55:381
3139199210,12cyclictest51408-21seq19:20:411
3139199210,12cyclictest1992-21runrttasks20:10:151
31390992118,2cyclictest168700-21apt-key21:10:010
29963622117,2sleep20-21swapper/222:35:082
29678722117,2sleep20-21swapper/222:31:322
28537822117,2sleep20-21swapper/222:23:232
27657622117,2sleep20-21swapper/222:18:332
26722622117,2sleep20-21swapper/222:13:012
25700122117,2sleep20-21swapper/222:05:552
25343422117,2sleep20-21swapper/222:00:462
25010912117,2phc2sys0-21swapper/323:49:273
25010912117,2phc2sys0-21swapper/323:15:163
25010912117,2phc2sys0-21swapper/323:09:503
25010912117,2phc2sys0-21swapper/321:45:143
25010912117,2phc2sys0-21swapper/319:28:433
25010912117,2phc2sys0-21swapper/300:32:153
25010912117,2phc2sys0-21swapper/300:00:413
22745922117,2sleep20-21swapper/221:46:432
22545022117,2sleep20-21swapper/221:44:032
20593022117,2sleep20-21swapper/221:31:442
18395322117,2sleep20-21swapper/221:16:012
11808622117,2sleep20-21swapper/220:20:272
10659222117,2sleep20-21swapper/220:10:292
9389322017,2sleep20-21swapper/219:57:032
8183622017,2sleep20-21swapper/219:47:372
7583722017,2sleep20-21swapper/219:43:002
6970122017,2sleep20-21swapper/219:37:112
5778722017,2sleep20-21swapper/219:29:012
48909622017,2sleep30-21swapper/300:39:353
46888122017,2sleep20-21swapper/200:25:432
4550722017,2sleep20-21swapper/219:17:552
43553622017,2sleep20-21swapper/200:01:302
40846022017,2sleep20-21swapper/223:46:072
3731722017,2sleep20-21swapper/219:14:232
33585122017,2sleep20-21swapper/222:56:092
31390992014,5cyclictest192173-21/usr/sbin/munin21:20:300
31390992012,4cyclictest0-21swapper/022:55:020
25010912017,2phc2sys0-21swapper/321:26:063
25010912017,2phc2sys0-21swapper/321:05:063
25010912017,2phc2sys0-21swapper/320:46:043
25010912017,2phc2sys0-21swapper/319:31:013
21691722017,2sleep20-21swapper/221:39:382
20667722017,2sleep30-21swapper/321:32:543
19595522017,2sleep20-21swapper/221:25:272
17590622017,2sleep20-21swapper/221:12:292
16809722017,2sleep20-21swapper/221:06:152
15659022017,2sleep20-21swapper/221:00:142
15615522017,2sleep20-21swapper/220:58:542
14990922017,2sleep20-21swapper/220:51:052
13806822017,2sleep20-21swapper/220:43:512
12560522017,2sleep20-21swapper/220:32:332
11941122017,2sleep20-21swapper/220:25:442
11291522017,2sleep20-21swapper/220:18:592
11291522017,2sleep20-21swapper/220:18:592
10012922017,2sleep20-21swapper/220:03:522
3139099198,6cyclictest0-21swapper/022:20:240
31390991916,2cyclictest377247-21idleruntime-cro23:25:000
31390991916,2cyclictest208036-21latency_hist21:35:020
3139099191,14cyclictest0-21swapper/023:46:580
31390991910,5cyclictest241686-21kthreadcore21:55:250
3139099187,7cyclictest1726-21systemd-logind00:10:020
3139099187,6cyclictest0-21swapper/021:15:230
31390991815,2cyclictest31388-21cyclictest00:15:260
31390991815,2cyclictest0-21swapper/021:50:020
31390991815,2cyclictest0-21swapper/020:40:010
3139099181,2cyclictest0-21swapper/022:41:330
3139099181,15cyclictest94477-21/usr/sbin/munin20:00:210
31390991810,4cyclictest70399-21tail19:40:180
31392991714,1cyclictest0-21swapper/221:55:262
31392991714,1cyclictest0-21swapper/221:20:262
3139099179,4cyclictest93780-21kworker/u16:2-rpciod21:10:230
3139099179,4cyclictest250602-21kthreadcore22:00:230
3139099178,5cyclictest1707-21polkitd00:25:010
31390991714,2cyclictest45851-21cut19:20:020
31390991714,2cyclictest320743-21grep22:50:010
31390991714,2cyclictest110231-21kthreadcore20:15:250
31390991714,2cyclictest110231-21kthreadcore20:15:250
31390991711,5cyclictest413851-21kthreadcore23:50:190
31390991711,5cyclictest340667-21kthreadcore23:00:240
31390991711,5cyclictest31388-21cyclictest19:25:200
31392991613,1cyclictest0-21swapper/223:00:202
3139099169,2cyclictest0-21swapper/021:40:220
3139099168,7cyclictest0-21swapper/021:40:000
3139099168,2cyclictest0-21swapper/022:55:290
3139099167,5cyclictest0-21swapper/000:00:240
3139099164,7cyclictest387421-21diskmemload23:31:380
3139099164,7cyclictest358280-21diskmemload23:13:030
3139099164,7cyclictest299672-21diskmemload22:35:110
31390991613,2cyclictest88185-21systemd-run19:55:010
31390991613,2cyclictest770595-21systemd-journal23:30:020
31390991613,2cyclictest442347-21sh00:10:140
31390991613,2cyclictest0-21swapper/020:00:010
31390991613,2cyclictest0-21swapper/019:50:020
31392991513,1cyclictest0-21swapper/223:30:152
31392991513,1cyclictest0-21swapper/223:20:022
31392991513,1cyclictest0-21swapper/200:00:012
3139199151,12cyclictest31348-21munin-run19:10:011
3139099157,4cyclictest0-21swapper/023:15:160
3139099157,2cyclictest0-21swapper/021:27:280
3139099156,4cyclictest0-21swapper/000:30:010
31390991513,1cyclictest31388-21cyclictest22:30:160
31390991512,2cyclictest290317-21latency_hist22:30:010
31390991512,2cyclictest161354-21needreboot21:00:260
31390991512,2cyclictest144236-21perf20:50:010
31390991512,2cyclictest1-21systemd19:15:010
31390991511,3cyclictest262437-21kthreadcore22:10:190
31392991412,1cyclictest0-21swapper/223:21:482
31392991411,1cyclictest0-21swapper/220:45:212
3139099143,6cyclictest0-21swapper/020:08:250
3139099142,7cyclictest0-21swapper/020:26:260
31390991411,2cyclictest481664-21sh00:35:240
31390991411,2cyclictest47348-21kthreadcore19:20:240
31390991411,2cyclictest149028-21kthreadcore20:50:310
31390991411,2cyclictest0-21swapper/019:35:000
31390991410,3cyclictest66758-21kthreadcore19:35:240
31390991410,3cyclictest393982-21kthreadcore23:35:260
31390991410,3cyclictest156488-21kworker/u16:0+nfsiod22:08:180
31392991311,1cyclictest0-21swapper/222:50:012
31392991310,1cyclictest0-21swapper/222:27:592
31392991310,1cyclictest0-21swapper/221:54:222
3139099131,7cyclictest116177-21grep20:20:240
31390991310,2cyclictest154923-21kthreadcore20:55:240
31390991310,2cyclictest133205-21head20:40:210
31390991310,2cyclictest105521-21kthreadcore20:10:220
3139299129,1cyclictest0-21swapper/200:07:062
3139099129,2cyclictest120219-21aten_repower_po20:30:130
3139299119,1cyclictest0-21swapper/219:50:232
3139099111,4cyclictest31228-21latency_hist19:10:020
255652110,5sleep20-21swapper/219:05:172
2501091119,1phc2sys0-21swapper/320:22:153
3139299107,1cyclictest0-21swapper/220:10:002
250109190,2phc2sys0-21swapper/319:05:183
250109190,1phc2sys0-21swapper/323:10:223
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional