You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-11-23 - 17:07
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackeslot2.osadl.org (updated Sat Nov 23, 2024 12:43:59)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
339996421580,1sleep03399968-21kthreadcore07:15:210
349613521050,2sleep30-21swapper/308:35:193
362919521020,3sleep30-21swapper/310:05:003
2500991330,5ptp4l186990irq/129-enp1s0-TxRx-007:35:163
3386816993126,3cyclictest1695-21dbus-daemon12:40:010
2500991270,5ptp4l186990irq/129-enp1s0-TxRx-007:50:093
2500991270,3ptp4l186990irq/129-enp1s0-TxRx-007:14:033
338681899262,4cyclictest0-21swapper/212:00:012
2500991260,5ptp4l186990irq/129-enp1s0-TxRx-011:55:283
2500991260,5ptp4l186990irq/129-enp1s0-TxRx-008:07:593
2500991260,3ptp4l186990irq/129-enp1s0-TxRx-008:51:443
2500991250,5ptp4l186990irq/129-enp1s0-TxRx-012:29:443
2500991250,5ptp4l186990irq/129-enp1s0-TxRx-009:40:323
2500991250,5ptp4l186990irq/129-enp1s0-TxRx-008:35:023
2500991250,3ptp4l186990irq/129-enp1s0-TxRx-011:35:453
2500991250,3ptp4l186990irq/129-enp1s0-TxRx-010:08:063
3386816992421,2cyclictest9244-21rtkit-daemon10:30:560
2500991240,6ptp4l186990irq/129-enp1s0-TxRx-007:15:123
2500991240,5ptp4l186990irq/129-enp1s0-TxRx-012:31:403
2500991240,5ptp4l186990irq/129-enp1s0-TxRx-009:10:183
2500991240,5ptp4l186990irq/129-enp1s0-TxRx-009:05:003
2500991240,5ptp4l186990irq/129-enp1s0-TxRx-008:10:123
2500991240,5ptp4l186990irq/129-enp1s0-TxRx-007:45:143
2500991240,5ptp4l186990irq/129-enp1s0-TxRx-007:45:013
2500991240,4ptp4l186990irq/129-enp1s0-TxRx-012:11:343
2500991240,4ptp4l186990irq/129-enp1s0-TxRx-008:50:013
2500991240,4ptp4l186990irq/129-enp1s0-TxRx-008:43:533
2500991240,4ptp4l186990irq/129-enp1s0-TxRx-008:15:133
2500991240,1ptp4l0-21swapper/312:06:033
3386818992320,1cyclictest0-21swapper/207:25:012
3386818992320,1cyclictest0-21swapper/207:25:002
3386816992320,2cyclictest1695-21dbus-daemon12:30:010
2500991230,5ptp4l186990irq/129-enp1s0-TxRx-012:37:493
2500991230,5ptp4l186990irq/129-enp1s0-TxRx-011:45:143
2500991230,5ptp4l186990irq/129-enp1s0-TxRx-011:15:003
2500991230,5ptp4l186990irq/129-enp1s0-TxRx-011:00:563
2500991230,5ptp4l186990irq/129-enp1s0-TxRx-010:50:143
2500991230,5ptp4l186990irq/129-enp1s0-TxRx-009:38:203
2500991230,5ptp4l186990irq/129-enp1s0-TxRx-009:17:093
2500991230,5ptp4l186990irq/129-enp1s0-TxRx-008:29:303
2500991230,5ptp4l186990irq/129-enp1s0-TxRx-008:25:013
2500991230,5ptp4l186990irq/129-enp1s0-TxRx-007:30:153
2500991230,5ptp4l186990irq/129-enp1s0-TxRx-007:25:003
2500991230,5ptp4l186990irq/129-enp1s0-TxRx-007:25:003
2500991230,5ptp4l186990irq/129-enp1s0-TxRx-007:05:123
2500991230,4ptp4l186990irq/129-enp1s0-TxRx-012:17:213
2500991230,4ptp4l186990irq/129-enp1s0-TxRx-008:00:013
2500991230,3ptp4l186990irq/129-enp1s0-TxRx-010:47:123
2500991230,3ptp4l186990irq/129-enp1s0-TxRx-009:52:443
3386818992220,1cyclictest0-21swapper/209:50:012
3386816992214,5cyclictest3787306-21/usr/sbin/munin11:40:190
3386816992214,4cyclictest1707-21polkitd10:40:020
2500991220,6ptp4l186990irq/129-enp1s0-TxRx-010:10:183
2500991220,5ptp4l186990irq/129-enp1s0-TxRx-011:41:493
2500991220,5ptp4l186990irq/129-enp1s0-TxRx-011:25:133
2500991220,5ptp4l186990irq/129-enp1s0-TxRx-009:56:563
2500991220,5ptp4l186990irq/129-enp1s0-TxRx-009:45:343
2500991220,4ptp4l186990irq/129-enp1s0-TxRx-011:06:213
2500991220,4ptp4l186990irq/129-enp1s0-TxRx-010:18:353
2500991220,4ptp4l186990irq/129-enp1s0-TxRx-009:10:013
2500991220,3ptp4l186990irq/129-enp1s0-TxRx-010:55:553
2500991220,3ptp4l186990irq/129-enp1s0-TxRx-010:55:553
2500991220,3ptp4l186990irq/129-enp1s0-TxRx-010:27:473
2500991220,2ptp4l0-21swapper/309:20:133
2500991220,2ptp4l0-21swapper/307:30:003
388777322117,2sleep20-21swapper/212:36:182
384482122117,2sleep20-21swapper/212:10:492
382659022117,2sleep20-21swapper/212:00:232
380970322117,2sleep20-21swapper/211:50:252
374858822117,2sleep20-21swapper/211:13:342
373892822117,2sleep20-21swapper/211:06:302
372221322117,2sleep20-21swapper/210:57:162
372221322117,2sleep20-21swapper/210:57:152
369563222117,2sleep20-21swapper/210:40:322
367051222117,2sleep20-21swapper/210:26:412
366212422117,2sleep20-21swapper/210:22:082
365481622117,2sleep20-21swapper/210:19:232
363579022117,2sleep20-21swapper/210:06:092
357798322117,2sleep20-21swapper/209:35:062
357568822117,2sleep20-21swapper/209:31:382
356616722117,2sleep20-21swapper/209:25:252
355813522117,2sleep20-21swapper/209:20:482
355058822117,2sleep20-21swapper/209:17:552
354127522117,2sleep20-21swapper/209:12:062
349789322117,2sleep20-21swapper/208:36:192
347987422117,2sleep20-21swapper/208:22:262
344812122117,2sleep20-21swapper/207:55:202
344176022117,2sleep20-21swapper/207:50:202
338853622117,2sleep20-21swapper/207:10:192
3386817992118,2cyclictest3787017-21systemd-run11:40:001
3386816992118,2cyclictest1-21systemd09:20:000
3386816992115,1cyclictest0-21swapper/010:17:270
2500991210,5ptp4l186990irq/129-enp1s0-TxRx-011:32:073
2500991210,5ptp4l186990irq/129-enp1s0-TxRx-009:27:473
2500991210,5ptp4l186990irq/129-enp1s0-TxRx-008:04:503
2500991210,4ptp4l186990irq/129-enp1s0-TxRx-012:02:573
2500991210,4ptp4l186990irq/129-enp1s0-TxRx-010:32:353
2500991210,2ptp4l0-21swapper/310:35:163
385387122017,2sleep20-21swapper/212:16:502
353418222017,2sleep20-21swapper/209:06:572
352218622017,2sleep20-21swapper/208:58:032
352218622017,2sleep20-21swapper/208:58:032
351602422017,2sleep20-21swapper/208:51:102
350402422017,2sleep20-21swapper/208:42:132
349188022017,2sleep20-21swapper/208:31:592
348576122017,2sleep20-21swapper/208:25:412
347380522017,2sleep20-21swapper/208:17:202
346743322017,2sleep20-21swapper/208:10:512
346145922017,2sleep20-21swapper/208:07:022
345547722017,2sleep20-21swapper/208:03:062
343722122017,2sleep20-21swapper/207:46:382
343140422017,2sleep20-21swapper/207:44:352
341315622017,2sleep20-21swapper/207:29:232
3386817992017,2cyclictest3467756-21cron08:15:001
338681699209,6cyclictest0-21swapper/010:25:150
338681699206,10cyclictest0-21swapper/008:25:180
3386816992017,2cyclictest3553650-21cut09:20:190
3386816992012,7cyclictest0-21swapper/011:30:020
338681699200,18cyclictest3715258-21latency_hist10:55:000
2500991200,4ptp4l186990irq/129-enp1s0-TxRx-011:51:263
2500991200,4ptp4l186990irq/129-enp1s0-TxRx-011:21:123
2500991200,4ptp4l186990irq/129-enp1s0-TxRx-011:17:193
2500991200,3ptp4l186990irq/129-enp1s0-TxRx-010:41:493
2500991200,3ptp4l186990irq/129-enp1s0-TxRx-009:30:533
2500991200,2ptp4l0-21swapper/310:21:573
2500991200,1ptp4l0-21swapper/312:23:233
3386817991917,1cyclictest3594792-21cron09:45:001
3386817991916,2cyclictest3838862-21ssh12:10:021
3386817991916,2cyclictest1696-1atopacctd11:40:221
3386817991916,2cyclictest0-21swapper/111:10:001
3386817991912,2cyclictest1312-21hwrng10:43:571
3386817991912,1cyclictest191rcu_preempt12:17:291
3386816991917,1cyclictest3386810-21cyclictest09:35:020
3386816991916,2cyclictest178850irq/121-eno111:03:040
3386816991916,2cyclictest178850irq/121-eno109:28:250
338681699191,4cyclictest3741385-21ssh11:10:130
3386816991912,6cyclictest3739550-21runrttasks11:07:310
3386818991815,1cyclictest0-21swapper/211:05:002
338681799184,4cyclictest3577681-21kworker/1:1+events10:04:171
338681799183,4cyclictest3577681-21kworker/1:1+events09:53:391
3386817991815,2cyclictest3522519-21systemd-run09:00:011
3386817991815,2cyclictest3522519-21systemd-run09:00:011
3386817991815,2cyclictest1726-21systemd-logind09:35:011
3386817991814,1cyclictest191rcu_preempt11:50:541
3386817991811,3cyclictest3647263-21/usr/sbin/munin10:15:151
3386817991811,1cyclictest601rcuop/311:45:361
338681699189,5cyclictest3629575-21latency_hist10:05:020
338681699184,3cyclictest3702542-21kthreadcore10:45:190
3386816991815,2cyclictest1-21systemd11:40:000
3386816991815,2cyclictest0-21swapper/012:20:000
3386816991814,2cyclictest3393612-21kthreadcore07:15:020
3386816991812,5cyclictest1992-21runrttasks11:16:440
338681699181,1cyclictest0-21swapper/010:08:280
338681699180,2cyclictest3578628-21df_inode09:35:140
2500991180,4ptp4l186990irq/129-enp1s0-TxRx-008:56:333
2500991180,4ptp4l186990irq/129-enp1s0-TxRx-008:56:323
338681899171,8cyclictest0-21swapper/212:10:012
3386818991714,1cyclictest0-21swapper/210:35:442
3386818991714,1cyclictest0-21swapper/210:15:002
3386818991714,1cyclictest0-21swapper/207:35:012
338681799179,3cyclictest0-21swapper/109:15:011
338681799178,3cyclictest501rcuop/210:14:031
338681799177,3cyclictest501rcuop/210:52:511
3386817991715,1cyclictest3890164-21/usr/sbin/munin12:40:021
3386817991714,2cyclictest3724137-21latency_hist11:00:011
3386817991714,2cyclictest3724137-21latency_hist11:00:011
3386817991714,2cyclictest3516596-21systemd-run08:55:011
3386817991714,2cyclictest3386810-21cyclictest12:00:191
3386817991714,2cyclictest1-21systemd10:30:021
3386817991714,2cyclictest0-21swapper/109:20:001
338681699177,6cyclictest3691757-21kthreadcore10:40:190
3386816991714,2cyclictest3847216-21/usr/sbin/munin12:15:010
3386816991710,2cyclictest3392926-21munin-node08:14:140
338681699170,6cyclictest3801897-21sshd11:46:130
36121972160,1sleep20-21swapper/209:55:012
3386818991613,1cyclictest0-21swapper/212:35:002
3386818991613,1cyclictest0-21swapper/211:30:022
3386818991612,2cyclictest0-21swapper/211:20:172
3386818991612,1cyclictest0-21swapper/210:50:012
338681899161,10cyclictest0-21swapper/210:00:012
338681899160,13cyclictest0-21swapper/210:50:102
338681799169,1cyclictest601rcuop/311:01:561
338681799169,1cyclictest601rcuop/309:55:551
338681799169,1cyclictest601rcuop/309:04:081
338681799168,1cyclictest17350irq/127-ahci[0000:00:17.0]07:15:021
338681799167,3cyclictest501rcuop/211:55:101
338681799167,3cyclictest501rcuop/210:47:411
338681799167,3cyclictest501rcuop/208:26:011
338681799164,8cyclictest3795781-21kworker/u16:3+xprtiod12:12:041
338681799164,8cyclictest3492039-21kworker/u16:1+xprtiod10:21:141
338681799162,8cyclictest3760938-21cut11:20:191
3386817991613,2cyclictest3873100-21/usr/sbin/munin12:30:011
3386817991613,2cyclictest3569167-21systemd-run09:30:011
3386817991613,2cyclictest3386810-21cyclictest11:15:211
3386817991610,2cyclictest178850irq/121-eno111:30:151
338681699169,6cyclictest3859921-21kthreadcore12:20:210
338681699169,6cyclictest0-21swapper/011:50:120
338681699168,4cyclictest3758622-21head11:20:120
338681699168,2cyclictest0-21swapper/011:30:130
338681699167,4cyclictest1696-1atopacctd12:05:240
338681699167,2cyclictest0-21swapper/011:55:200
338681699165,6cyclictest3656967-21ps10:20:210
3386816991613,2cyclictest3594796-21cron09:45:010
3386816991613,2cyclictest3504270-21dump-pmu-power08:45:000
3386816991613,2cyclictest2015-21snmpd08:45:170
3386816991612,3cyclictest3720036-21kthreadcore10:55:200
3386816991612,3cyclictest3720036-21kthreadcore10:55:200
3386816991610,5cyclictest3595264-21aten2.4-expect09:45:120
338681699160,7cyclictest3475336-21irqcore08:20:170
338681699160,4cyclictest3620595-21perf10:00:000
338681899151,8cyclictest0-21swapper/207:20:022
3386818991513,1cyclictest0-21swapper/210:30:242
3386818991512,1cyclictest0-21swapper/211:18:442
3386818991512,1cyclictest0-21swapper/208:46:012
338681799158,1cyclictest601rcuop/311:10:571
338681799157,3cyclictest501rcuop/211:26:161
338681799157,3cyclictest501rcuop/208:15:431
338681799157,3cyclictest501rcuop/208:00:091
338681799157,3cyclictest501rcuop/207:36:001
338681799157,1cyclictest601rcuop/308:35:151
338681799157,1cyclictest191rcu_preempt12:20:271
338681799156,3cyclictest501rcuop/208:05:291
338681799156,3cyclictest501rcuop/207:29:271
338681799155,3cyclictest0-21swapper/107:55:241
338681799153,5cyclictest36-21ksoftirqd/112:34:111
3386817991513,1cyclictest9244-21rtkit-daemon09:08:291
3386817991512,2cyclictest3634977-21mailstats10:05:251
3386817991512,2cyclictest3486749-21cpuspeed_turbos08:30:151
3386817991512,2cyclictest3393244-21kthreadcore07:15:041
3386817991510,4cyclictest341rcuc/109:45:171
3386817991510,1cyclictest191rcu_preempt10:37:051
338681799150,3cyclictest0-21swapper/107:21:301
338681799150,3cyclictest0-21swapper/107:21:291
338681699157,2cyclictest0-21swapper/009:50:220
3386816991514,1cyclictest3558736-21kworker/u16:0+events_freezable_pwr_efficient10:13:540
3386816991513,1cyclictest9244-21rtkit-daemon08:37:460
3386816991512,2cyclictest3386810-21cyclictest08:30:200
3386816991511,3cyclictest3449569-21perf08:00:010
3386816991511,3cyclictest1761-21gdbus07:30:020
3386818991411,1cyclictest0-21swapper/212:20:142
3386818991411,1cyclictest0-21swapper/211:48:582
3386818991411,1cyclictest0-21swapper/209:40:182
338681799149,4cyclictest3675699-21cut10:30:271
338681799146,6cyclictest1761-21gdbus08:45:021
338681799146,3cyclictest501rcuop/208:47:531
338681799146,3cyclictest501rcuop/208:23:331
338681799146,3cyclictest501rcuop/207:50:431
338681799146,3cyclictest501rcuop/207:40:101
338681799146,3cyclictest501rcuop/207:33:041
3386817991411,2cyclictest3555306-21kthreadcore09:20:201
3386817991411,2cyclictest3432065-21cpuspeed_turbos07:45:161
3386817991410,3cyclictest3583496-21unixbench_multi09:35:251
338681699148,5cyclictest3439620-21tr07:50:160
338681699145,5cyclictest0-21swapper/007:45:030
3386816991411,2cyclictest3821536-21kworker/u16:1-rpciod12:03:530
3386816991411,2cyclictest3517014-21cstates08:55:130
3386816991411,2cyclictest3517014-21cstates08:55:130
3386816991411,2cyclictest3457968-21kthreadcore08:05:180
3386816991411,2cyclictest3419662-21aten2.4-expect07:35:120
3386816991411,2cyclictest3418819-21unixbench_multi07:30:290
3386816991411,2cyclictest3404443-21kthreadcore07:20:200
3386816991411,2cyclictest3404443-21kthreadcore07:20:200
3386816991410,3cyclictest3873861-21fschecks_count12:30:190
3386816991410,3cyclictest3539285-21kthreadcore09:10:270
3386816991410,3cyclictest3533028-21kthreadcore09:05:200
3386816991410,3cyclictest3426778-21irqcore07:40:170
3386816991410,2cyclictest0-21swapper/008:20:010
338681699140,9cyclictest3516500-21date08:55:010
338681899139,2cyclictest0-21swapper/211:30:152
3386818991310,2cyclictest0-21swapper/207:35:192
3386818991310,1cyclictest0-21swapper/211:35:192
3386818991310,1cyclictest0-21swapper/210:00:162
3386816991310,2cyclictest3523999-21kthreadcore09:00:190
3386816991310,2cyclictest3450506-21fschecks_count08:00:160
3386816991310,2cyclictest3386980-21munin-plugin-st07:10:020
338681899129,2cyclictest0-21swapper/209:00:162
338681899129,1cyclictest0-21swapper/212:25:202
338681899129,1cyclictest0-21swapper/211:40:162
338681799119,1cyclictest0-21swapper/107:10:031
338681899108,1cyclictest0-21swapper/207:10:032
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional