You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-11-22 - 02:41
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rackeslot2.osadl.org (updated Thu Nov 21, 2024 12:43:59)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
366959821120,1sleep10-21swapper/107:30:161
2500991380,1ptp4l0-21swapper/309:48:123
2500991320,5ptp4l186990irq/129-enp1s0-TxRx-009:10:463
2500991320,4ptp4l186990irq/129-enp1s0-TxRx-011:23:283
2500991320,1ptp4l186990irq/129-enp1s0-TxRx-009:55:113
2500991320,1ptp4l186990irq/129-enp1s0-TxRx-008:30:543
39142802300,0sleep03914281-21/usr/sbin/munin10:25:120
2500991300,3ptp4l0-21swapper/311:39:033
2500991300,1ptp4l186990irq/129-enp1s0-TxRx-009:51:313
2500991290,2ptp4l186990irq/129-enp1s0-TxRx-011:09:573
2500991290,1ptp4l186990irq/129-enp1s0-TxRx-011:04:343
2500991280,1ptp4l186990irq/129-enp1s0-TxRx-011:14:003
2500991270,4ptp4l0-21swapper/311:40:123
2500991260,5ptp4l186990irq/129-enp1s0-TxRx-011:25:123
2500991260,5ptp4l186990irq/129-enp1s0-TxRx-010:38:243
364209799251,19cyclictest4120791-21find12:25:110
2500991250,5ptp4l186990irq/129-enp1s0-TxRx-010:18:003
2500991250,4ptp4l186990irq/129-enp1s0-TxRx-012:12:223
2500991250,4ptp4l186990irq/129-enp1s0-TxRx-010:04:513
2500991250,4ptp4l186990irq/129-enp1s0-TxRx-009:28:583
2500991250,4ptp4l186990irq/129-enp1s0-TxRx-008:55:203
2500991250,2ptp4l0-21swapper/312:37:183
3642099992421,1cyclictest0-21swapper/207:15:012
3642097992417,6cyclictest4139234-21kthreadcore12:35:170
25010912417,2phc2sys0-21swapper/311:18:563
25010912417,2phc2sys0-21swapper/309:20:123
2500991240,5ptp4l186990irq/129-enp1s0-TxRx-012:27:063
2500991240,4ptp4l186990irq/129-enp1s0-TxRx-012:03:003
2500991240,4ptp4l186990irq/129-enp1s0-TxRx-011:45:463
2500991240,4ptp4l186990irq/129-enp1s0-TxRx-010:46:573
2500991240,3ptp4l186990irq/129-enp1s0-TxRx-012:16:423
3642097992315,7cyclictest3999918-21latency_hist11:15:000
25010912317,3phc2sys0-21swapper/311:30:303
25010912317,2phc2sys0-21swapper/311:58:283
25010912317,2phc2sys0-21swapper/311:58:273
25010912317,2phc2sys0-21swapper/308:51:393
25010912317,2phc2sys0-21swapper/308:40:043
2500991230,6ptp4l186990irq/129-enp1s0-TxRx-010:29:213
2500991230,4ptp4l186990irq/129-enp1s0-TxRx-008:46:393
2500991230,3ptp4l186990irq/129-enp1s0-TxRx-012:24:413
39306312220,0sleep071-21kcompactd010:34:440
25010912217,3phc2sys0-21swapper/311:50:303
25010912217,3phc2sys0-21swapper/309:18:273
25010912217,3phc2sys0-21swapper/308:36:553
25010912216,2phc2sys0-21swapper/309:38:283
25010912216,2phc2sys0-21swapper/308:29:233
2500991220,5ptp4l186990irq/129-enp1s0-TxRx-012:09:403
2500991220,5ptp4l186990irq/129-enp1s0-TxRx-010:21:243
2500991220,5ptp4l186990irq/129-enp1s0-TxRx-009:42:343
2500991220,5ptp4l186990irq/129-enp1s0-TxRx-009:42:333
2500991220,4ptp4l186990irq/129-enp1s0-TxRx-010:56:343
2500991220,4ptp4l186990irq/129-enp1s0-TxRx-010:42:083
2500991220,4ptp4l186990irq/129-enp1s0-TxRx-007:51:113
2500991220,2ptp4l0-21swapper/310:08:543
2500991220,1ptp4l0-21swapper/310:53:483
414352522117,2sleep20-21swapper/212:35:382
413649622117,2sleep20-21swapper/212:33:212
412647622117,2sleep20-21swapper/212:25:482
411065622117,2sleep20-21swapper/212:18:592
408306922117,2sleep20-21swapper/212:00:382
407617822117,2sleep20-21swapper/211:58:352
407617822117,2sleep20-21swapper/211:58:342
406044722117,2sleep20-21swapper/211:50:212
405784722117,2sleep20-21swapper/211:46:312
404208822117,2sleep20-21swapper/211:38:582
403366322117,2sleep20-21swapper/211:34:182
401527422117,2sleep20-21swapper/211:22:082
400025922117,2sleep20-21swapper/211:15:132
398875622117,2sleep20-21swapper/211:06:112
398072222117,2sleep20-21swapper/211:02:082
394559622117,2sleep20-21swapper/210:40:472
393680822117,2sleep20-21swapper/210:35:292
392816722117,2sleep20-21swapper/210:30:292
391962422117,2sleep20-21swapper/210:25:312
391180522117,2sleep20-21swapper/210:21:562
388680422117,2sleep20-21swapper/210:08:082
387879922117,2sleep20-21swapper/210:04:122
384259822117,2sleep20-21swapper/209:41:042
384259822117,2sleep20-21swapper/209:41:032
383505322117,2sleep20-21swapper/209:37:552
381869722117,2sleep20-21swapper/209:29:132
380697522117,2sleep20-21swapper/209:19:152
379680422117,2sleep20-21swapper/209:11:372
369262522117,2sleep20-21swapper/207:48:542
366907022117,2sleep20-21swapper/207:30:152
3642098992114,1cyclictest191rcu_preempt11:25:111
25010912116,1phc2sys0-21swapper/309:06:023
2500991210,4ptp4l186990irq/129-enp1s0-TxRx-010:13:083
2500991210,4ptp4l186990irq/129-enp1s0-TxRx-008:15:163
2500991210,2ptp4l0-21swapper/307:40:123
2500991210,2ptp4l0-21swapper/307:40:113
409468722017,2sleep20-21swapper/212:10:162
402297822017,2sleep20-21swapper/211:25:352
386891422017,2sleep20-21swapper/209:56:582
385402822017,2sleep20-21swapper/209:50:172
378386622017,2sleep20-21swapper/209:04:442
378386622017,2sleep20-21swapper/209:04:432
377767422017,2sleep20-21swapper/208:58:022
376541022017,2sleep20-21swapper/208:45:402
375915622017,2sleep20-21swapper/208:40:592
374170522017,2sleep20-21swapper/208:30:052
374119322017,2sleep20-21swapper/208:27:282
372318822017,2sleep20-21swapper/208:14:182
371715722017,2sleep20-21swapper/208:09:412
370473422017,2sleep20-21swapper/207:59:152
368058822017,2sleep20-21swapper/207:39:442
366213922017,2sleep20-21swapper/207:20:332
365622622017,2sleep20-21swapper/207:18:032
3642099992018,1cyclictest0-21swapper/212:25:002
3642099992017,1cyclictest0-21swapper/210:50:092
3642098992016,2cyclictest0-21swapper/112:40:011
3642098992016,2cyclictest0-21swapper/112:20:001
3642098992014,2cyclictest178850irq/121-eno111:55:201
3642098992014,2cyclictest178850irq/121-eno111:55:201
364209799209,6cyclictest0-21swapper/010:20:160
3642097992017,2cyclictest3991254-21systemd11:10:000
3642097992010,5cyclictest4130021-21fschecks_count12:30:210
3642097992010,5cyclictest0-21swapper/009:25:000
2500991200,5ptp4l186990irq/129-enp1s0-TxRx-009:00:483
2500991200,5ptp4l186990irq/129-enp1s0-TxRx-009:00:483
2500991200,4ptp4l186990irq/129-enp1s0-TxRx-012:32:463
2500991200,4ptp4l186990irq/129-enp1s0-TxRx-009:32:483
2500991200,4ptp4l186990irq/129-enp1s0-TxRx-008:06:393
2500991200,4ptp4l186990irq/129-enp1s0-TxRx-007:22:263
2500991200,2ptp4l0-21swapper/310:30:113
3642098991912,3cyclictest4132174-21kthreadcore12:30:241
3642098991912,3cyclictest3866560-21kthreadcore09:55:211
3642098991911,3cyclictest3978068-21kthreadcore11:00:211
3642098991911,3cyclictest3792774-21kthreadcore09:10:171
364209899190,1cyclictest0-21swapper/110:54:201
364209799198,6cyclictest0-21swapper/010:50:000
3642097991917,1cyclictest4008409-21kworker/0:1+events12:13:560
3642097991916,2cyclictest3717296-21kworker/u16:1-rpciod09:50:010
3642097991912,6cyclictest4113355-21kthreadcore12:20:220
3642097991911,7cyclictest0-21swapper/009:40:240
3642097991911,7cyclictest0-21swapper/009:40:230
3642097991911,3cyclictest4073834-21ls11:55:230
3642097991911,3cyclictest4073834-21ls11:55:220
2500991190,5ptp4l186990irq/129-enp1s0-TxRx-008:03:243
2500991190,4ptp4l186990irq/129-enp1s0-TxRx-008:14:393
2500991190,4ptp4l186990irq/129-enp1s0-TxRx-007:37:353
2500991190,4ptp4l186990irq/129-enp1s0-TxRx-007:30:483
2500991190,4ptp4l186990irq/129-enp1s0-TxRx-007:25:463
2500991190,3ptp4l186990irq/129-enp1s0-TxRx-008:20:263
2500991190,3ptp4l186990irq/129-enp1s0-TxRx-007:48:363
3642098991815,2cyclictest770595-21systemd-journal10:10:381
3642098991815,2cyclictest4097830-21kthreadcore12:10:231
3642098991815,2cyclictest3642095-21cyclictest11:46:131
3642098991814,3cyclictest1696-1atopacctd07:10:231
364209799187,6cyclictest0-21swapper/011:25:190
364209799187,6cyclictest0-21swapper/009:40:010
364209799187,5cyclictest0-21swapper/012:15:130
364209799185,5cyclictest0-21swapper/011:30:120
364209799182,11cyclictest0-21swapper/011:42:310
3642097991815,2cyclictest3704970-21latency_hist08:00:000
3642097991812,5cyclictest3900728-21kthreadcore10:15:260
2500991180,4ptp4l186990irq/129-enp1s0-TxRx-007:05:503
2500991180,3ptp4l186990irq/129-enp1s0-TxRx-007:56:253
2500991180,2ptp4l0-21swapper/307:10:203
39739832170,2sleep20-21swapper/211:00:012
3642099991714,1cyclictest0-21swapper/211:11:112
3642099991714,1cyclictest0-21swapper/210:15:322
3642099991714,1cyclictest0-21swapper/208:00:442
3642099991714,1cyclictest0-21swapper/207:42:302
3642099991714,1cyclictest0-21swapper/207:42:292
3642099991713,2cyclictest0-21swapper/210:45:262
364209899176,5cyclictest0-21swapper/111:35:121
3642098991715,1cyclictest4008457-21cut11:20:001
3642098991714,2cyclictest4017012-21systemd-run11:25:011
3642098991714,2cyclictest3991118-21apt-key11:10:001
3642098991714,2cyclictest0-21swapper/112:25:021
3642098991714,2cyclictest0-21swapper/111:54:591
3642098991711,2cyclictest3873956-21kthreadcore10:00:211
3642098991711,2cyclictest0-21swapper/107:50:001
3642098991710,3cyclictest3965711-21aten_repower_fr10:55:121
364209799178,5cyclictest0-21swapper/008:10:140
364209799177,5cyclictest0-21swapper/011:15:120
3642097991714,2cyclictest3880036-21cpuspeed_turbos10:05:140
3642097991714,2cyclictest3648218-21proc_pri07:15:010
3642097991714,2cyclictest3642095-21cyclictest09:00:020
3642097991714,2cyclictest1695-21dbus-daemon10:45:010
3642097991714,2cyclictest0-21swapper/008:45:020
3642097991713,3cyclictest4060019-21munin-plugin-st11:50:020
3642097991713,2cyclictest4086606-21df_inode12:05:130
2500991170,5ptp4l186990irq/129-enp1s0-TxRx-007:17:123
3642099991613,1cyclictest0-21swapper/210:15:022
364209899169,3cyclictest3693194-21aten2.4-expect07:50:131
3642098991613,2cyclictest4125616-21grep12:25:221
3642098991613,2cyclictest4043870-21gltestperf11:40:161
3642098991613,2cyclictest3992552-21idleruntime11:10:231
3642098991613,2cyclictest3884809-21mailstats10:05:241
3642098991613,2cyclictest3741430-21cut08:30:001
3642098991613,2cyclictest3711340-21systemd-run08:05:021
3642098991613,2cyclictest1726-21systemd-logind09:55:011
3642098991613,2cyclictest1707-21polkitd09:10:011
3642098991612,3cyclictest1696-1atopacctd11:30:221
364209799168,5cyclictest3875539-21kthreadcore10:00:220
364209799168,4cyclictest0-21swapper/010:50:190
364209799166,5cyclictest0-21swapper/009:55:200
364209799161,5cyclictest0-21swapper/009:11:590
3642097991614,1cyclictest3790181-21diskmemload11:35:270
3642097991613,2cyclictest4085829-21/usr/sbin/munin12:05:020
3642097991613,2cyclictest3820948-21kthreadcore09:30:170
3642097991613,2cyclictest3729339-21cut08:20:000
3642097991613,2cyclictest3692771-21systemd07:50:000
3642097991612,3cyclictest4013715-21pmu-power11:20:230
3642097991612,3cyclictest3732416-21kthreadcore08:20:240
364209799161,10cyclictest0-21swapper/009:55:010
3642099991513,1cyclictest0-21swapper/209:30:152
3642099991513,1cyclictest0-21swapper/208:37:242
3642099991512,1cyclictest0-21swapper/212:08:192
3642099991512,1cyclictest0-21swapper/208:55:022
364209899159,2cyclictest178850irq/121-eno109:25:521
364209899159,2cyclictest178850irq/121-eno109:20:181
364209899158,3cyclictest3833616-21/usr/sbin/munin09:35:271
364209899155,4cyclictest0-21swapper/110:35:101
3642098991513,2cyclictest3913773-21kworker/u16:2+events_freezable_pwr_efficient12:06:051
3642098991512,2cyclictest3924749-21kthreadcore10:30:191
3642098991512,2cyclictest3913773-21kworker/u16:2-rpciod10:45:181
3642098991512,2cyclictest3753832-21head08:40:111
3642098991512,2cyclictest3742406-21gltestperf08:30:171
3642098991512,2cyclictest3730216-21fschecks_count08:20:201
3642098991512,2cyclictest3642095-21cyclictest10:22:381
3642098991512,2cyclictest1726-21systemd-logind07:45:021
3642098991512,2cyclictest1726-21systemd-logind07:45:011
3642098991512,2cyclictest1696-1atopacctd07:21:371
3642098991512,2cyclictest0-21swapper/109:35:021
3642098991511,3cyclictest3717296-21kworker/u16:1+nfsiod10:19:211
3642098991511,2cyclictest0-21swapper/110:45:011
3642098991510,4cyclictest3799947-21fschecks_time09:15:191
364209799158,6cyclictest3682763-21tr07:40:190
364209799158,6cyclictest3682763-21tr07:40:180
364209799155,4cyclictest3656270-21sshd07:18:380
364209799154,7cyclictest3965793-21tail10:55:120
364209799153,4cyclictest491rcuog/208:49:260
3642097991513,1cyclictest3668064-21unixbench-2d07:25:260
3642097991512,2cyclictest770595-21systemd-journal09:08:380
3642097991512,2cyclictest3890704-21kthreadcore10:10:220
3642097991512,2cyclictest3753723-21sh08:40:010
3642097991512,2cyclictest3711286-21systemd08:05:020
3642097991512,2cyclictest3693726-21gltestperf07:50:160
3642097991512,2cyclictest1726-21systemd-logind11:55:000
3642097991511,3cyclictest3804533-21timerandwakeup09:15:290
3642097991511,2cyclictest0-21swapper/008:55:020
3642097991510,4cyclictest1-21systemd07:10:020
364209999141,7cyclictest0-21swapper/209:50:012
3642099991412,1cyclictest0-21swapper/207:10:022
3642099991411,1cyclictest0-21swapper/211:40:162
3642099991411,1cyclictest0-21swapper/209:20:192
3642099991411,1cyclictest0-21swapper/209:10:012
3642098991411,2cyclictest3772855-21gltestperf08:55:151
3642098991411,2cyclictest3724336-21gltestperf08:15:181
3642098991411,2cyclictest3676237-21tr07:35:181
3642098991411,2cyclictest3668657-21cut07:30:011
3642098991411,2cyclictest3653415-21kthreadcore07:15:181
3642098991411,2cyclictest3642095-21cyclictest08:45:121
3642098991410,3cyclictest3781506-21kthreadcore09:00:191
3642098991410,3cyclictest3781506-21kthreadcore09:00:181
3642098991410,3cyclictest3642095-21cyclictest09:40:151
3642098991410,3cyclictest3642095-21cyclictest09:40:141
364209899140,3cyclictest0-21swapper/108:38:151
364209799145,4cyclictest3790181-21diskmemload10:35:520
3642097991411,2cyclictest3812976-21gmain09:26:290
3642097991411,2cyclictest3678956-21kthreadcore07:35:190
3642097991411,2cyclictest1-21systemd08:30:000
3642097991410,3cyclictest3975603-21kthreadcore11:00:200
3642097991410,3cyclictest3713621-21kthreadcore08:05:200
3642097991410,3cyclictest3672894-21kthreadcore07:30:200
3642099991311,1cyclictest0-21swapper/207:55:012
3642099991310,1cyclictest0-21swapper/207:25:162
364209899135,7cyclictest3913963-1ssh10:25:071
3642098991311,1cyclictest3846676-21kthreadcore09:45:201
3642098991310,2cyclictest3768850-21kthreadcore08:50:201
3642098991310,2cyclictest3720928-21kthreadcore08:10:211
3642098991310,2cyclictest3714360-21kthreadcore08:05:201
3642098991310,2cyclictest3701509-21kthreadcore07:55:181
3642098991310,2cyclictest3642095-21cyclictest12:00:161
364209799139,3cyclictest3648166-21munin-node07:20:120
3642097991310,2cyclictest3742448-21gltestperf08:30:170
364209999129,1cyclictest0-21swapper/208:25:002
364209799129,2cyclictest3782517-21kthreadcore09:00:200
364209799129,2cyclictest3782517-21kthreadcore09:00:190
364209999119,1cyclictest0-21swapper/208:15:152
36420989996,2cyclictest3642157-21true07:10:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional