You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-27 - 14:27
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack2slot7.osadl.org (updated Sat Jul 27, 2024 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3682705994524,5cyclictest3772204-21grep10:12:440
368270699442,15cyclictest3876237-21ssh12:07:311
368270599423,24cyclictest3767919-21/usr/sbin/munin10:07:370
368270599401,27cyclictest3809186-21/usr/sbin/munin10:57:340
3682705993922,2cyclictest11050irq/107-eth%d11:52:320
368270599381,24cyclictest3793014-21latency_hist10:37:430
368270599372,25cyclictest0-21swapper/011:37:310
368270599350,24cyclictest0-21swapper/011:27:440
368270599340,7cyclictest3750851-21ntpq09:47:320
368270599333,18cyclictest0-21swapper/012:02:330
368270599322,24cyclictest3741866-21fschecks_time09:37:260
3682705993219,1cyclictest0-21swapper/011:07:320
368270799315,23cyclictest3876240-21ntpq12:07:302
368270599310,4cyclictest3724998-21diskstats09:17:260
3682707992920,5cyclictest3837253-21munin-plugin-st11:27:442
368270599292,14cyclictest0-21swapper/010:57:470
368270599291,21cyclictest0-21swapper/011:22:130
368270599282,20cyclictest0-21swapper/011:57:440
3682705992722,1cyclictest3822264-21grep11:12:350
368270599264,7cyclictest3895365-21aten2.4-expect12:27:240
3682705992620,4cyclictest3850845-21fschecks_count11:42:260
368270599260,2cyclictest3840961-21grep11:32:270
3682706992519,4cyclictest3866883-21grep11:57:361
368270599252,21cyclictest3722016-21latency_hist09:12:440
3682705992513,3cyclictest0-21swapper/011:46:440
3682705992511,4cyclictest3906098-21ntpq12:37:300
368270599250,17cyclictest3780794-21grep10:22:440
368270599241,17cyclictest0-21swapper/010:01:450
3682707992315,6cyclictest3780600-21idleruntime-cro10:22:442
3682706992319,3cyclictest3770970-21cut10:12:301
368270599232,20cyclictest0-21swapper/009:27:350
3682705992311,1cyclictest0-21swapper/011:15:230
368270599230,2cyclictest0-21swapper/009:57:310
368270599224,16cyclictest0-21swapper/010:47:350
368270599220,2cyclictest3706235-21grep08:27:280
368270799211,6cyclictest11050irq/107-eth%d10:32:282
368270699215,11cyclictest3821151-21/usr/sbin/munin11:12:251
368270699212,7cyclictest171rcu_preempt07:12:431
368270599211,2cyclictest3775142-21diskstats10:17:250
3682707992014,4cyclictest3705552-21grep08:22:342
368270699201,10cyclictest3709431-21fschecks_count08:37:261
3682705992011,4cyclictest3714067-21/usr/sbin/munin08:52:250
3682705992010,1cyclictest0-21swapper/009:22:340
3682707991915,3cyclictest3793173-21latency_hist10:37:442
368270799191,4cyclictest11050irq/107-eth%d12:37:302
368270799190,2cyclictest3775852-21ntpq10:17:332
368270699193,1cyclictest11050irq/107-eth%d12:02:261
3682706991915,1cyclictest0-21swapper/110:47:341
368270599195,10cyclictest1002-21mta-sts-daemon07:37:290
368270599191,9cyclictest3804843-21/usr/sbin/munin10:52:310
3682705991916,2cyclictest3797378-21latency_hist10:42:440
3682705991916,2cyclictest3784610-21grep10:27:370
368270599191,12cyclictest3720388-21idleruntime-cro09:07:440
368270599190,18cyclictest0-21swapper/010:27:500
368270799184,9cyclictest3840579-21/usr/sbin/munin11:32:382
3682707991812,3cyclictest0-21swapper/210:07:372
368270699184,12cyclictest3792832-21sed10:37:351
368270699183,9cyclictest3699630-21tune2fs08:07:251
368270699182,2cyclictest3911146-21collect212:42:311
368270699181,6cyclictest3906100-21ssh12:37:301
3682706991815,2cyclictest3805439-21grep10:52:361
3682706991815,2cyclictest3784748-21munin-plugin-st10:27:431
3682706991813,3cyclictest3694058-21grep07:47:381
368270699180,7cyclictest3890873-21ssh12:22:281
368270599183,13cyclictest3682663-21munin-run07:12:430
368270599181,9cyclictest0-21swapper/012:12:260
3682705991814,2cyclictest3692442-21unixbench_multi07:42:370
368270599180,16cyclictest11050irq/107-eth%d12:17:280
112299180,3rtkit-daemon1121-21rtkit-daemon08:57:480
3682707991714,1cyclictest0-21swapper/212:02:292
368270699175,5cyclictest3722023-21diskmemload11:50:571
368270699172,5cyclictest11050irq/107-eth%d10:42:301
3682706991712,3cyclictest3816990-21gltestperf11:07:281
368270599175,1cyclictest0-21swapper/012:07:220
368270599172,11cyclictest3900590-21/usr/sbin/munin12:32:260
368270599172,11cyclictest3891029-21/usr/sbin/munin12:22:290
368270799165,7cyclictest0-21swapper/211:12:252
368270799163,8cyclictest3861171-21/usr/sbin/munin11:52:302
368270799162,11cyclictest3714558-21/usr/sbin/munin08:52:242
3682707991613,2cyclictest3866885-21unixbench_singl11:57:362
3682707991612,3cyclictest3816989-21grep11:07:282
3682707991611,3cyclictest0-21swapper/210:02:282
3682707991611,3cyclictest0-21swapper/207:12:432
368270699167,7cyclictest0-21swapper/111:02:271
368270699165,2cyclictest11050irq/107-eth%d11:32:261
368270699163,11cyclictest3758516-21fschecks_time09:57:261
368270699162,2cyclictest11050irq/107-eth%d11:42:441
368270699161,5cyclictest3737345-21/usr/sbin/munin09:32:221
3682706991611,4cyclictest3717243-21grep08:57:441
368270599164,3cyclictest3747050-21unixbench_multi09:42:340
368270599162,10cyclictest3910223-21aten_r2power_cu12:42:230
368270799158,5cyclictest0-21swapper/208:02:312
368270799157,7cyclictest341rcuc/210:47:272
368270799157,5cyclictest0-21swapper/212:32:342
368270799155,8cyclictest3881056-21/usr/sbin/munin12:12:292
368270799155,8cyclictest3826477-21/usr/sbin/munin11:17:262
368270799151,7cyclictest3687555-21unixbench_singl07:27:362
368270799151,3cyclictest11050irq/107-eth%d11:35:552
3682707991512,2cyclictest3759568-21unixbench_singl09:57:372
3682707991511,3cyclictest3754403-21gltestperf09:52:252
368270799151,10cyclictest3750339-21grep09:47:262
368270799151,10cyclictest3702361-21basename08:12:432
368270699156,7cyclictest3881219-21ssh12:12:311
368270699154,9cyclictest3826613-21ssh11:17:281
368270699154,8cyclictest0-21swapper/112:32:251
368270699154,2cyclictest11050irq/107-eth%d08:22:271
368270699154,10cyclictest3787561-21/usr/sbin/munin10:32:231
368270699153,9cyclictest3857095-21basename11:47:431
368270699153,7cyclictest3885320-21/usr/sbin/munin12:17:231
368270699152,9cyclictest3896121-21/usr/sbin/munin12:27:291
368270699151,9cyclictest3766516-21ssh10:07:221
368270699151,4cyclictest11050irq/107-eth%d11:34:351
3682706991511,3cyclictest3720379-21cron09:07:441
368270599158,6cyclictest0-21swapper/007:17:370
368270599153,10cyclictest3716616-21/usr/sbin/munin08:57:410
368270599151,1cyclictest3685351-21ntpq07:22:270
368270599151,11cyclictest3703992-21munin-run08:17:440
368270599150,1cyclictest3696514-21sed07:57:230
112299150,2rtkit-daemon1121-21rtkit-daemon07:50:461
112299150,2rtkit-daemon1121-21rtkit-daemon07:50:461
368270799149,4cyclictest3770971-21fschecks_count10:12:302
368270799146,4cyclictest0-21swapper/208:07:312
368270799145,6cyclictest0-21swapper/211:47:252
368270799142,8cyclictest3886852-21/usr/sbin/munin12:17:382
368270799142,10cyclictest3813385-21/usr/sbin/munin11:02:342
368270799141,9cyclictest3725500-21/usr/sbin/munin09:17:302
368270799141,1cyclictest11050irq/107-eth%d11:42:332
3682707991411,2cyclictest1000-21mta-sts-daemon10:55:262
368270799141,11cyclictest3716084-21fschecks_time08:57:352
368270699148,3cyclictest0-21swapper/111:27:331
368270699146,8cyclictest3707596-21kworker/u8:1+events_unbound10:22:321
368270699144,6cyclictest3763623-21/usr/sbin/munin10:02:351
368270699142,10cyclictest3809825-21grep10:57:441
368270699141,10cyclictest3831291-21/usr/sbin/munin11:22:291
368270599142,10cyclictest3712803-21cut08:47:260
368270599141,8cyclictest3694798-21/usr/sbin/munin07:52:260
368270599141,8cyclictest3694798-21/usr/sbin/munin07:52:260
368270599140,1cyclictest3754931-21ntpq09:52:310
112299140,1rtkit-daemon0-21swapper/107:53:031
368270899132,6cyclictest0-21swapper/310:57:343
368270899132,5cyclictest0-21swapper/310:32:323
368270899130,6cyclictest0-21swapper/312:02:273
368270799139,2cyclictest3911578-21grep12:42:352
368270799135,7cyclictest3890634-21fschecks_count12:22:262
368270799132,8cyclictest3895284-21/usr/sbin/munin12:27:252
368270799132,7cyclictest3805226-21/usr/sbin/munin10:52:352
368270799132,5cyclictest3720954-21/usr/sbin/munin09:12:252
368270799131,9cyclictest3831692-21ssh11:22:342
368270799131,6cyclictest3795736-21aten_r2power_po10:42:232
368270799131,10cyclictest3707891-21fschecks_time08:32:262
368270799130,9cyclictest3712802-21grep08:47:262
368270799130,2cyclictest3783624-21fschecks_time10:27:272
368270699137,4cyclictest0-21swapper/108:42:321
368270699135,5cyclictest3701187-21/usr/sbin/munin08:12:241
368270699133,7cyclictest3745633-21/usr/sbin/munin09:42:271
368270699132,8cyclictest3725618-21/usr/sbin/munin09:17:321
368270699132,8cyclictest3683858-21/usr/sbin/munin07:17:361
368270699132,7cyclictest3750341-21tail09:47:261
368270699132,7cyclictest3720623-21/usr/sbin/munin09:12:221
368270699132,7cyclictest3714847-21/usr/sbin/munin08:52:281
368270699132,7cyclictest3697903-21cpuspeed08:02:251
368270699132,10cyclictest3741809-21cut09:37:251
368270699131,9cyclictest3729466-21/usr/sbin/munin09:22:291
368270599136,3cyclictest3693579-21ntpq07:47:320
368270599133,8cyclictest3709952-21/usr/sbin/munin08:37:300
368270599133,4cyclictest3699327-21/usr/sbin/munin08:07:300
368270599131,8cyclictest0-21swapper/009:29:370
368270599131,7cyclictest3711170-21cut08:42:280
368270599130,1cyclictest0-21swapper/007:32:230
368270899122,7cyclictest0-21swapper/310:47:373
368270899122,6cyclictest0-21swapper/311:07:313
368270899122,4cyclictest0-21swapper/310:17:233
368270899121,7cyclictest0-21swapper/311:52:323
368270899121,5cyclictest0-21swapper/312:32:263
368270799129,2cyclictest3741849-21fschecks_time09:37:262
368270799129,2cyclictest3684879-21cut07:22:232
368270799128,3cyclictest0-21swapper/209:27:382
368270799128,3cyclictest0-21swapper/207:52:292
368270799128,3cyclictest0-21swapper/207:52:292
368270799128,2cyclictest0-21swapper/207:42:372
368270799124,5cyclictest3683899-21/usr/sbin/munin07:17:362
368270799123,6cyclictest0-21swapper/207:32:402
368270799122,7cyclictest3705883-21/usr/sbin/munin08:27:252
368270799121,8cyclictest3696346-21fschecks_count07:57:232
368270699129,2cyclictest1002-21mta-sts-daemon09:50:191
368270699127,3cyclictest3684880-21fschecks_count07:22:231
368270699124,6cyclictest3775777-21ntpq10:17:321
368270699123,7cyclictest3716985-21wc08:57:441
368270699122,8cyclictest3707517-21/usr/sbin/munin08:32:341
368270699122,8cyclictest321-21systemd-journal09:27:441
368270699121,8cyclictest3712801-21fschecks_time08:47:261
368270699121,7cyclictest3706976-21/usr/sbin/munin08:27:371
368270599128,2cyclictest0-21swapper/008:12:260
368270599123,7cyclictest3705637-21grep08:22:430
368270599122,7cyclictest3686549-21grep07:27:250
368270599121,8cyclictest3707888-21grep08:32:260
368270899115,3cyclictest0-21swapper/311:08:043
368270899114,4cyclictest0-21swapper/312:17:383
368270899113,6cyclictest0-21swapper/310:42:223
368270899113,5cyclictest0-21swapper/310:52:313
368270899113,5cyclictest0-21swapper/310:07:223
368270899113,4cyclictest0-21swapper/311:47:283
368270899112,6cyclictest0-21swapper/312:37:273
368270899112,5cyclictest0-21swapper/312:12:233
368270899112,5cyclictest0-21swapper/311:37:243
368270899112,5cyclictest0-21swapper/311:22:283
368270899112,5cyclictest0-21swapper/310:22:313
368270899112,5cyclictest0-21swapper/309:47:263
368270899111,5cyclictest0-21swapper/312:07:263
368270899111,4cyclictest0-21swapper/308:02:313
368270799112,8cyclictest3709535-21grep08:37:272
368270799112,6cyclictest3719473-21idleruntime09:07:282
368270799111,8cyclictest3737312-21/usr/sbin/munin09:32:232
368270799111,7cyclictest3717660-21fschecks_count09:02:262
368270799111,6cyclictest3693898-21/usr/sbin/munin07:47:372
368270699115,4cyclictest3689492-21/usr/sbin/munin07:37:201
368270699115,4cyclictest0-21swapper/108:17:391
368270699115,3cyclictest3692518-21sendmail07:42:441
368270699113,6cyclictest3689399-21grep07:32:441
368270599115,4cyclictest3698135-21gltestperf08:02:270
368270899104,3cyclictest0-21swapper/311:32:263
368270899103,4cyclictest0-21swapper/311:02:263
368270899103,4cyclictest0-21swapper/310:27:263
368270899103,4cyclictest0-21swapper/308:17:403
368270899103,4cyclictest0-21swapper/307:32:393
368270899103,3cyclictest0-21swapper/311:53:053
368270899102,6cyclictest0-21swapper/310:12:243
368270899102,5cyclictest0-21swapper/311:27:223
368270899102,5cyclictest0-21swapper/309:22:283
368270899102,5cyclictest0-21swapper/309:02:443
368270899102,5cyclictest0-21swapper/308:12:323
368270899102,4cyclictest0-21swapper/311:17:223
368270899102,4cyclictest0-21swapper/308:27:253
368270899102,4cyclictest0-21swapper/307:42:373
368270899102,3cyclictest0-21swapper/309:37:213
368270899101,5cyclictest0-21swapper/309:57:253
368270899100,5cyclictest0-21swapper/308:57:433
368270899100,5cyclictest0-21swapper/308:07:263
368270799106,3cyclictest3745969-21fschecks_count09:42:242
368270799103,4cyclictest3710780-21/usr/sbin/munin08:42:372
368270799102,5cyclictest3729474-21/usr/sbin/munin09:22:292
368270799102,3cyclictest3702958-21fschecks_time08:17:282
368270699101,7cyclictest3686548-21tune2fs07:27:251
36827089995,2cyclictest0-21swapper/310:37:253
36827089994,3cyclictest0-21swapper/310:02:293
36827089994,3cyclictest0-21swapper/308:47:343
36827089994,3cyclictest0-21swapper/308:37:283
36827089994,3cyclictest0-21swapper/307:57:273
36827089993,3cyclictest0-21swapper/307:47:313
36827089993,2cyclictest0-21swapper/312:38:283
36827089992,5cyclictest0-21swapper/309:52:213
36827089992,5cyclictest0-21swapper/309:42:263
36827089992,4cyclictest0-21swapper/309:27:383
36827089992,4cyclictest0-21swapper/309:12:323
36827089992,4cyclictest0-21swapper/309:07:243
36827089992,4cyclictest0-21swapper/308:42:373
36827089992,3cyclictest0-21swapper/312:22:223
36827089992,2cyclictest0-21swapper/312:27:333
36827089991,5cyclictest0-21swapper/308:22:223
36827089991,5cyclictest0-21swapper/307:22:323
36827089991,4cyclictest0-21swapper/307:52:243
36827089991,4cyclictest0-21swapper/307:52:243
36827089990,5cyclictest0-21swapper/311:42:363
36827089990,5cyclictest0-21swapper/307:17:343
36827079994,4cyclictest3689893-21grep07:37:242
36827089982,3cyclictest0-21swapper/307:37:233
36827089981,3cyclictest0-21swapper/308:52:223
36827089980,4cyclictest0-21swapper/309:32:223
36827089980,4cyclictest0-21swapper/309:17:253
36827089972,2cyclictest0-21swapper/308:32:223
36827089970,4cyclictest0-21swapper/307:27:243
36827089952,2cyclictest0-21swapper/307:12:443
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional