You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-11-22 - 14:30
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7.osadl.org (updated Fri Nov 22, 2024 12:43:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3255106996140,7cyclictest3409687-21/usr/sbin/munin11:24:350
3255106995036,3cyclictest0-21swapper/010:04:360
325510699492,36cyclictest0-21swapper/010:29:460
325510699492,36cyclictest0-21swapper/010:29:460
3255106993916,3cyclictest3349505-21ssh10:19:400
3255106993916,3cyclictest3349505-21ssh10:19:400
3255108993810,20cyclictest1005-21mta-sts-daemon11:11:062
325510699371,23cyclictest3477287-21ntpq12:29:430
325510699371,23cyclictest3477287-21ntpq12:29:430
325510699333,6cyclictest0-21swapper/012:24:390
3255106993217,4cyclictest3298527-21ntp_states09:14:380
325510699321,29cyclictest0-21swapper/009:54:350
325510899317,18cyclictest1008-21mta-sts-daemon11:55:432
325510699302,27cyclictest191rcuc/010:39:430
3255106993020,3cyclictest0-21swapper/012:39:430
3255106993014,10cyclictest11050irq/107-eth%d12:14:390
3255106993011,4cyclictest14-21ksoftirqd/011:54:360
3255108992924,4cyclictest1006-21mta-sts-daemon11:09:402
3255108992919,7cyclictest3420033-21gltestperf11:34:332
325510699292,1cyclictest171rcu_preempt10:22:180
325510699280,21cyclictest3374618-21/usr/sbin/munin10:49:450
325510699277,13cyclictest1005-21mta-sts-daemon10:54:380
325510699276,3cyclictest0-21swapper/009:39:390
325510699273,18cyclictest14-21ksoftirqd/011:05:410
3255106992726,0cyclictest0-21swapper/011:33:440
325510699271,18cyclictest3383918-21ntpq10:59:370
325510899265,7cyclictest11050irq/107-eth%d11:40:052
3255107992624,1cyclictest0-21swapper/110:55:401
3255107992623,2cyclictest0-21swapper/111:44:421
325510699262,7cyclictest3390949-21ssh11:05:420
325510899251,5cyclictest3471700-21sort12:24:372
325510799258,3cyclictest0-21swapper/111:59:361
3255106992513,4cyclictest3332720-21tune2fs09:59:350
325510699250,2cyclictest3446745-21ssh11:59:400
325510799242,5cyclictest11050irq/107-eth%d11:39:401
325510699241,2cyclictest3405585-21sed11:19:420
325510899233,15cyclictest3388591-21ssh11:04:342
3255108992319,3cyclictest1005-21mta-sts-daemon11:54:322
3255108992318,3cyclictest3349326-21needreboot10:19:372
3255108992318,3cyclictest3349326-21needreboot10:19:372
3255108992317,3cyclictest1006-21mta-sts-daemon08:24:402
325510799236,12cyclictest3411123-21sh11:25:071
325510699231,3cyclictest3360931-21irqstats10:34:340
325510699231,17cyclictest3285642-21sort08:44:320
325510699230,22cyclictest619-21mta-sts-daemon10:44:190
3255106992218,3cyclictest3291954-21latency_hist09:00:410
325510699221,20cyclictest0-21swapper/010:05:580
3255106992210,1cyclictest0-21swapper/011:14:390
325510699220,7cyclictest0-21swapper/007:14:360
3255108992116,4cyclictest3358232-21basename10:30:402
3255108992116,4cyclictest3358232-21basename10:30:402
325510799212,14cyclictest3310297-21ssh09:29:381
3255106992116,1cyclictest0-21swapper/009:34:400
325510699211,16cyclictest0-21swapper/011:45:220
325510899203,9cyclictest3255063-21munin-run07:10:402
325510899203,12cyclictest3456738-21ssh12:09:432
3255108992014,4cyclictest1006-21mta-sts-daemon11:49:412
325510799202,15cyclictest3419854-21ssh11:34:321
3255107992015,4cyclictest3473316-21cron12:25:401
325510699209,7cyclictest0-21swapper/007:10:400
325510699204,12cyclictest3424708-21aten_r2power_en11:39:330
3255106992015,3cyclictest3277100-21grep08:14:430
3255106992013,1cyclictest3310568-21ntpq09:29:400
325510699201,18cyclictest3434926-21/usr/sbin/munin11:49:330
325510699200,20cyclictest0-21swapper/009:17:390
325510899193,12cyclictest3409666-21ssh11:24:352
325510899193,11cyclictest3333122-21tail09:59:372
3255108991917,1cyclictest0-21swapper/212:14:392
3255108991914,4cyclictest3341004-21grep10:09:412
325510799198,6cyclictest3332492-21aten_r2power_vo09:59:331
325510799196,8cyclictest3441314-21/usr/sbin/munin11:54:401
3255107991914,4cyclictest3365053-21fschecks_time10:39:401
3255107991914,3cyclictest3263211-21grep07:34:411
3255107991913,5cyclictest3396086-21latency_hist11:10:411
3255107991911,5cyclictest11050irq/107-eth%d11:14:421
325510699194,14cyclictest191rcuc/010:14:410
325510699192,14cyclictest967-21snmpd12:20:100
3255106991915,1cyclictest0-21swapper/012:09:430
325510699190,2cyclictest14-21ksoftirqd/008:29:320
325510899184,11cyclictest3404498-21diskmemload11:19:332
3255108991812,3cyclictest111788-21systemd-journal08:05:402
325510899181,14cyclictest3324760-21ssh09:49:342
325510799187,9cyclictest0-21swapper/111:49:371
325510799183,9cyclictest3345847-21grep10:14:431
325510799183,11cyclictest3451567-21ssh12:04:381
325510699182,13cyclictest3482292-21ntpq12:34:410
3255106991811,2cyclictest0-21swapper/012:05:330
325510899172,9cyclictest3352726-21cut10:24:352
325510899172,10cyclictest3482289-21ssh12:34:412
3255108991714,2cyclictest3329951-21unixbench_multi09:54:412
325510899171,14cyclictest3477188-21/usr/sbin/munin12:29:422
325510899171,14cyclictest3477188-21/usr/sbin/munin12:29:422
325510899171,12cyclictest3282654-21fschecks_count08:34:352
325510899171,12cyclictest3282654-21fschecks_count08:34:352
325510799175,9cyclictest3456993-21/usr/sbin/munin12:09:461
325510799173,8cyclictest3388778-21/usr/sbin/munin11:04:351
325510799171,9cyclictest3313708-21/usr/sbin/munin09:34:311
3255107991712,4cyclictest3384417-21sed10:59:411
3255106991712,5cyclictest151ktimers/007:34:370
325510699170,4cyclictest3306685-21ntpq09:24:390
325510699170,2cyclictest0-21swapper/009:49:380
112699170,2rtkit-daemon0-21swapper/111:29:341
112699170,1rtkit-daemon0-21swapper/109:40:151
325510999164,6cyclictest0-21swapper/312:04:373
325510899164,9cyclictest3276695-21/usr/sbin/munin08:14:412
325510899164,7cyclictest3361181-21/usr/sbin/munin10:34:352
325510899162,9cyclictest3319761-21cat09:40:412
325510799168,7cyclictest241irq_work/110:04:361
325510799165,8cyclictest3270459-21apt-get07:55:421
325510799164,9cyclictest1-21systemd07:55:401
325510799163,9cyclictest0-21swapper/111:19:361
325510799163,10cyclictest3325825-21/usr/sbin/munin09:49:421
325510799162,8cyclictest3305780-21aten_r2power_cu09:24:321
325510799161,5cyclictest0-21swapper/112:34:451
3255107991611,3cyclictest0-21swapper/108:10:401
325510699169,3cyclictest3263919-21grep07:39:330
325510699165,10cyclictest3274115-21apt-get08:05:420
325510699161,4cyclictest14-21ksoftirqd/007:45:060
112699160,3rtkit-daemon1125-21rtkit-daemon10:15:122
325510999152,7cyclictest0-21swapper/307:59:383
325510899156,5cyclictest3298728-21ssh09:14:402
325510899155,6cyclictest3281078-21fschecks_time08:29:342
325510899154,8cyclictest3301844-21/usr/sbin/munin09:19:342
325510899153,10cyclictest3310127-21fschecks_time09:29:372
325510899152,9cyclictest3285113-21/usr/sbin/munin08:39:412
3255108991513,1cyclictest0-21swapper/210:44:372
3255108991511,2cyclictest3270086-21latency_hist07:55:402
325510899151,12cyclictest11050irq/107-eth%d09:34:382
3255108991511,2cyclictest0-21swapper/208:59:412
325510899151,10cyclictest3307191-21sed09:24:432
3255108991510,3cyclictest0-21swapper/210:39:422
325510799157,5cyclictest3273714-21latency_hist08:05:401
325510799154,9cyclictest629-21thd09:54:371
325510799154,7cyclictest3374220-21/usr/sbin/munin10:49:401
325510799153,9cyclictest3349521-21/usr/sbin/munin10:19:411
325510799153,9cyclictest3349521-21/usr/sbin/munin10:19:411
325510799152,8cyclictest3298095-21sort09:14:331
325510799152,11cyclictest3357241-21ntp_states10:29:421
325510799152,11cyclictest3357241-21ntp_states10:29:421
325510799152,11cyclictest1008-21mta-sts-daemon12:29:411
325510799152,11cyclictest1008-21mta-sts-daemon12:29:411
3255107991512,2cyclictest0-21swapper/110:09:411
325510699155,1cyclictest171rcu_preempt08:50:410
325510699154,9cyclictest111788-21systemd-journal11:30:400
325510699152,12cyclictest605-21avahi-daemon09:00:420
112699150,2rtkit-daemon1125-21rtkit-daemon07:36:202
325510999143,5cyclictest0-21swapper/309:49:323
325510999142,8cyclictest0-21swapper/311:55:423
325510899145,6cyclictest3278079-21/usr/sbin/munin08:19:382
325510899144,9cyclictest3373713-21aten_r2power_fr10:49:362
325510899143,8cyclictest3486640-21aten_r2power_po12:39:332
325510899143,4cyclictest3383917-21ssh10:59:372
325510899142,11cyclictest3451682-21/usr/sbin/munin12:04:402
325510899142,10cyclictest3415538-21/usr/sbin/munin11:29:422
325510899142,10cyclictest3337516-21ssh10:04:392
325510899141,6cyclictest11050irq/107-eth%d12:19:412
325510899141,10cyclictest3258239-21sed07:19:402
3255108991410,3cyclictest633-21gpm10:54:072
3255108991410,3cyclictest3271878-21sh08:00:402
325510799149,3cyclictest3461276-21fschecks_time12:14:341
325510799145,8cyclictest3369457-21/usr/sbin/munin10:44:341
325510799144,7cyclictest3466460-21grep12:19:351
325510799143,8cyclictest3360327-21/usr/sbin/munin10:34:351
325510799143,8cyclictest3279095-21/usr/sbin/munin08:24:331
325510799143,4cyclictest3352686-21/usr/sbin/munin10:24:341
325510799143,10cyclictest3292550-21apt-get09:00:421
325510799142,9cyclictest3301982-21/usr/sbin/munin09:19:361
3255107991411,2cyclictest3256681-21unixbench_singl07:14:401
325510699149,1cyclictest0-21swapper/008:19:370
325510699143,2cyclictest171rcu_preempt09:09:360
3255106991412,1cyclictest1007-21mta-sts-daemon08:34:440
3255106991412,1cyclictest1007-21mta-sts-daemon08:34:440
3255106991412,1cyclictest0-21swapper/007:24:410
325510699141,1cyclictest3269884-21apt-get07:55:420
325510999136,4cyclictest0-21swapper/310:29:443
325510999136,4cyclictest0-21swapper/310:29:443
325510999135,4cyclictest0-21swapper/309:14:413
325510999134,5cyclictest0-21swapper/312:09:473
325510999134,4cyclictest0-21swapper/311:34:303
325510999134,4cyclictest0-21swapper/311:04:353
325510999134,3cyclictest0-21swapper/308:24:403
325510999132,5cyclictest0-21swapper/309:59:313
325510999131,6cyclictest0-21swapper/310:44:383
325510899139,3cyclictest3274561-21grep08:09:342
325510899132,9cyclictest3261650-21/usr/sbin/munin07:29:432
325510899131,9cyclictest3262270-21fschecks_time07:34:342
325510899131,10cyclictest3430070-21/usr/sbin/munin11:44:332
325510799133,9cyclictest3320751-21ssh09:42:321
325510799132,9cyclictest3486790-21/usr/sbin/munin12:39:351
325510799132,6cyclictest3266080-21/usr/sbin/munin07:45:031
325510799131,9cyclictest3283605-21sed08:34:441
325510799131,9cyclictest3283605-21sed08:34:441
325510799131,8cyclictest3260187-21grep07:25:401
325510799131,5cyclictest3281611-21ntpq08:29:401
325510699137,1cyclictest3268477-21/usr/sbin/munin07:54:420
325510699131,8cyclictest0-21swapper/009:44:310
3255106991310,3cyclictest3261081-21ntp_kernel_pll_07:29:380
3255106991310,2cyclictest191rcuc/007:19:380
325510699130,9cyclictest0-21swapper/008:24:370
112699130,0rtkit-daemon0-21swapper/108:17:351
325510999123,6cyclictest0-21swapper/311:54:323
325510999123,6cyclictest0-21swapper/311:14:383
325510999123,4cyclictest0-21swapper/312:34:383
325510999123,4cyclictest0-21swapper/308:04:453
325510999122,6cyclictest0-21swapper/311:44:383
325510999122,5cyclictest0-21swapper/310:59:283
325510999122,4cyclictest0-21swapper/309:45:403
325510999121,7cyclictest0-21swapper/309:54:303
325510899127,4cyclictest0-21swapper/208:44:362
325510899122,7cyclictest3293631-21/usr/sbin/munin09:04:432
325510899121,8cyclictest3265878-21/usr/sbin/munin07:45:012
325510899121,10cyclictest3290351-21wc08:55:402
3255108991210,1cyclictest3258966-21fschecks_time07:24:342
325510799129,2cyclictest3291918-21unixbench_singl08:59:411
325510799128,3cyclictest3261663-21cron07:30:401
325510799127,3cyclictest0-21swapper/108:49:411
325510799123,7cyclictest3286863-21/usr/sbin/munin08:44:421
325510699128,3cyclictest3284384-21grep08:39:340
325510699122,7cyclictest3266843-21/usr/sbin/munin07:49:310
325510699121,8cyclictest3272504-21fschecks_time08:04:420
325510999116,4cyclictest0-21swapper/309:34:423
325510999114,5cyclictest0-21swapper/309:24:423
325510999114,4cyclictest0-21swapper/307:49:443
325510999113,6cyclictest0-21swapper/312:21:153
325510999113,4cyclictest0-21swapper/312:19:373
325510999113,4cyclictest0-21swapper/312:14:343
325510999112,5cyclictest0-21swapper/311:05:423
325510999112,5cyclictest0-21swapper/309:09:433
325510999111,6cyclictest0-21swapper/312:29:403
325510999111,6cyclictest0-21swapper/312:29:403
325510999111,6cyclictest0-21swapper/310:13:313
325510999111,6cyclictest0-21swapper/308:09:343
325510999111,5cyclictest0-21swapper/310:24:423
325510999111,5cyclictest0-21swapper/310:02:153
325510999111,5cyclictest0-21swapper/309:19:323
325510899118,2cyclictest1006-21mta-sts-daemon09:45:312
325510899111,8cyclictest3295271-21/usr/sbin/munin09:09:422
325510799112,6cyclictest3294606-21/usr/sbin/munin09:09:351
325510799112,5cyclictest3275791-21/usr/sbin/munin08:14:331
325510799111,8cyclictest3284907-21/usr/sbin/munin08:39:391
325510799111,8cyclictest3267702-21/usr/sbin/munin07:49:451
325510799111,8cyclictest0-21swapper/108:54:391
325510799111,7cyclictest111788-21systemd-journal07:20:401
325510699111,2cyclictest14-21ksoftirqd/008:54:370
325510999104,3cyclictest0-21swapper/311:39:323
325510999104,3cyclictest0-21swapper/309:30:343
325510999103,4cyclictest0-21swapper/310:19:343
325510999103,4cyclictest0-21swapper/310:19:343
325510999103,3cyclictest0-21swapper/309:39:333
325510999103,3cyclictest0-21swapper/307:54:483
325510999102,6cyclictest0-21swapper/311:29:403
325510999102,6cyclictest0-21swapper/308:49:333
325510999102,5cyclictest0-21swapper/311:25:073
325510999102,5cyclictest0-21swapper/310:38:573
325510999102,5cyclictest0-21swapper/310:09:403
325510999102,5cyclictest0-21swapper/309:04:383
325510999102,5cyclictest0-21swapper/308:59:413
325510999102,5cyclictest0-21swapper/307:29:383
325510999101,6cyclictest0-21swapper/311:19:363
325510899102,6cyclictest3287315-21aten2.4-expect08:49:322
325510899102,5cyclictest3255725-21/usr/sbin/munin07:14:332
325510899101,6cyclictest3266842-21/usr/sbin/munin07:49:382
325510799101,8cyclictest3263547-21/usr/sbin/munin07:39:311
32551099994,3cyclictest0-21swapper/312:39:333
32551099993,4cyclictest0-21swapper/311:49:003
32551099993,4cyclictest0-21swapper/308:54:353
32551099992,5cyclictest0-21swapper/310:32:123
32551099992,4cyclictest0-21swapper/308:44:363
32551099992,4cyclictest0-21swapper/308:14:343
32551099992,4cyclictest0-21swapper/307:19:363
32551099992,3cyclictest0-21swapper/310:45:503
32551099991,5cyclictest0-21swapper/310:54:373
32551079992,2cyclictest3255242-21cat07:10:411
32551099983,3cyclictest0-21swapper/308:39:343
32551099983,3cyclictest0-21swapper/308:19:363
32551099982,4cyclictest0-21swapper/307:24:313
32551099982,3cyclictest0-21swapper/307:39:323
32551099981,4cyclictest0-21swapper/308:34:333
32551099981,4cyclictest0-21swapper/308:34:333
32551099981,4cyclictest0-21swapper/307:34:353
32551099981,4cyclictest0-21swapper/307:14:343
32551099972,3cyclictest0-21swapper/308:29:323
32551099972,2cyclictest0-21swapper/307:44:463
32551099951,2cyclictest0-21swapper/307:10:413
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional