You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-11-23 - 12:43
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7.osadl.org (updated Sat Nov 23, 2024 00:43:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2556497993618,6cyclictest2642363-21open_files21:59:390
255649799350,4cyclictest2778423-21ntpq00:34:430
2556497993431,2cyclictest2633034-21ssh21:49:390
255649799331,7cyclictest2648448-21ssh22:05:410
112699310,3rtkit-daemon1125-21rtkit-daemon21:28:470
255649799307,5cyclictest2682885-21ssh22:44:340
2556497993022,1cyclictest0-21swapper/022:19:240
255649999296,8cyclictest2710732-21ssh23:14:412
255649799281,25cyclictest0-21swapper/023:59:360
255649799281,25cyclictest0-21swapper/023:59:360
255649799270,1cyclictest0-21swapper/023:55:400
255649899269,2cyclictest11050irq/107-eth%d21:59:361
255649799263,2cyclictest0-21swapper/023:14:420
112699260,3rtkit-daemon1125-21rtkit-daemon21:23:471
2556499992516,5cyclictest0-21swapper/200:14:382
255649799251,2cyclictest2670237-21mailstats22:29:430
112699240,2rtkit-daemon1125-21rtkit-daemon20:30:092
2556497992320,2cyclictest2619528-21unixbench_multi21:34:410
255649799231,21cyclictest0-21swapper/023:19:380
255649899223,4cyclictest2673972-21diskstats22:34:321
2556497992219,2cyclictest2687507-21fschecks_time22:49:380
255649799221,7cyclictest11050irq/107-eth%d23:29:330
255649799221,7cyclictest11050irq/107-eth%d21:44:380
255649799221,3cyclictest11050irq/107-eth%d21:14:330
255649799221,20cyclictest0-21swapper/021:39:360
255649799221,1cyclictest2608697-21ssh21:24:340
255649999218,9cyclictest605-21avahi-daemon00:34:432
255649999212,18cyclictest2660490-21cut22:19:362
2556497992119,1cyclictest0-21swapper/023:49:410
255649899202,12cyclictest2615236-21apt-get21:30:421
255649799202,17cyclictest0-21swapper/022:24:420
2556499991916,2cyclictest2585089-21unixbench_singl20:34:412
2556498991915,3cyclictest0-21swapper/121:44:341
255649799192,3cyclictest11050irq/107-eth%d00:24:320
255649799192,15cyclictest2758383-21gltestperf00:09:340
2556497991917,2cyclictest0-21swapper/023:44:390
2556497991916,2cyclictest2678556-21gltestperf22:39:340
2556497991915,3cyclictest2763401-21unixbench_singl00:14:430
2556497991915,3cyclictest2567240-21fschecks_count19:44:330
2556497991915,2cyclictest2559741-21unixbench_singl19:19:420
255649799191,17cyclictest0-21swapper/023:09:320
255649799190,17cyclictest2596835-21latency_hist21:10:410
255649999186,9cyclictest2745444-21ssh23:54:402
255649999183,6cyclictest2705237-21/usr/sbin/munin23:09:322
255649999182,12cyclictest2759405-21/usr/sbin/munin00:09:422
255649999182,10cyclictest2722132-21grep23:29:332
2556499991814,3cyclictest2643668-21latency_hist22:00:412
2556499991813,3cyclictest2618874-21missed_timers21:34:352
255649999181,10cyclictest2566339-21apt-get19:40:422
255649899184,7cyclictest0-21swapper/100:24:321
255649899182,8cyclictest2606142-21ssh21:20:411
2556498991815,1cyclictest0-21swapper/123:39:401
2556498991811,6cyclictest2596653-21diskmemload21:49:381
255649799183,10cyclictest2697165-21fschecks_time22:59:350
112699180,4rtkit-daemon1008-21mta-sts-daemon23:23:521
112699180,3rtkit-daemon1125-21rtkit-daemon20:06:000
255649999179,5cyclictest2586748-21grep20:39:402
255649999174,10cyclictest2693399-21/usr/sbin/munin22:54:422
255649999173,9cyclictest2615369-21cat21:30:402
255649999173,12cyclictest2599577-21cut21:14:332
255649999172,11cyclictest2735577-21cut23:44:332
255649999171,11cyclictest2646685-21fschecks_time22:04:352
255649899175,8cyclictest118475-21wpa_supplicant00:14:381
255649899173,11cyclictest619-21mta-sts-daemon23:05:431
255649899172,1cyclictest0-21swapper/122:49:451
2556498991714,2cyclictest2767240-21cron00:20:401
2556498991714,2cyclictest0-21swapper/123:59:351
2556498991714,2cyclictest0-21swapper/123:59:351
2556498991714,1cyclictest0-21swapper/122:09:341
255649899171,2cyclictest2723750-21cat23:30:411
255649799174,0cyclictest0-21swapper/000:19:320
255649799173,8cyclictest2556462-21munin-run19:10:400
2556497991714,2cyclictest2732807-21cron23:40:410
2556497991712,1cyclictest2652979-21munin-run22:10:400
112699170,4rtkit-daemon1125-21rtkit-daemon00:38:151
112699170,3rtkit-daemon1125-21rtkit-daemon00:04:470
255650099162,6cyclictest0-21swapper/321:54:353
255649999167,6cyclictest2697385-21/usr/sbin/munin22:59:362
255649999167,5cyclictest2637162-21/usr/sbin/munin21:54:342
255649999165,8cyclictest2740672-21/usr/sbin/munin23:49:372
255649999164,8cyclictest2749956-21/usr/sbin/munin23:59:372
255649999164,8cyclictest2749956-21/usr/sbin/munin23:59:372
255649999164,7cyclictest2753682-21/usr/sbin/munin00:04:322
255649999164,6cyclictest2714251-21aten_r2power_po23:19:332
255649999163,10cyclictest619-21mta-sts-daemon22:33:202
255649999162,11cyclictest2682632-21ssh22:44:322
2556499991613,2cyclictest2594965-21unixbench_singl21:04:432
255649999161,1cyclictest0-21swapper/221:49:372
255649899162,11cyclictest2636742-21/usr/sbin/munin21:54:311
255649899161,9cyclictest2691977-21aten_r2power_en22:54:311
2556498991614,1cyclictest0-21swapper/100:04:411
2556498991612,3cyclictest2774158-21ntp_kernel_err00:29:371
2556498991612,2cyclictest1006-21mta-sts-daemon19:34:381
255649799164,9cyclictest2596653-21diskmemload21:54:370
255649799162,10cyclictest2673836-21/usr/sbin/munin22:34:310
2556497991614,1cyclictest0-21swapper/021:19:340
2556497991614,0cyclictest0-21swapper/023:34:350
2556497991613,2cyclictest2573202-21unixbench_singl19:59:420
255649799161,10cyclictest0-21swapper/000:29:360
255649799160,9cyclictest0-21swapper/000:38:300
255649999159,5cyclictest0-21swapper/200:29:342
255649999155,3cyclictest2656546-21ssh22:14:422
255649999154,7cyclictest11050irq/107-eth%d00:24:372
255649999153,10cyclictest2730723-21/usr/sbin/munin23:39:312
255649999153,10cyclictest0-21swapper/221:24:332
255649999152,8cyclictest2689421-21apt-key22:50:412
255649999152,10cyclictest2726555-21grep23:34:362
255649999152,10cyclictest2628305-21/usr/sbin/munin21:44:372
2556499991510,4cyclictest2593238-21grep20:59:422
2556499991510,3cyclictest0-21swapper/222:39:362
255649899159,4cyclictest0-21swapper/120:59:371
255649899154,4cyclictest11050irq/107-eth%d23:34:411
255649899154,2cyclictest11050irq/107-eth%d23:49:381
255649899154,2cyclictest11050irq/107-eth%d23:19:381
255649899153,6cyclictest11050irq/107-eth%d22:24:401
255649899153,11cyclictest2679592-21/usr/sbin/munin22:39:411
255649899153,10cyclictest2656623-21ssh22:14:431
2556498991512,3cyclictest2647154-21ntp_kernel_err22:04:381
255649899151,11cyclictest2710482-21ntp_states23:14:391
255649799152,3cyclictest11050irq/107-eth%d22:14:340
255649799151,8cyclictest2594712-21/usr/sbin/munin21:04:420
2556497991512,2cyclictest2692800-21ntpq22:54:370
255650099143,8cyclictest0-21swapper/322:14:393
255650099143,6cyclictest0-21swapper/300:34:433
255650099143,6cyclictest0-21swapper/300:14:343
255650099142,6cyclictest0-21swapper/323:19:413
255650099140,8cyclictest0-21swapper/321:59:363
255649999149,2cyclictest0-21swapper/200:19:322
255649999142,7cyclictest2604483-21/usr/sbin/munin21:19:362
255649999142,2cyclictest0-21swapper/221:39:332
2556499991412,1cyclictest2573815-21fschecks_count20:04:332
255649999141,10cyclictest2781700-21uniq00:39:342
255649899149,4cyclictest2582079-21latency_hist20:25:411
255649899147,3cyclictest1008-21mta-sts-daemon21:29:401
255649899147,2cyclictest11050irq/107-eth%d22:27:041
255649899145,7cyclictest0-21swapper/122:59:361
255649899144,8cyclictest2623105-21ssh21:39:351
255649899144,4cyclictest0-21swapper/120:54:341
255649899143,8cyclictest2599540-21grep21:14:331
255649899143,7cyclictest2758172-21/usr/sbin/munin00:09:331
255649899143,7cyclictest2702378-21cat23:05:411
255649899142,11cyclictest2683536-21/usr/sbin/munin22:44:391
255649899141,10cyclictest2579116-21cut20:19:361
255649799148,4cyclictest2577526-21/usr/sbin/munin20:14:330
112699140,1rtkit-daemon0-21swapper/020:55:440
255650099131,5cyclictest0-21swapper/319:34:373
255649999133,8cyclictest2579276-21sed20:19:362
255649999133,8cyclictest2570498-21/usr/sbin/munin19:54:322
255649999132,8cyclictest2558882-21if_end019:19:352
255649999132,5cyclictest2666718-21ssh22:25:412
255649999131,9cyclictest2669557-21cut22:29:372
255649999131,9cyclictest2572168-21tune2fs19:59:332
255649999131,8cyclictest1007-21mta-sts-daemon23:25:412
2556499991311,1cyclictest0-21swapper/222:09:312
255649899139,3cyclictest0-21swapper/123:44:321
255649899138,4cyclictest2745320-21ntp_kernel_pll_23:54:391
255649899135,2cyclictest11050irq/107-eth%d19:24:351
255649899134,5cyclictest2777988-21sh00:34:371
255649899131,11cyclictest2660434-21grep22:19:361
255649899131,10cyclictest2574932-21apt-get20:05:431
255649799136,1cyclictest2562558-21ntpq19:29:380
255649799132,9cyclictest2570308-21/usr/sbin/munin19:54:310
255649799132,7cyclictest2702379-21grep23:05:410
255649799130,8cyclictest0-21swapper/020:54:420
255650099123,4cyclictest0-21swapper/323:34:343
255650099123,4cyclictest0-21swapper/322:44:383
255650099122,6cyclictest0-21swapper/322:49:393
255650099122,5cyclictest0-21swapper/323:39:363
255650099122,4cyclictest0-21swapper/320:59:383
255650099122,4cyclictest0-21swapper/300:29:093
255650099122,3cyclictest0-21swapper/300:21:053
255650099121,6cyclictest0-21swapper/322:59:383
255650099121,5cyclictest0-21swapper/323:14:343
255650099120,7cyclictest0-21swapper/323:59:313
255650099120,7cyclictest0-21swapper/323:59:313
255649999124,6cyclictest2590827-21/usr/sbin/munin20:54:352
255649999123,6cyclictest2564529-21cat19:34:412
255649999121,9cyclictest2702309-21latency_hist23:05:412
255649999121,9cyclictest2587388-21grep20:44:342
255649999121,9cyclictest2557480-21/usr/sbin/munin19:14:362
255649899128,3cyclictest2596089-21ntp_kernel_pll_21:09:391
255649899128,3cyclictest2586713-21grep20:39:401
255649899126,5cyclictest2570554-21tune2fs19:54:331
255649899124,2cyclictest11050irq/107-eth%d20:49:371
255649899123,6cyclictest2587943-21ntp_states20:44:391
255649899122,8cyclictest2565833-21ntp_states19:39:411
255649899122,7cyclictest2577830-21/usr/sbin/munin20:14:361
255649899121,9cyclictest2559861-21cat19:20:411
255649899121,1cyclictest0-21swapper/121:04:321
255649799129,2cyclictest2590000-21unixbench_multi20:49:410
255649799129,1cyclictest0-21swapper/020:34:410
255649799125,2cyclictest2580427-21date20:20:410
255649799122,7cyclictest2566398-21unin-run19:40:400
255649799121,7cyclictest2560333-21fschecks_count19:24:340
255649799121,1cyclictest0-21swapper/023:22:350
255650099115,2cyclictest0-21swapper/300:19:413
255650099113,5cyclictest0-21swapper/319:14:363
255650099113,4cyclictest0-21swapper/323:44:373
255650099113,3cyclictest0-21swapper/321:30:423
255650099112,5cyclictest0-21swapper/323:05:413
255650099112,4cyclictest0-21swapper/323:25:403
255650099112,4cyclictest0-21swapper/320:29:303
255650099111,6cyclictest0-21swapper/322:34:393
255649999118,2cyclictest2569615-21mailstats19:49:402
255649999118,2cyclictest0-21swapper/220:49:352
255649999113,6cyclictest2576302-21/usr/sbin/munin20:09:372
255649999112,8cyclictest2561666-21/usr/sbin/munin19:29:312
255649999112,8cyclictest2561002-21/usr/sbin/munin19:24:402
255649999111,8cyclictest2595394-21aten_r2power_po21:09:332
255649899118,3cyclictest2557530-21ntp_kernel_pll_19:14:371
255649899116,3cyclictest2572148-21/usr/sbin/munin19:59:331
255649899112,8cyclictest2567060-21aten_r2power_fr19:44:321
255649899111,7cyclictest2582640-21/usr/sbin/munin20:29:321
255649799118,2cyclictest0-21swapper/020:29:390
255649799118,2cyclictest0-21swapper/019:49:420
255649799118,2cyclictest0-21swapper/019:34:330
255649799111,7cyclictest2587141-21aten_r2power_fr20:44:320
255649799111,6cyclictest2573605-21tail20:04:310
255649799110,7cyclictest0-21swapper/020:39:380
255649799110,10cyclictest2581291-21ntpq20:24:380
255650099104,3cyclictest0-21swapper/323:54:363
255650099103,4cyclictest0-21swapper/322:54:373
255650099103,4cyclictest0-21swapper/322:29:353
255650099103,4cyclictest0-21swapper/321:24:433
255650099103,3cyclictest0-21swapper/323:29:343
255650099103,3cyclictest0-21swapper/321:49:353
255650099103,3cyclictest0-21swapper/319:54:393
255650099102,5cyclictest0-21swapper/323:09:343
255650099102,5cyclictest0-21swapper/322:39:323
255650099102,5cyclictest0-21swapper/322:24:413
255650099102,5cyclictest0-21swapper/321:44:353
255650099102,4cyclictest0-21swapper/323:49:333
255650099102,4cyclictest0-21swapper/321:19:413
255649999108,1cyclictest0-21swapper/220:24:352
255649999101,6cyclictest2577608-21sed20:14:342
255649899104,3cyclictest2561760-21aten_r2power_fr19:29:321
255649899103,5cyclictest2568953-21cut19:49:341
255649899101,7cyclictest2584011-21/usr/sbin/munin20:34:331
112699100,1rtkit-daemon0-21swapper/120:01:481
112699100,1rtkit-daemon0-21swapper/119:09:531
25565009993,5cyclictest0-21swapper/319:19:393
25565009993,2cyclictest0-21swapper/322:19:333
25565009992,5cyclictest0-21swapper/321:39:363
25565009992,4cyclictest0-21swapper/321:09:323
25565009992,4cyclictest0-21swapper/320:34:313
25565009992,4cyclictest0-21swapper/319:39:393
25565009991,6cyclictest0-21swapper/322:09:313
25565009991,5cyclictest0-21swapper/322:00:433
25565009990,5cyclictest0-21swapper/321:29:463
25564999995,3cyclictest967-21snmpd19:39:302
25564979998,1cyclictest0-21swapper/019:14:310
25565009985,3cyclictest0-21swapper/300:35:483
25565009983,4cyclictest0-21swapper/321:14:333
25565009983,3cyclictest0-21swapper/300:09:323
25565009982,4cyclictest0-21swapper/319:49:403
25565009982,3cyclictest0-21swapper/320:19:393
25565009982,3cyclictest0-21swapper/320:05:433
25565009981,4cyclictest0-21swapper/320:24:413
25564999985,2cyclictest0-21swapper/219:10:402
25565009974,2cyclictest0-21swapper/319:59:393
25565009972,3cyclictest0-21swapper/320:49:393
25565009972,3cyclictest0-21swapper/320:39:383
25565009972,3cyclictest0-21swapper/320:14:363
25565009972,3cyclictest0-21swapper/320:04:323
25565009971,3cyclictest0-21swapper/321:04:323
25565009971,3cyclictest0-21swapper/300:01:033
25565009970,4cyclictest0-21swapper/320:44:363
25565009970,4cyclictest0-21swapper/319:29:383
25565009970,4cyclictest0-21swapper/319:24:343
25565009962,3cyclictest0-21swapper/319:40:423
25565009961,3cyclictest0-21swapper/320:54:313
25565009961,2cyclictest0-21swapper/319:10:413
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional