You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-11-22 - 08:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack2slot7s.osadl.org (updated Fri Nov 22, 2024 00:43:08)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
203780099584,8cyclictest0-21swapper/122:25:531
2037800995538,11cyclictest421-21avahi-daemon23:00:501
2037801995434,16cyclictest2181511-21ssh23:40:022
2037801995434,16cyclictest2181511-21ssh23:40:022
2037801995142,6cyclictest453-21systemd-logind23:20:022
2037801994938,7cyclictest2048310-21systemd-run19:45:022
2037801994933,12cyclictest2058768-21latency_hist20:20:012
2037801994739,4cyclictest0-21swapper/223:31:002
2037801994639,4cyclictest2194359-21lockfile-create00:00:012
2037801994636,6cyclictest2185054-21latency_hist23:45:022
2037801994636,6cyclictest2185054-21latency_hist23:45:022
203780199454,31cyclictest2129943-21ssh22:25:472
2037801994524,18cyclictest2141459-21unixbench_singl22:41:002
2037799994530,12cyclictest2095643-21sendmail21:40:010
203780199442,15cyclictest2067298-21ps20:45:532
2037800994433,6cyclictest0-21swapper/122:15:491
203780199433,8cyclictest2111642-21ssh22:00:542
2037801994333,6cyclictest2157448-21aten_r2power_en23:05:382
203780199432,5cyclictest2071740-21ntpq21:00:522
203780199432,5cyclictest2043219-21ntpq19:25:502
203780199432,17cyclictest2107802-21ssh21:55:472
2037801994318,22cyclictest2162044-21timerwakeupswit23:11:012
2037799994333,7cyclictest2187343-21grep23:50:010
2037799994333,7cyclictest2187343-21grep23:50:010
203780199423,6cyclictest2070171-21ntpq20:55:472
2037801994236,3cyclictest0-21swapper/200:25:432
2037801994234,3cyclictest0-21swapper/221:20:012
203780199422,7cyclictest2122574-21ntpq22:15:512
203780199422,6cyclictest2068714-21ntpq20:50:522
203780199421,9cyclictest2039813-21gltestperf19:15:422
203780199421,13cyclictest2094123-21ssh21:36:382
203780199421,10cyclictest2151183-21ntpq22:55:482
203780199421,10cyclictest2059688-21ntpq20:20:502
2037800994234,5cyclictest2088421-21systemd-run21:30:011
2037799994230,9cyclictest2181481-21cron23:40:010
2037799994230,9cyclictest2181481-21cron23:40:010
203780199418,30cyclictest2196956-21sh00:02:512
203780199418,30cyclictest2196956-21sh00:02:512
203780199413,8cyclictest2086138-21ntpq21:25:542
203780199413,7cyclictest2209178-21ntpq00:20:512
203780199413,6cyclictest2044674-21ntpq19:30:472
2037801994133,5cyclictest2217099-21ssh00:35:012
2037801994129,8cyclictest219547-21cups-browsed22:51:242
203780199412,6cyclictest2052170-21ntpq19:55:492
2037801994121,17cyclictest0-21swapper/200:15:382
203780199411,9cyclictest2073149-21ntpq21:05:482
203780199411,9cyclictest2053701-21ntpq20:00:522
203780199411,9cyclictest2041445-21kernelversion19:20:432
203780199411,15cyclictest2050758-21ntpq19:50:562
203780199411,12cyclictest2172074-21ntpq23:25:512
203780199411,10cyclictest2185373-21ssh23:45:192
203780199411,10cyclictest2185373-21ssh23:45:192
203780199411,10cyclictest2133802-21ntpq22:30:582
2037800994135,3cyclictest0-21swapper/123:10:481
2037800994131,7cyclictest422-21dbus-daemon00:40:011
2037800994131,6cyclictest2135942-21munin-plugin-st22:35:011
2037800994130,7cyclictest957-21mta-sts-daemon20:00:481
2037800994130,6cyclictest0-21swapper/119:20:021
203780199407,4cyclictest2125278-21ssh22:20:032
203780199404,29cyclictest2096907-21ntpq21:40:502
203780199403,6cyclictest2049202-21ntpq19:45:512
203780199402,6cyclictest2100520-21ntpq21:45:492
203780199402,6cyclictest2038665-21ntpq19:10:482
203780199402,5cyclictest2188549-21ntpq23:50:482
203780199402,5cyclictest2061193-21ntpq20:25:482
203780199401,5cyclictest2118954-21ntpq22:10:542
203780199401,15cyclictest2046297-21ps19:35:532
203780199401,12cyclictest2065281-21diskstats20:40:402
203780199401,10cyclictest2138159-21ssh22:36:462
203780199400,11cyclictest2117547-21ssh22:09:502
2037800994029,7cyclictest219547-21cups-browsed21:55:481
2037800994028,8cyclictest2201908-21aten_r2power_cu00:10:451
203780099402,31cyclictest2115354-21ssh22:05:561
203780099401,9cyclictest171rcu_preempt19:50:521
2037799994026,12cyclictest2114584-21aten_r2power_fr22:05:400
203779999401,21cyclictest219547-21cups-browsed21:46:040
203780199392,4cyclictest2062693-21ntpq20:30:492
203780199391,9cyclictest2103308-21ssh21:50:172
203780199391,8cyclictest2168629-21ntp_offset23:20:552
203780199391,6cyclictest2082478-21ntpq21:20:542
203780199391,6cyclictest2055415-21sensors_volt20:05:572
203780199391,12cyclictest2154632-21ntpq23:00:492
203780199391,11cyclictest2218295-21ntpq00:35:502
203780199391,11cyclictest2143485-21ssh22:45:292
203780199391,10cyclictest2203821-21ssh00:12:332
2037800993932,4cyclictest2095686-21systemd21:40:021
2037800993931,5cyclictest2185014-21ssh23:45:011
2037800993931,5cyclictest2185014-21ssh23:45:011
2037800993930,5cyclictest2174486-21latency_hist23:30:031
2037800993928,8cyclictest2052787-21sendmail20:00:011
2037799993930,7cyclictest2194370-21/usr/sbin/munin00:00:010
2037799993930,6cyclictest151ktimers/023:10:520
203780199382,9cyclictest2075035-21ssh21:10:492
203780199381,5cyclictest2056703-21ntpq20:10:522
203780199381,4cyclictest2064111-21ntpq20:35:452
203780199381,10cyclictest2199021-21ntpq00:05:522
203780199380,9cyclictest2089719-21modprobe21:30:562
2037800993830,5cyclictest2070758-21munin-plugin-st21:00:011
2037800993829,6cyclictest2170809-21munin-plugin-st23:25:011
2037800993818,14cyclictest271ktimers/120:25:471
2037800993815,8cyclictest2089602-21ssh21:30:521
2037799993830,4cyclictest2081246-21kworker/u8:8-xprtiod21:35:020
203780099372,9cyclictest171rcu_preempt21:50:541
2037800993728,7cyclictest2149965-21/usr/sbin/munin22:55:021
2037800993728,6cyclictest2217104-21latency_hist00:35:011
2037800993726,7cyclictest219547-21cups-browsed22:01:081
2037799993712,18cyclictest12450irq/32-eth000:35:490
203780099363,26cyclictest2078744-21ssh21:15:521
2037800993629,3cyclictest0-21swapper/100:25:011
2037800993628,6cyclictest422-21dbus-daemon20:55:011
2037800993628,5cyclictest2096276-21aten_r2power_po21:40:381
2037800993628,4cyclictest0-21swapper/121:10:021
2037800993626,6cyclictest421-21avahi-daemon23:07:381
2037800993626,6cyclictest219547-21cups-browsed19:35:021
2037800993623,9cyclictest2165136-21ntpq23:15:591
203780099362,25cyclictest2082421-21ssh21:20:511
203779999366,8cyclictest422-21dbus-daemon20:15:010
2037799993627,6cyclictest453-21systemd-logind19:55:020
203779999362,30cyclictest2140932-21ssh22:40:510
203779999362,26cyclictest2137169-21ssh22:35:490
203780099353,27cyclictest2179187-21sh23:35:501
203780099353,27cyclictest2179187-21sh23:35:501
2037800993526,4cyclictest0-21swapper/122:35:501
2037800993525,8cyclictest2206053-21sh00:15:561
2037799993527,5cyclictest421-21avahi-daemon23:30:020
2037799993527,5cyclictest2194438-21cups-browsed00:16:400
2037799993525,7cyclictest2211421-21ls00:25:020
2037799993524,9cyclictest2125736-21sh22:20:400
2037799993520,12cyclictest2198646-21fschecks_time00:05:460
2037799993512,18cyclictest2130092-21ssh22:25:530
2037800993427,4cyclictest2177922-21ssh23:35:011
2037800993426,5cyclictest2064764-21munin-run20:40:011
2037800993426,4cyclictest956-21mta-sts-daemon19:25:481
2037800993425,6cyclictest266-21systemd-journal19:15:001
2037800993424,3cyclictest0-21swapper/122:20:551
2037800993421,7cyclictest2198483-21aten_r2power_vo00:05:431
2037800993418,11cyclictest2194438-21cups-browsed00:00:531
2037800993418,11cyclictest2194438-21cups-browsed00:00:531
203779999344,24cyclictest2111710-21ssh22:00:560
2037799993428,3cyclictest0-21swapper/023:10:010
2037799993428,3cyclictest0-21swapper/021:11:030
2037799993427,4cyclictest956-21mta-sts-daemon23:15:580
2037799993426,3cyclictest0-21swapper/022:55:470
2037799993425,6cyclictest2108724-21sh21:56:320
2037799993425,6cyclictest12450irq/32-eth022:31:000
2037799993425,4cyclictest2076758-21kworker/u8:6-xprtiod21:25:530
203779999342,27cyclictest2096881-21ssh21:40:490
2037799993421,10cyclictest0-21swapper/023:31:040
2037800993325,5cyclictest2188703-21proc_pri23:50:551
2037800993325,5cyclictest2057264-21cron20:15:001
2037800993325,4cyclictest0-21swapper/121:45:581
2037800993324,5cyclictest2075670-21unixbench_singl21:11:031
2037800993321,3cyclictest2065898-21mailstats20:40:571
2037800993319,9cyclictest2192126-21rm23:55:521
2037800993311,17cyclictest422-21dbus-daemon20:45:511
2037799993326,5cyclictest2215872-21sed00:31:060
2037799993325,4cyclictest0-21swapper/021:05:510
2037799993323,7cyclictest2122388-21missed_timers22:15:450
2037799993316,2cyclictest0-21swapper/022:10:570
2037800993223,6cyclictest422-21dbus-daemon22:43:481
2037799993226,3cyclictest0-21swapper/019:40:010
2037799993224,6cyclictest2060178-21unixbench_multi20:21:000
2037799993224,5cyclictest2078503-21/usr/sbin/munin21:15:450
2037800993126,2cyclictest0-21swapper/120:20:021
2037800993125,3cyclictest0-21swapper/122:45:571
2037800993124,3cyclictest0-21swapper/122:58:131
203780099312,23cyclictest2118860-21ssh22:10:501
2037799993125,4cyclictest2058772-21munin-run20:20:010
2037799993124,5cyclictest421-21avahi-daemon23:01:400
2037799993124,4cyclictest2144616-21switchtime22:46:040
2037799993120,8cyclictest2044054-21aten_r2power_cu19:30:360
2037799993116,11cyclictest12450irq/32-eth023:20:540
203780199301,6cyclictest2037830-21date19:10:022
203780199301,6cyclictest2037830-21date19:10:022
2037799993024,4cyclictest2052789-21idleruntime-cro20:00:010
2037799993024,4cyclictest2042244-21unixbench_singl19:20:590
2037799993023,4cyclictest957-21mta-sts-daemon00:10:580
2037799993023,3cyclictest0-21swapper/023:40:440
2037799993023,3cyclictest0-21swapper/023:40:440
203780099295,13cyclictest437-21mta-sts-daemon19:40:491
2037800992923,3cyclictest0-21swapper/119:20:581
203779999293,18cyclictest2147773-21ssh22:51:010
2037799992924,3cyclictest956-21mta-sts-daemon21:05:020
2037799992923,3cyclictest0-21swapper/021:25:010
2037799992921,6cyclictest2195921-21wc00:01:030
2037799992921,6cyclictest2195921-21wc00:01:030
2037799992921,5cyclictest0-21swapper/019:20:010
2037799992920,6cyclictest421-21avahi-daemon20:05:020
2037799992912,11cyclictest12450irq/32-eth000:25:530
2037799992822,3cyclictest957-21mta-sts-daemon21:52:590
2037799992822,3cyclictest0-21swapper/023:50:400
2037799992820,6cyclictest2038185-21aten_r2power_vo19:10:390
2037800992719,5cyclictest2213133-21unixbench_singl00:26:021
2037799992722,2cyclictest0-21swapper/020:10:010
2037799992719,6cyclictest2061146-21ntp_kernel_err20:25:460
2037800992620,3cyclictest0-21swapper/119:46:011
2037800992618,5cyclictest0-21swapper/123:48:141
2037800992618,5cyclictest0-21swapper/123:48:141
2037800992618,4cyclictest0-21swapper/120:20:521
2037799992621,2cyclictest0-21swapper/019:25:480
2037799992618,3cyclictest0-21swapper/020:40:530
2037799992616,4cyclictest0-21swapper/020:45:480
2037800992516,6cyclictest2046773-21sendmail19:40:011
2037800992514,8cyclictest2055182-21ntp_kernel_pll_20:05:491
2037799992518,5cyclictest2049801-21systemd-run19:50:010
2037799992518,4cyclictest2064705-21unixbench_singl20:35:580
203780099243,16cyclictest2062792-21ps20:30:541
203780099241,5cyclictest171rcu_preempt21:00:471
2037799992418,3cyclictest0-21swapper/019:10:010
2037799992418,3cyclictest0-21swapper/019:10:010
2037799992416,5cyclictest1553077-21kworker/u8:1+xprtiod19:41:020
2037799992414,8cyclictest1-21systemd20:51:140
203779999232,15cyclictest2062703-21ntpq20:30:500
2037799992010,7cyclictest2070264-21/usr/sbin/munin20:55:510
2037800991914,2cyclictest0-21swapper/119:10:011
2037800991914,2cyclictest0-21swapper/119:10:011
203780299182,9cyclictest0-21swapper/321:50:563
203780299181,6cyclictest0-21swapper/322:25:533
203780299174,7cyclictest0-21swapper/321:10:503
203780299172,9cyclictest0-21swapper/322:55:453
203780299172,9cyclictest0-21swapper/321:40:543
203780299172,8cyclictest0-21swapper/323:25:513
203780299172,8cyclictest0-21swapper/321:15:483
203780299171,9cyclictest0-21swapper/322:15:423
203780299164,6cyclictest0-21swapper/322:40:523
203780299164,6cyclictest0-21swapper/322:35:523
203780299162,9cyclictest0-21swapper/321:45:543
203780299162,8cyclictest0-21swapper/322:10:493
203780299162,8cyclictest0-21swapper/300:05:563
203780299161,9cyclictest0-21swapper/300:25:543
203780299161,7cyclictest0-21swapper/319:55:533
203780299154,7cyclictest0-21swapper/323:55:493
203780299153,8cyclictest0-21swapper/300:21:043
203780299153,7cyclictest0-21swapper/323:15:593
203780299152,8cyclictest0-21swapper/323:30:533
203780299152,8cyclictest0-21swapper/323:05:513
203780299152,8cyclictest0-21swapper/323:00:503
203780299152,8cyclictest0-21swapper/322:05:473
203780299152,7cyclictest0-21swapper/300:15:533
203780299152,6cyclictest0-21swapper/319:45:503
203780299152,5cyclictest0-21swapper/320:55:443
203780299151,9cyclictest0-21swapper/323:40:593
203780299151,9cyclictest0-21swapper/323:40:593
203780299151,8cyclictest0-21swapper/322:45:553
203780299151,8cyclictest0-21swapper/321:20:513
203780299151,8cyclictest0-21swapper/300:30:533
203780299151,8cyclictest0-21swapper/300:10:573
203780299151,7cyclictest0-21swapper/320:30:503
203780299151,7cyclictest0-21swapper/320:00:513
203780299144,7cyclictest0-21swapper/321:30:523
203780299143,7cyclictest0-21swapper/321:35:473
203780299143,7cyclictest0-21swapper/321:25:523
203780299143,6cyclictest0-21swapper/322:21:023
203780299143,4cyclictest0-21swapper/319:40:523
203780299142,7cyclictest0-21swapper/323:50:473
203780299142,7cyclictest0-21swapper/322:30:523
203780299142,5cyclictest0-21swapper/320:40:523
203780299141,8cyclictest0-21swapper/300:35:523
203780299141,7cyclictest0-21swapper/323:35:483
203780299141,7cyclictest0-21swapper/323:35:483
203780299141,6cyclictest0-21swapper/319:50:503
203780299141,5cyclictest0-21swapper/321:00:463
203780299133,4cyclictest0-21swapper/320:15:553
203780299133,4cyclictest0-21swapper/319:30:523
203780299132,7cyclictest0-21swapper/323:10:453
203780299132,7cyclictest0-21swapper/322:50:583
203780299132,5cyclictest0-21swapper/320:35:493
203780299131,8cyclictest0-21swapper/300:00:453
203780299131,8cyclictest0-21swapper/300:00:453
203780299131,6cyclictest0-21swapper/322:00:393
203780299131,6cyclictest0-21swapper/321:55:363
203780299131,6cyclictest0-21swapper/320:50:553
203780299131,5cyclictest0-21swapper/320:25:453
203780299123,7cyclictest0-21swapper/319:35:463
203780299122,7cyclictest0-21swapper/323:20:533
203780299121,6cyclictest0-21swapper/323:49:133
203780299121,6cyclictest0-21swapper/323:49:133
203780299121,6cyclictest0-21swapper/320:45:493
203780299121,6cyclictest0-21swapper/319:10:493
203780299114,4cyclictest0-21swapper/319:20:483
203780299113,4cyclictest0-21swapper/320:20:483
203780299112,6cyclictest0-21swapper/321:05:513
203780299111,6cyclictest0-21swapper/320:10:473
203780299111,6cyclictest0-21swapper/319:25:513
203780299111,6cyclictest0-21swapper/319:15:443
203780299104,4cyclictest0-21swapper/320:05:483
203780299101,6cyclictest0-21swapper/319:10:023
203780299101,6cyclictest0-21swapper/319:10:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional