You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-04-03 - 23:47

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackbslot7s.osadl.org (updated Thu Apr 03, 2025 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
265812520818,5178sleep320489-21kworker/3:110:17:233
265812520818,5178sleep320489-21kworker/3:110:17:233
258662343313,3407sleep320489-21kworker/3:108:18:233
27429261117,577sleep227449-21users08:20:532
20439260615,473sleep020456-21idleruntime-cro11:59:520
20439260615,473sleep020456-21idleruntime-cro11:59:520
127625507,531sleep01312-21ntpq08:45:180
16785238511,332sleep016848-21mailstats07:45:250
21060238454,263sleep021140-21fschecks_time08:00:190
3154423770,53sleep017443-1kworker/0:2H08:39:520
1054923747,348sleep00-21swapper/011:19:540
15767235413,327sleep115768-21sshd11:36:231
10922232310,290sleep011073-21latency_hist09:19:550
12420232013,217sleep012434-21fschecks_count11:25:110
2658229139,196sleep02798-21unixbench_singl07:00:250
30272229044,231sleep030386-21timerwakeupswit08:30:240
28147227922,195sleep028209-21fschecks_time08:25:150
5295227211,212sleep00-21swapper/008:59:520
14514226912,72sleep014652-21latency_hist07:39:550
16913224419,210sleep016984-21switchtime11:40:300
16913224419,210sleep016984-21switchtime11:40:300
5317223545,171sleep05411-21fschecks_time11:00:080
14557223517,170sleep014600-21ntp_kernel_pll_11:30:280
8996222320,185sleep19029-21/usr/sbin/munin11:10:351
24329221841,92sleep023829-21/usr/sbin/munin12:10:230
30927221672,16sleep00-21swapper/010:30:240
19832221527,151sleep019872-21latency09:50:150
26633220653,130sleep026647-21fschecks_count08:20:390
17721220523,163sleep117776-21grep11:45:071
17721220523,163sleep117776-21grep11:45:071
402021995,31sleep00-21swapper/010:51:080
601219849,89sleep00-21swapper/010:40:260
2072219751,125sleep00-21swapper/010:45:220
2072219751,125sleep00-21swapper/010:45:220
6219219333,117sleep06298-21timerandwakeup09:00:330
1837121919,166sleep018420-21awk09:45:190
1837121919,166sleep018420-21awk09:45:190
32076218113,151sleep32-21kthreadd10:39:523
7966218030,110sleep08037-21sort09:05:420
26026217743,58sleep01711-21cyclictest08:19:540
413217410,16sleep00-21swapper/006:55:130
2202421728,122sleep00-21swapper/012:04:530
22355216624,106sleep022432-21grep10:00:210
28875216444,48sleep028922-21munin-run12:29:530
1216721627,141sleep012244-21readlink07:30:220
1052321626,116sleep00-21swapper/007:25:210
818215414,124sleep2857-21processes06:55:312
7264215411,57sleep07326-21uname11:05:330
26187215437,78sleep026271-21latency_hist10:14:540
9795215336,74sleep00-21swapper/007:24:530
275821538,117sleep00-21swapper/008:50:150
275821538,117sleep00-21swapper/008:50:150
6450215110,12sleep10-21swapper/107:11:331
29317215118,117sleep329456-21unixbench_singl10:25:233
2119721510,9sleep20-21swapper/208:00:202
1896021498,121sleep00-21swapper/011:50:230
351121459,73sleep03573-21switchtime07:04:580
6784214316,51sleep00-21swapper/007:14:550
24579214343,54sleep024636-21systemd-run10:09:530
24579214343,54sleep024636-21systemd-run10:09:530
24066214143,55sleep0370-21snmpd08:10:040
27289214015,35sleep10-21swapper/108:20:521
18130214017,54sleep00-21swapper/007:50:170
32095213617,38sleep00-21swapper/010:39:530
2346521355,11sleep00-21swapper/008:06:010
9221213216,92sleep39306-21awk11:10:413
16251213042,75sleep016316-21latency_hist11:40:090
22757212910,80sleep022831-21mailstats12:05:220
29141212822,91sleep129212-21sensors_temp10:25:211
30183212038,51sleep230179-21apt-get10:30:062
3571211716,87sleep13628-21mailstats10:50:241
19598211316,81sleep219651-21/usr/sbin/munin07:55:122
470721129,84sleep24821-21timerwakeupswit08:55:262
1978211216,74sleep32068-21mailstats10:45:213
1978211216,74sleep32068-21mailstats10:45:213
25153211110,20sleep125154-21sshd08:12:241
12956211039,21sleep00-21swapper/009:25:160
17041210930,60sleep317190-21grep07:45:283
7083210818,67sleep17163-21tune2fs07:15:121
6301210819,70sleep16443-21sed09:00:341
30020210812,79sleep230057-21/usr/sbin/munin08:30:182
19228210827,57sleep219378-21tail11:50:292
11029210824,46sleep011087-21idleruntime11:21:070
3222210615,75sleep1194-21jbd2/mmcblk2p2-07:04:541
25152210620,68sleep225246-21memory10:10:162
20727210629,63sleep020787-21date07:59:550
12336210613,76sleep212457-21timerwakeupswit07:30:242
14118210510,71sleep10-21swapper/111:30:051
13065210520,68sleep213091-21netstat09:25:182
10177210418,72sleep110197-21fschecks_count07:25:141
22306210114,74sleep122376-21latency_hist08:04:561
17173210122,57sleep317317-21grep09:40:213
1520421019,50sleep00-21swapper/007:40:240
256862996,11sleep00-21swapper/012:19:070
256862996,11sleep00-21swapper/012:19:070
1427729920,23sleep20-21swapper/211:30:222
1309329915,60sleep312673-21/usr/sbin/munin09:25:193
787329818,57sleep27896-21/usr/sbin/munin09:05:402
553929710,70sleep35599-21fschecks_time07:10:143
295372975,11sleep00-21swapper/010:25:360
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional