You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-11-23 - 20:37

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Sat Nov 23, 2024 12:59:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
202459911841169,10cyclictest20682-21diskstats07:25:141
202459911841169,10cyclictest20682-21diskstats07:25:131
202449911561125,18cyclictest20681-21diskstats07:25:130
202449911561125,18cyclictest20681-21diskstats07:25:130
198382562517,30sleep10-21swapper/107:21:181
201742460416,29sleep00-21swapper/007:24:510
20792820,4sleep00-21swapper/012:20:190
5262600,8sleep12024599cyclictest12:15:271
176822600,2sleep017684-21uname11:35:210
231442590,8sleep02024499cyclictest10:20:220
210702550,11sleep12024599cyclictest10:15:191
246922450,5sleep1211ktimersoftd/111:55:121
20245993926,10cyclictest22-21ksoftirqd/109:30:231
174022392,32sleep117485-21memory10:05:231
165202381,34sleep130944-21snmpd08:35:291
20245993722,12cyclictest22-21ksoftirqd/111:05:221
117302371,31sleep011751-21/usr/sbin/munin09:50:240
2024499361,22cyclictest14314-21ps08:30:270
227602350,2sleep022759-21aten_r4power_en11:50:100
20245993528,4cyclictest22-21ksoftirqd/107:40:151
2024499356,10cyclictest0-21swapper/009:49:500
60062342,28sleep16027-21iostat_ios12:30:221
20245993427,4cyclictest22-21ksoftirqd/109:55:261
20245993427,4cyclictest22-21ksoftirqd/108:40:101
20245993427,4cyclictest22-21ksoftirqd/107:35:161
20245993418,12cyclictest22-21ksoftirqd/108:10:121
2024499343,15cyclictest4670-21memory08:05:220
2024499341,4cyclictest0-21swapper/007:50:180
2024499341,21cyclictest27878-21find07:40:270
195072341,4sleep019508-21ntp_states10:10:290
20245993326,4cyclictest22-21ksoftirqd/112:20:121
20245993326,4cyclictest22-21ksoftirqd/112:10:161
20245993326,4cyclictest22-21ksoftirqd/111:30:121
20245993326,4cyclictest22-21ksoftirqd/110:50:191
20245993326,4cyclictest22-21ksoftirqd/109:45:161
20245993326,4cyclictest22-21ksoftirqd/109:43:471
20245993326,4cyclictest22-21ksoftirqd/109:43:461
20245993326,4cyclictest22-21ksoftirqd/109:05:281
20245993326,4cyclictest22-21ksoftirqd/108:55:121
20245993326,4cyclictest22-21ksoftirqd/108:55:111
20245993326,4cyclictest22-21ksoftirqd/108:50:171
20245993326,4cyclictest22-21ksoftirqd/108:25:141
20245993326,4cyclictest22-21ksoftirqd/108:20:121
20245993323,7cyclictest22-21ksoftirqd/112:45:271
20245993322,8cyclictest22-21ksoftirqd/111:00:151
2024499331,8cyclictest0-21swapper/010:45:120
2024599328,4cyclictest22-21ksoftirqd/110:38:551
20245993226,4cyclictest22-21ksoftirqd/109:35:151
20245993226,3cyclictest22-21ksoftirqd/109:20:101
20245993225,4cyclictest22-21ksoftirqd/112:35:311
20245993225,4cyclictest22-21ksoftirqd/111:45:131
20245993225,4cyclictest22-21ksoftirqd/111:20:111
20245993225,4cyclictest22-21ksoftirqd/111:15:391
20245993225,4cyclictest22-21ksoftirqd/110:47:561
20245993225,4cyclictest22-21ksoftirqd/110:40:241
20245993225,4cyclictest22-21ksoftirqd/110:25:301
20245993225,4cyclictest22-21ksoftirqd/110:10:141
20245993225,4cyclictest22-21ksoftirqd/109:15:161
20245993225,4cyclictest22-21ksoftirqd/108:05:221
20245993225,4cyclictest22-21ksoftirqd/108:00:591
20245993222,6cyclictest19012-21wget11:40:101
20245993219,10cyclictest22-21ksoftirqd/111:50:261
2024499326,8cyclictest81rcu_preempt08:40:000
2024499321,7cyclictest5903-21aten_r4power_en08:10:110
20244993216,13cyclictest3-21ksoftirqd/010:39:480
2024499321,4cyclictest81rcu_preempt09:59:500
2024499321,4cyclictest81rcu_preempt08:57:480
2024499321,4cyclictest81rcu_preempt08:57:480
2024499321,17cyclictest1396-21munin-run12:20:000
145542321,9sleep00-21swapper/012:53:360
287832311,25sleep028856-21hddtemp_smartct12:05:180
20245993125,4cyclictest22-21ksoftirqd/112:50:081
20245993125,4cyclictest22-21ksoftirqd/112:40:161
20245993125,4cyclictest22-21ksoftirqd/110:55:161
20245993125,3cyclictest22-21ksoftirqd/109:50:201
20245993125,3cyclictest22-21ksoftirqd/107:55:011
20245993124,4cyclictest22-21ksoftirqd/112:00:131
20245993124,4cyclictest22-21ksoftirqd/111:35:161
20245993124,4cyclictest22-21ksoftirqd/109:25:281
20245993124,4cyclictest22-21ksoftirqd/109:00:291
20245993124,4cyclictest22-21ksoftirqd/109:00:291
20245993124,4cyclictest22-21ksoftirqd/108:45:101
20245993124,4cyclictest22-21ksoftirqd/108:30:171
20245993124,4cyclictest22-21ksoftirqd/108:15:321
20245993124,4cyclictest22-21ksoftirqd/107:30:241
20245993123,4cyclictest22-21ksoftirqd/110:20:281
2024499311,4cyclictest81rcu_preempt10:32:570
20244993111,11cyclictest0-21swapper/011:10:280
316552301,6sleep00-21swapper/012:11:540
20245993023,4cyclictest22-21ksoftirqd/111:10:231
20245993023,4cyclictest22-21ksoftirqd/109:10:211
20245993020,7cyclictest22-21ksoftirqd/112:25:121
2024599301,24cyclictest40950irq/93-i91512:05:181
2024499305,12cyclictest21674-21ntp_states11:45:250
2024499302,15cyclictest13284-21iostat_ios11:20:200
2024499302,13cyclictest25166-21fschecks_count07:35:150
20244993016,8cyclictest15472-21df_inode11:30:110
2024499301,4cyclictest81rcu_preempt12:43:390
2024499301,4cyclictest81rcu_preempt09:37:300
2024499301,4cyclictest81rcu_preempt08:03:190
20244993012,6cyclictest6045-21/usr/sbin/munin12:30:240
2024499301,25cyclictest6725-21taskset11:03:290
2024499301,18cyclictest12413-21runrttasks11:19:040
2024499300,4cyclictest81rcu_preempt11:06:260
2024499300,4cyclictest81rcu_preempt08:40:070
84162291,5sleep00-21swapper/009:40:310
84162291,5sleep00-21swapper/009:40:300
52392291,5sleep00-21swapper/012:29:470
45832291,5sleep00-21swapper/010:55:590
20245992922,4cyclictest22-21ksoftirqd/107:55:141
20245992922,4cyclictest22-21ksoftirqd/107:45:151
2024499296,12cyclictest2220-21dbus-daemon07:49:570
2024499294,4cyclictest81rcu_preempt10:30:020
2024499292,12cyclictest2750-21python09:25:280
2024499292,12cyclictest19789-21ntp_states11:40:230
20244992913,13cyclictest3-21ksoftirqd/009:20:540
2024499291,24cyclictest31152-21ntp_states09:15:260
20244992911,6cyclictest1273-21/usr/sbin/munin10:50:140
20244992911,5cyclictest8094-21awk12:35:250
20244992910,6cyclictest23215-21/usr/sbin/munin07:30:150
20244992910,6cyclictest0-21swapper/011:57:470
165632291,5sleep00-21swapper/010:04:190
20245992821,4cyclictest22-21ksoftirqd/110:00:171
20245992813,12cyclictest22-21ksoftirqd/110:30:021
20245992812,4cyclictest22-21ksoftirqd/111:25:141
2024499286,10cyclictest0-21swapper/011:25:210
2024499282,13cyclictest0-21swapper/012:00:170
20244992818,6cyclictest11131-21wget12:45:110
2024499281,4cyclictest81rcu_preempt10:18:570
20244992810,6cyclictest8426-21memory08:15:240
20244992810,5cyclictest26895-21fschecks_count09:05:150
15502281,5sleep00-21swapper/007:57:140
110182281,5sleep00-21swapper/008:21:360
51582271,5sleep00-21swapper/009:33:080
300132271,4sleep00-21swapper/009:13:350
2024499272,13cyclictest20303-21users08:45:300
2024499269,5cyclictest11916-21grep08:25:150
2024499261,13cyclictest24746-21/usr/sbin/munin09:00:110
2024499261,13cyclictest24746-21/usr/sbin/munin09:00:110
2024499261,11cyclictest30662-21memory10:40:220
20244992610,12cyclictest22324-21taskset08:51:520
2024499251,13cyclictest18430-21taskset10:09:110
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional