You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-11-22 - 08:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack9slot4s (updated Fri Nov 22, 2024 00:59:00)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
61489912381207,21cyclictest0-21swapper/019:25:130
61499910871058,25cyclictest6399-21wget19:25:111
43732565517,32sleep10-21swapper/119:20:031
43722563518,30sleep00-21swapper/019:20:010
249092990,9sleep0614899cyclictest21:37:000
94742480,3sleep041ktimersoftd/019:30:200
6149994627,13cyclictest22464-21hddtemp_smartct20:05:171
6149994626,14cyclictest3020-21runrttasks23:21:271
6149994614,14cyclictest6793-21cstates20:50:131
614999448,30cyclictest0-21swapper/121:55:151
6149994425,13cyclictest3020-21runrttasks00:06:121
6149994421,18cyclictest3020-21runrttasks20:14:151
6149994421,17cyclictest23737-21iostat_ios23:00:181
6149994420,20cyclictest11499-21users23:55:301
6149994420,17cyclictest24083-21iostat_ios21:35:171
6149994414,17cyclictest8959-21irqstats23:50:171
6149994330,7cyclictest16924-21iostat_ios19:50:201
6149994328,8cyclictest12451-21iostat_ios22:30:241
6149994325,12cyclictest3020-21runrttasks00:35:551
6149994323,15cyclictest22132-21irqstats00:25:221
6149994321,18cyclictest3020-21runrttasks20:41:281
6149994319,19cyclictest5582-21users22:10:311
6149994314,17cyclictest29067-21diskstats23:15:151
6149994314,17cyclictest28003-21ntp_states00:40:251
6149994313,25cyclictest16794-21ntp_states21:15:251
6149994227,8cyclictest10661-21memory22:25:201
6149994224,12cyclictest3020-21runrttasks20:01:531
6149994224,12cyclictest3020-21runrttasks19:40:181
6149994224,12cyclictest3020-21runrttasks19:33:501
6149994224,12cyclictest3020-21runrttasks00:33:431
6149994224,12cyclictest1266-21ntpq22:00:231
6149994223,14cyclictest3020-21runrttasks00:13:271
6149994223,14cyclictest29957-21ntpq21:50:271
6149994223,13cyclictest14326-21irqstats22:35:211
6149994223,12cyclictest3020-21runrttasks00:20:061
6149994218,20cyclictest14456-21/usr/sbin/munin19:45:261
6149994215,16cyclictest18451-21iostat21:20:191
6149994125,9cyclictest14370-21df21:10:141
6149994125,11cyclictest20202-21ntpq22:50:311
6149994124,12cyclictest3020-21runrttasks23:36:351
6149994124,12cyclictest3020-21runrttasks22:40:471
6149994124,12cyclictest3020-21runrttasks19:57:571
6149994124,12cyclictest18100-21irqstats22:45:241
6149994124,11cyclictest32548-21/usr/sbin/munin23:25:311
6149994123,14cyclictest32545-21unixbench_multi20:30:301
6149994123,13cyclictest3020-21runrttasks22:23:391
6149994123,13cyclictest3020-21runrttasks21:03:341
6149994123,12cyclictest7018-21ntpq22:15:231
6149994123,12cyclictest3020-21runrttasks21:29:461
6149994123,12cyclictest29694-21irqstats00:45:201
6149994122,6cyclictest3009-21if_eth022:05:191
6149994122,13cyclictest11484-21ntpq19:35:221
6149994121,15cyclictest1619-21ntp_states20:35:231
6149994120,16cyclictest5169-21hddtemp_smartct20:45:161
6149994119,18cyclictest3020-21runrttasks21:47:451
6149994118,17cyclictest31650-21memory00:50:181
6149994117,20cyclictest26475-21grep20:15:241
6149994117,19cyclictest12208-21/usr/sbin/munin21:05:111
6149994117,11cyclictest3020-21runrttasks23:42:451
6149994114,13cyclictest1984-21/usr/sbin/munin23:30:191
6148994110,17cyclictest27472-21basename20:20:010
262242410,4sleep041ktimersoftd/000:35:270
6149994023,12cyclictest26184-21ntpq21:40:221
6149994023,12cyclictest22067-21ntpq22:55:211
6149994023,11cyclictest3020-21runrttasks23:46:401
6149994022,13cyclictest3020-21runrttasks00:04:461
6149994020,13cyclictest29495-21/usr/sbin/munin20:25:291
6149994019,16cyclictest23169-21taskset21:33:231
6149993923,12cyclictest25838-21ntpq23:05:251
6149993923,11cyclictest8433-21/usr/sbin/munin20:55:271
6149993923,11cyclictest3020-21runrttasks23:10:471
6149993916,19cyclictest0-21swapper/100:15:281
6149993822,10cyclictest27622-21/usr/sbin/munin20:20:311
614899371,23cyclictest4339-21fschecks_count23:35:160
221392370,22sleep03-21ksoftirqd/021:30:220
614899352,21cyclictest30944-21snmpd00:46:030
614899343,4cyclictest81rcu_preempt20:05:230
614899339,5cyclictest0-21swapper/019:35:190
6148993324,6cyclictest16187-21/usr/sbin/munin00:10:200
614899331,4cyclictest81rcu_preempt20:01:140
63892321,9sleep00-21swapper/020:49:580
614899322,16cyclictest6875-21python23:40:280
614899321,4cyclictest81rcu_preempt23:14:450
614899314,4cyclictest81rcu_preempt20:10:480
6148993123,5cyclictest3-21ksoftirqd/000:45:000
614899312,24cyclictest13599-21python19:40:300
614899311,4cyclictest81rcu_preempt22:30:070
614899311,4cyclictest81rcu_preempt22:00:390
614899311,4cyclictest81rcu_preempt20:50:120
614899311,26cyclictest209922sleep022:54:020
614899310,4cyclictest81rcu_preempt23:34:000
614899310,4cyclictest81rcu_preempt21:15:200
194512311,9sleep00-21swapper/021:23:460
614899305,4cyclictest81rcu_preempt23:25:100
614899305,4cyclictest81rcu_preempt22:20:120
614899303,13cyclictest0-21swapper/000:20:140
614899302,24cyclictest28759-21/usr/sbin/munin20:20:280
614899302,14cyclictest30672-21/usr/sbin/munin23:20:130
614899301,4cyclictest81rcu_preempt23:15:290
614899301,4cyclictest81rcu_preempt21:48:370
6148993013,5cyclictest299562tune2fs20:25:150
6148993013,4cyclictest8201-21cron23:49:590
6148993012,7cyclictest2653-21latency_hist20:40:000
614899301,25cyclictest9473-21sort20:55:250
6148993012,5cyclictest14555-21ntp_states22:35:240
614899300,4cyclictest81rcu_preempt20:42:350
210942301,5sleep00-21swapper/021:26:210
190722304,5sleep00-21swapper/000:15:530
6148992919,5cyclictest12099-21cat00:00:010
614899291,4cyclictest81rcu_preempt23:05:310
614899291,4cyclictest81rcu_preempt21:40:100
614899291,4cyclictest81rcu_preempt19:55:590
614899291,4cyclictest81rcu_preempt19:45:030
614899291,4cyclictest81rcu_preempt00:25:160
6148992912,4cyclictest0-21swapper/020:30:300
614899291,15cyclictest32682-21cron00:55:000
614899291,13cyclictest5488-21/usr/sbin/munin22:10:290
6148992911,14cyclictest96442chrt23:50:310
614899284,18cyclictest11343-21python21:00:270
614899281,4cyclictest81rcu_preempt22:06:240
614899281,3cyclictest81rcu_preempt00:10:000
6148992811,5cyclictest15690-21taskset21:13:530
188612281,5sleep00-21swapper/022:46:250
115362281,5sleep00-21swapper/022:28:270
614899273,4cyclictest81rcu_preempt22:41:510
614899272,13cyclictest24731-21watchsnmpd00:31:000
614899272,12cyclictest2220-21dbus-daemon21:57:360
614899271,12cyclictest23740-21irqstats23:00:190
614899271,11cyclictest0-21swapper/019:54:080
227212271,5sleep00-21swapper/022:57:340
135292271,5sleep00-21swapper/021:05:590
6148992617,6cyclictest3-21ksoftirqd/022:15:380
614899261,4cyclictest81rcu_preempt00:00:210
614899261,21cyclictest0-21swapper/021:50:150
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional