You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-12-21 - 13:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Sat Dec 21, 2024 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2949199252,22cyclictest593-21dbus-daemon22:05:003
29488992523,1cyclictest1629-21latency_hist22:55:002
2948499250,24cyclictest28562-21dump-pmu-power22:40:001
2948499250,24cyclictest10033-21apt-get21:55:031
2949199240,2cyclictest20150-21awk23:40:003
2949199240,23cyclictest7490-21perf23:10:003
2948499240,1cyclictest22583-21awk23:45:011
2948199240,23cyclictest4423-21sendmail23:00:000
2948199240,23cyclictest2181-21sh21:35:000
2948199240,23cyclictest0-21swapper/020:40:020
29491992321,1cyclictest593-21dbus-daemon23:50:003
29491992321,1cyclictest593-21dbus-daemon00:40:003
29491992321,1cyclictest22275-21awk19:59:593
2949199231,21cyclictest22798-21apt-get20:03:073
2949199230,2cyclictest31914-21perf20:20:003
2949199230,23cyclictest0-21swapper/319:53:093
2949199230,22cyclictest4640-21dump-pmu-power19:25:003
2949199230,0cyclictest29022-21apt-get00:03:093
29488992320,3cyclictest0-21swapper/220:33:072
2948899230,22cyclictest9855-21idleruntime-cro23:15:002
2948899230,22cyclictest7481-21dump-pmu-power23:10:002
2948499230,22cyclictest0-21swapper/120:49:591
29481992320,2cyclictest10376-21apt-get23:18:110
2948199230,22cyclictest23617-21awk23:50:000
2948199230,22cyclictest15245-21munin-run22:05:000
29491992221,0cyclictest14790-21apt-get20:53:073
29491992220,1cyclictest0-21swapper/319:33:093
2949199220,21cyclictest2198-21grep21:35:013
2949199220,21cyclictest0-21swapper/322:18:093
2949199220,21cyclictest0-21swapper/320:58:093
2949199220,21cyclictest0-21swapper/320:13:113
2949199220,21cyclictest0-21swapper/319:43:103
2949199220,1cyclictest7972-21apt-get23:13:063
2949199220,1cyclictest1632-21apt-get22:55:003
2949199220,1cyclictest0-21swapper/300:15:003
29488992222,0cyclictest0-21swapper/222:03:102
29488992220,1cyclictest9087-21apt-get20:40:022
29488992220,1cyclictest28509-21perf00:00:012
29488992220,1cyclictest0-21swapper/222:15:012
2948899220,21cyclictest0-21swapper/220:53:072
2948899220,1cyclictest1852-21perf19:20:002
29484992222,0cyclictest0-21swapper/122:53:061
29484992219,2cyclictest9086-21latency_hist20:40:001
2948499220,22cyclictest0-21swapper/123:45:021
2948499220,21cyclictest4594-21munin-run21:40:001
2948499220,21cyclictest0-21swapper/100:13:061
2948499220,1cyclictest31627-21awk22:50:001
2948499220,1cyclictest30907-21apt-get00:05:001
2948499220,1cyclictest26355-21grep21:15:001
2948499220,1cyclictest0-21swapper/122:10:001
29481992220,2cyclictest9110-21munin-plugin-st20:40:000
29481992220,1cyclictest1865-21cron20:25:000
29481992219,2cyclictest12814-21cron22:00:000
2948199220,21cyclictest15345-21awk23:30:000
2948199220,1cyclictest0-21swapper/022:43:110
29491992121,0cyclictest4878-21apt-get00:23:133
29491992119,1cyclictest7424-21turbostat00:30:003
29491992119,1cyclictest26519-21apt-get23:58:083
2949199210,20cyclictest0-21swapper/322:43:103
2949199210,1cyclictest31652-21perf22:50:003
29488992121,0cyclictest0-21swapper/219:23:102
29488992118,2cyclictest23953-21idleruntime-cro21:10:002
2948899210,20cyclictest10731-21apt-get19:38:092
2948899210,20cyclictest10731-21apt-get19:38:092
2948899210,20cyclictest0-21swapper/220:23:102
2948899210,1cyclictest0-21swapper/221:20:022
29484992119,1cyclictest32197-21perf21:30:001
29484992119,1cyclictest17936-21apt-get19:53:091
2948499210,21cyclictest0-21swapper/119:28:101
2948499210,20cyclictest0-21swapper/120:43:101
2948499210,20cyclictest0-21swapper/119:20:011
2948499210,0cyclictest0-21swapper/123:10:001
2948499210,0cyclictest0-21swapper/120:58:091
2948499210,0cyclictest0-21swapper/120:28:101
29481992121,0cyclictest0-21swapper/019:33:090
29481992121,0cyclictest0-21swapper/000:23:120
29481992119,1cyclictest612-21gdbus22:55:000
29481992119,1cyclictest29499-21munin-run20:15:000
2948199210,20cyclictest4789-21apt-get20:33:070
2948199210,20cyclictest0-21swapper/023:33:070
2948199210,20cyclictest0-21swapper/021:38:100
2948199210,1cyclictest0-21swapper/023:03:090
2948199210,0cyclictest7910-21apt-get00:33:060
2948199210,0cyclictest0-21swapper/021:23:080
29491992020,0cyclictest24278-21apt-get22:33:053
29491992020,0cyclictest0-21swapper/323:53:063
29491992020,0cyclictest0-21swapper/323:33:063
29491992020,0cyclictest0-21swapper/321:13:093
29491992020,0cyclictest0-21swapper/320:38:113
29491992018,1cyclictest593-21dbus-daemon23:45:003
2949199200,19cyclictest10935-21apt-get21:58:113
2949199200,0cyclictest0-21swapper/323:03:083
29488992020,0cyclictest20327-21apt-get19:58:062
29488992018,1cyclictest4302-21grep20:30:012
29488992017,3cyclictest0-21swapper/200:03:082
2948899200,19cyclictest0-21swapper/222:23:082
2948899200,0cyclictest0-21swapper/221:33:052
2948899200,0cyclictest0-21swapper/200:38:112
2948899200,0cyclictest0-21swapper/200:05:012
29484992020,0cyclictest15821-21apt-get23:33:061
29484992020,0cyclictest0-21swapper/123:38:101
29484992020,0cyclictest0-21swapper/123:23:111
29484992020,0cyclictest0-21swapper/122:03:111
29484992020,0cyclictest0-21swapper/121:53:061
29484992020,0cyclictest0-21swapper/121:03:111
29484992020,0cyclictest0-21swapper/120:23:111
29484992020,0cyclictest0-21swapper/119:18:081
29484992020,0cyclictest0-21swapper/119:13:091
29484992019,1cyclictest29991-21apt-get20:18:091
29484992019,1cyclictest15540-21apt-get19:48:081
29484992019,0cyclictest10312-21apt-get00:38:111
29484992018,1cyclictest28515-21latency_hist00:00:001
2948499200,20cyclictest0-21swapper/122:43:101
2948499200,19cyclictest0-21swapper/121:43:101
29481992020,0cyclictest21193-21apt-get22:23:080
29481992020,0cyclictest0-21swapper/023:43:090
29481992020,0cyclictest0-21swapper/022:13:060
29481992020,0cyclictest0-21swapper/021:13:090
29481992020,0cyclictest0-21swapper/019:48:090
29481992020,0cyclictest0-21swapper/000:18:090
29481992020,0cyclictest0-21swapper/000:13:060
2948199200,20cyclictest0-21swapper/021:03:100
2948199200,0cyclictest18224-21apt-get23:38:100
2948199200,0cyclictest0-21swapper/022:38:080
2948199200,0cyclictest0-21swapper/020:48:090
2948199200,0cyclictest0-21swapper/019:18:090
2948199200,0cyclictest0-21swapper/000:03:090
29491991919,0cyclictest26844-21apt-get21:18:103
29491991919,0cyclictest16376-21apt-get22:13:063
29491991919,0cyclictest0-21swapper/323:23:123
29491991919,0cyclictest0-21swapper/320:40:023
29491991919,0cyclictest0-21swapper/319:18:083
29491991918,0cyclictest25193-21apt-get20:08:093
29491991917,1cyclictest31975-21munin-run00:10:013
29491991917,1cyclictest14302-21munin-run20:49:593
2949199190,18cyclictest23931-21cron21:10:003
2948899192,16cyclictest9803-21turbostat.cron00:35:002
29488991919,0cyclictest27589-21apt-get20:13:112
29488991919,0cyclictest0-21swapper/221:55:022
29488991919,0cyclictest0-21swapper/221:43:102
29488991919,0cyclictest0-21swapper/221:18:102
29488991919,0cyclictest0-21swapper/220:08:092
29488991919,0cyclictest0-21swapper/200:23:132
29488991917,1cyclictest31636-21basename22:50:002
29488991917,1cyclictest26036-21munin-run23:55:012
29488991917,1cyclictest0-21swapper/223:38:102
2948899190,0cyclictest0-21swapper/200:18:092
29484991919,0cyclictest0-21swapper/123:13:061
29484991919,0cyclictest0-21swapper/122:58:111
29484991919,0cyclictest0-21swapper/122:18:091
29484991919,0cyclictest0-21swapper/120:53:071
29484991919,0cyclictest0-21swapper/120:08:091
29484991919,0cyclictest0-21swapper/119:58:061
29484991917,1cyclictest18290-21turbostat22:15:001
29481991919,0cyclictest0-21swapper/020:18:090
29481991918,1cyclictest0-21swapper/023:13:060
29481991918,0cyclictest2476-21apt-get19:20:010
29481991917,1cyclictest28714-21cron21:20:000
29481991917,1cyclictest13147-21apt-get19:43:090
29491991818,0cyclictest2395-21apt-get20:28:103
29491991818,0cyclictest0-21swapper/322:38:083
29491991818,0cyclictest0-21swapper/320:33:083
29491991818,0cyclictest0-21swapper/319:28:103
29491991818,0cyclictest0-21swapper/300:18:093
29491991817,0cyclictest0-21swapper/323:18:113
29491991817,0cyclictest0-21swapper/300:33:063
29491991816,1cyclictest7656-21munin-run21:50:003
29488991818,0cyclictest5147-21apt-get19:28:092
29488991817,1cyclictest29952-21apt-get19:13:102
2948899180,18cyclictest0-21swapper/223:33:062
29484991818,0cyclictest0-21swapper/121:08:091
29484991818,0cyclictest0-21swapper/119:38:091
29484991818,0cyclictest0-21swapper/119:38:091
29481991818,0cyclictest0-21swapper/022:33:050
29491991717,0cyclictest0-21swapper/322:58:113
29491991717,0cyclictest0-21swapper/321:38:103
29491991715,1cyclictest12639-21awk19:40:013
29491991715,1cyclictest12639-21awk19:40:003
29488991717,0cyclictest0-21swapper/219:43:092
29488991717,0cyclictest0-21swapper/200:13:062
29488991714,2cyclictest24680-21latency_hist20:05:002
2948899170,1cyclictest0-21swapper/221:03:102
2948899170,16cyclictest0-21swapper/222:58:112
29484991717,0cyclictest0-21swapper/100:23:121
29484991716,1cyclictest0-21swapper/120:13:111
2948499170,14cyclictest0-21swapper/123:17:541
2948499170,0cyclictest0-21swapper/122:33:051
29481991717,0cyclictest31544-21apt-get00:05:010
29481991717,0cyclictest20327-21apt-get19:58:060
29481991717,0cyclictest0-21swapper/022:48:040
29481991716,1cyclictest18778-21apt-get22:18:090
29481991716,0cyclictest0-21swapper/019:35:010
29481991716,0cyclictest0-21swapper/019:35:010
29481991715,1cyclictest15882-21latency_hist22:10:000
29491991616,0cyclictest0-21swapper/321:20:023
29488991616,0cyclictest0-21swapper/222:38:082
29488991616,0cyclictest0-21swapper/221:13:102
29488991616,0cyclictest0-21swapper/220:18:092
29488991614,2cyclictest0-21swapper/219:48:092
29488991614,1cyclictest15301-21cron23:30:002
29484991616,0cyclictest0-21swapper/123:03:101
29484991616,0cyclictest0-21swapper/122:23:081
29484991616,0cyclictest0-21swapper/119:43:091
29484991615,0cyclictest0-21swapper/121:33:051
29484991614,1cyclictest0-21swapper/119:30:011
2948199163,11cyclictest313-21systemd-journal21:30:000
29481991616,0cyclictest0-21swapper/021:53:060
29481991616,0cyclictest0-21swapper/021:43:100
29481991616,0cyclictest0-21swapper/020:53:080
29481991614,1cyclictest313-21systemd-journal00:30:010
29488991514,1cyclictest0-21swapper/221:37:392
29488991513,1cyclictest0-21swapper/221:55:002
2948899150,1cyclictest8323-21cat19:33:112
2948899150,1cyclictest19108-21munin-run21:00:002
2948899150,1cyclictest0-21swapper/222:43:152
2948899150,15cyclictest0-21swapper/223:42:112
2948899150,15cyclictest0-21swapper/222:28:582
2948899150,14cyclictest0-21swapper/222:18:152
29481991515,0cyclictest0-21swapper/023:53:060
29481991515,0cyclictest0-21swapper/020:08:090
29481991513,1cyclictest28670-21munin-run00:00:010
29481991513,1cyclictest12236-21munin-run00:40:000
29491991414,0cyclictest0-21swapper/323:27:183
29491991414,0cyclictest0-21swapper/321:02:193
29491991414,0cyclictest0-21swapper/319:45:073
2949199140,14cyclictest0-21swapper/322:26:173
2949199140,14cyclictest0-21swapper/322:21:533
2949199140,14cyclictest0-21swapper/321:43:013
2949199140,14cyclictest0-21swapper/321:26:143
2949199140,14cyclictest0-21swapper/320:23:163
2949199140,13cyclictest0-21swapper/322:07:153
2949199140,0cyclictest0-21swapper/321:51:013
29488991413,1cyclictest0-21swapper/223:00:042
2948899141,2cyclictest6960-21sendmail-mta20:35:362
2948899140,14cyclictest0-21swapper/223:46:362
2948899140,14cyclictest0-21swapper/223:15:292
2948899140,14cyclictest0-21swapper/222:31:122
2948899140,14cyclictest0-21swapper/222:09:542
2948899140,14cyclictest0-21swapper/221:47:322
2948899140,14cyclictest0-21swapper/221:25:412
2948899140,14cyclictest0-21swapper/200:26:252
2948899140,0cyclictest0-21swapper/220:48:582
29484991414,0cyclictest0-21swapper/123:51:251
29484991414,0cyclictest0-21swapper/123:25:451
29484991414,0cyclictest0-21swapper/121:45:001
29484991414,0cyclictest0-21swapper/100:33:071
29484991412,1cyclictest0-21swapper/121:23:081
2948499140,14cyclictest0-21swapper/121:15:401
2948499140,0cyclictest0-21swapper/100:25:171
2948499140,0cyclictest0-21swapper/100:08:071
29481991414,0cyclictest0-21swapper/019:52:350
2948199140,14cyclictest0-21swapper/023:22:170
2948199140,14cyclictest0-21swapper/023:07:590
2948199140,14cyclictest0-21swapper/021:06:490
2948199140,14cyclictest0-21swapper/020:25:490
2948199140,14cyclictest0-21swapper/019:11:280
2948199140,0cyclictest0-21swapper/022:25:340
2948199140,0cyclictest0-21swapper/021:45:020
2948199140,0cyclictest0-21swapper/020:55:320
2948199140,0cyclictest0-21swapper/020:02:470
2948199140,0cyclictest0-21swapper/019:26:060
29491991313,0cyclictest0-21swapper/319:10:453
29488991313,0cyclictest0-21swapper/223:20:062
29488991313,0cyclictest0-21swapper/219:51:282
29484991313,0cyclictest0-21swapper/122:25:161
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional