You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-11-21 - 22:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot3s.osadl.org (updated Thu Nov 21, 2024 12:45:08)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
295498991381,3cyclictest131rcu_preempt09:00:020
295498991381,3cyclictest131rcu_preempt09:00:020
29550899773,40cyclictest272-21dbus-daemon10:00:002
29551399701,15cyclictest311860-21sshd12:24:393
295513996626,36cyclictest309759-21sshd11:41:153
295513996518,42cyclictest296415-21latency_hist07:25:023
29551399642,15cyclictest309007-21munin-run11:29:593
29551399642,15cyclictest304041-21sshd09:52:383
29551399642,15cyclictest304041-21sshd09:52:383
29551399631,14cyclictest298526-21sshd08:05:343
29551399622,17cyclictest312129-21munin-run12:30:013
29551399622,14cyclictest306653-21sshd10:42:393
29551399601,15cyclictest308181-21sshd11:10:393
295513995923,31cyclictest37-21ksoftirqd/310:35:013
29551399592,15cyclictest304863-21munin-run10:10:013
295513995920,34cyclictest37-21ksoftirqd/311:15:393
295513995816,5cyclictest1-21systemd09:45:013
29551399572,16cyclictest297527-21munin-run07:50:003
295513995721,32cyclictest312399-21latency_hist12:35:013
295513995717,7cyclictest305675-21cat10:25:013
29551399566,8cyclictest298039-21grep08:00:003
29551399562,15cyclictest300440-21cut08:45:013
295513995617,8cyclictest300653-21sshd08:45:373
295513995522,27cyclictest272-21dbus-daemon10:55:023
295513995522,27cyclictest272-21dbus-daemon10:55:013
295513995519,4cyclictest297272-21latency_hist07:45:023
295498995516,34cyclictest12-21ksoftirqd/012:20:000
295498995511,4cyclictest131rcu_preempt07:40:000
29551399542,18cyclictest311085-21munin-run12:10:013
29551399542,18cyclictest311085-21munin-run12:10:013
29551399542,13cyclictest297045-21latency_hist07:40:013
295513995418,7cyclictest37-21ksoftirqd/307:20:023
295513995418,33cyclictest301342-21sed09:00:023
295513995418,33cyclictest301342-21sed09:00:023
295513995415,6cyclictest301598-21cat09:05:023
295502995436,14cyclictest1-21systemd12:40:001
295513995322,27cyclictest37-21ksoftirqd/311:05:003
295513995321,28cyclictest299305-21latency_hist08:20:023
29551399522,14cyclictest310586-21true12:00:013
295513995215,10cyclictest298335-21sort08:05:003
295513995211,8cyclictest301690-21sshd09:05:543
295513995211,8cyclictest301690-21sshd09:05:533
295498995232,13cyclictest235-21systemd-journal07:30:010
295498995232,13cyclictest235-21systemd-journal07:30:000
29551399512,14cyclictest310831-21/usr/sbin/munin12:05:013
29551399512,12cyclictest302778-21munin-plugin-st09:29:593
295513995118,4cyclictest304294-21sshd09:57:403
295513995115,4cyclictest298525-21kworker/u8:108:10:033
295513995112,6cyclictest0-21swapper/308:25:013
29551399511,16cyclictest305202-21grep10:15:023
29551399511,16cyclictest301952-21sshd09:10:533
29550899513,4cyclictest131rcu_preempt11:00:012
295513995015,4cyclictest412-21sshd11:49:393
29551399501,14cyclictest309719-21latency_hist11:40:023
295502995035,11cyclictest235-21systemd-journal11:35:011
29551399499,35cyclictest0-21swapper/307:15:033
29551399499,35cyclictest0-21swapper/307:15:023
29551399492,16cyclictest306-21in:imuxsock07:35:003
29551399492,16cyclictest299675-21wc08:30:023
29551399492,15cyclictest308770-21munin-run11:25:023
29551399491,14cyclictest1-21systemd10:50:003
295502994936,9cyclictest297767-21cron07:55:001
295498994941,4cyclictest16950irq/224-800000009:05:000
29549899492,3cyclictest131rcu_preempt10:04:500
29551399482,15cyclictest303814-21munin-run09:50:013
295513994817,27cyclictest307419-21sshd10:59:393
29551399481,15cyclictest311338-21munin-run12:15:003
29549899483,5cyclictest131rcu_preempt08:20:000
29549899482,11cyclictest312659-21lockfile-create12:40:000
29551399472,15cyclictest311625-21sendmail-msp12:20:003
295513994716,7cyclictest37-21ksoftirqd/309:35:013
295513994716,5cyclictest297751-21journal-offline07:51:393
29551399471,15cyclictest309275-21munin-run11:35:023
29550899474,4cyclictest131rcu_preempt10:55:022
29550899474,4cyclictest131rcu_preempt10:55:022
295508994733,9cyclictest272-21dbus-daemon08:05:012
295502994736,8cyclictest305345-21sshd10:19:401
295502994735,9cyclictest272-21dbus-daemon10:05:001
295498994736,6cyclictest16950irq/224-800000008:39:590
295498994735,9cyclictest1-21systemd09:25:020
29549899473,4cyclictest131rcu_preempt11:20:010
29551399462,15cyclictest302255-21munin-run09:20:003
295513994614,4cyclictest271-21cron11:10:013
295513994614,4cyclictest271-21cron11:10:003
29550899464,3cyclictest131rcu_preempt10:05:022
29550899464,3cyclictest131rcu_preempt08:00:012
29550899463,3cyclictest131rcu_preempt08:40:002
295508994631,11cyclictest1-21systemd10:20:012
29550899462,3cyclictest131rcu_preempt09:10:012
29550899462,3cyclictest131rcu_preempt09:10:002
295502994627,14cyclictest235-21systemd-journal11:05:001
295502994611,6cyclictest131rcu_preempt08:40:001
295498994634,8cyclictest12-21ksoftirqd/011:00:020
29549899463,10cyclictest304405-21latency_hist10:00:020
29549899462,11cyclictest298961-21latency_hist08:15:020
295513994522,18cyclictest305362-21sendmail10:20:003
29551399452,14cyclictest302502-21modprobe09:22:403
295513994518,6cyclictest300281-21latency_hist08:40:023
29550899453,4cyclictest131rcu_preempt12:40:012
295508994532,10cyclictest295707-21sh07:15:002
295508994532,10cyclictest295707-21sh07:15:002
29550899452,4cyclictest131rcu_preempt09:30:002
29550299452,4cyclictest131rcu_preempt11:25:001
295498994528,14cyclictest272-21dbus-daemon08:00:000
29549899452,6cyclictest303034-21modprobe09:35:000
29549899452,3cyclictest131rcu_preempt10:30:020
29549899451,3cyclictest131rcu_preempt12:25:030
29549899451,3cyclictest131rcu_preempt08:25:010
29551399441,15cyclictest312658-21grep12:40:003
29550899448,7cyclictest131rcu_preempt08:50:022
29550899445,3cyclictest131rcu_preempt11:20:002
29550899445,3cyclictest131rcu_preempt10:30:022
295508994434,7cyclictest307702-21cron11:05:012
295508994431,9cyclictest1-21systemd10:25:002
29550899442,3cyclictest131rcu_preempt10:35:002
29550299446,9cyclictest23-21ksoftirqd/108:32:371
29550299446,8cyclictest23-21ksoftirqd/109:39:381
29550299444,4cyclictest131rcu_preempt09:10:031
29550299444,4cyclictest131rcu_preempt09:10:031
295502994434,7cyclictest308188-21sshd11:11:391
295502994430,11cyclictest272-21dbus-daemon11:55:021
295502994430,11cyclictest272-21dbus-daemon11:55:011
295502994430,10cyclictest272-21dbus-daemon10:45:001
29549899443,3cyclictest131rcu_preempt09:40:030
295498994428,12cyclictest309227-21sshd11:31:130
29549899442,3cyclictest131rcu_preempt11:05:000
295498994417,18cyclictest16850irq/134-800000008:28:390
295498994416,19cyclictest16850irq/134-800000012:25:190
29549899441,4cyclictest131rcu_preempt07:25:000
29551399433,5cyclictest306395-21modprobe10:40:013
29550899434,3cyclictest131rcu_preempt12:23:382
29550899433,4cyclictest131rcu_preempt12:30:002
29550899433,3cyclictest131rcu_preempt08:30:022
295508994331,9cyclictest297501-21sshd07:47:382
295508994327,12cyclictest272-21dbus-daemon09:00:022
295508994327,12cyclictest272-21dbus-daemon09:00:012
29550899431,4cyclictest131rcu_preempt12:35:022
29550899431,3cyclictest131rcu_preempt09:15:022
295502994332,7cyclictest23-21ksoftirqd/109:59:591
295502994331,8cyclictest302656-21sed09:25:021
295502994329,10cyclictest1-21systemd08:15:001
29550299432,11cyclictest23-21ksoftirqd/110:25:001
295498994336,4cyclictest16850irq/134-800000011:40:000
29549899433,4cyclictest131rcu_preempt12:00:010
295498994315,20cyclictest16950irq/224-800000011:43:390
29549899431,4cyclictest131rcu_preempt10:05:020
29549899431,3cyclictest131rcu_preempt09:55:010
29549899431,3cyclictest131rcu_preempt09:55:000
29551399423,15cyclictest304602-21modprobe10:05:003
29550899423,3cyclictest131rcu_preempt11:40:012
295508994231,8cyclictest310117-21cat11:50:012
295508994227,11cyclictest235-21systemd-journal08:55:002
295508994225,13cyclictest272-21dbus-daemon07:20:002
29550899422,4cyclictest131rcu_preempt10:36:042
29550899422,3cyclictest131rcu_preempt08:12:292
29550899421,4cyclictest131rcu_preempt12:00:012
29550899421,4cyclictest131rcu_preempt08:24:382
29550899421,3cyclictest131rcu_preempt11:40:402
29550899421,3cyclictest131rcu_preempt11:10:022
29550899421,3cyclictest131rcu_preempt11:10:022
29550899421,3cyclictest131rcu_preempt08:45:022
29550299425,7cyclictest23-21ksoftirqd/110:28:381
29550299423,4cyclictest131rcu_preempt08:00:031
295502994228,11cyclictest235-21systemd-journal12:10:021
295502994228,11cyclictest235-21systemd-journal12:10:011
295502994228,10cyclictest1-21systemd10:55:021
295502994228,10cyclictest1-21systemd10:55:011
295502994226,12cyclictest235-21systemd-journal08:40:021
295502994226,11cyclictest272-21dbus-daemon12:00:001
295498994216,18cyclictest16850irq/134-800000007:19:160
29551399418,9cyclictest301075-21wc08:55:023
295513994128,10cyclictest310282-21cron11:55:013
295513994128,10cyclictest310282-21cron11:55:003
29550899413,7cyclictest30-21ksoftirqd/212:16:402
29550899413,3cyclictest131rcu_preempt11:27:392
29550899413,3cyclictest131rcu_preempt09:51:392
29550899413,3cyclictest131rcu_preempt09:51:382
295508994130,8cyclictest299872-21sshd08:30:392
29550899412,3cyclictest131rcu_preempt11:35:002
29550899412,3cyclictest131rcu_preempt08:05:342
29550899412,3cyclictest131rcu_preempt07:41:392
295508994123,12cyclictest235-21systemd-journal07:55:012
29550899411,3cyclictest131rcu_preempt12:10:382
29550899411,3cyclictest131rcu_preempt10:50:012
29550299416,6cyclictest131rcu_preempt09:10:021
29550299412,3cyclictest131rcu_preempt08:25:021
295502994121,15cyclictest1-21systemd08:20:011
295498994127,10cyclictest272-21dbus-daemon08:45:010
295498994126,11cyclictest1-21systemd10:40:010
295498994125,12cyclictest306114-21sshd10:31:040
29549899412,3cyclictest131rcu_preempt11:55:000
29549899412,3cyclictest131rcu_preempt11:55:000
295498994123,14cyclictest305067-21sshd10:10:400
29550899408,28cyclictest297046-21latency_hist07:40:022
29550899404,4cyclictest131rcu_preempt09:45:022
29550899403,3cyclictest131rcu_preempt12:10:012
29550899403,3cyclictest131rcu_preempt12:10:002
29550899403,3cyclictest131rcu_preempt09:25:022
29550899402,4cyclictest131rcu_preempt07:30:012
29550899402,4cyclictest131rcu_preempt07:30:002
29550899401,4cyclictest131rcu_preempt11:20:062
29550899401,4cyclictest131rcu_preempt09:35:022
29550899401,3cyclictest131rcu_preempt08:15:032
29550299409,26cyclictest297043-21latency_hist07:40:011
29550299405,31cyclictest310793-21sshd12:00:391
295502994029,8cyclictest295511-21latency_hist07:10:011
295502994027,9cyclictest23-21ksoftirqd/109:05:001
29549899404,4cyclictest131rcu_preempt10:20:000
295498994031,5cyclictest302248-21sendmail09:20:000
295498994028,9cyclictest306-21in:imuxsock07:55:000
295498994027,9cyclictest235-21systemd-journal07:41:390
295498994027,10cyclictest299886-21sshd08:33:370
29549899402,4cyclictest131rcu_preempt09:15:020
295498994015,17cyclictest16850irq/134-800000011:11:070
29549899401,3cyclictest131rcu_preempt11:10:020
29549899401,3cyclictest131rcu_preempt11:10:010
29551399391,14cyclictest303448-21cat09:40:033
29550899392,3cyclictest131rcu_preempt10:45:012
29550899392,3cyclictest131rcu_preempt09:20:012
295508993922,12cyclictest30-21ksoftirqd/211:55:022
295508993922,12cyclictest30-21ksoftirqd/211:55:012
29550899391,5cyclictest131rcu_preempt09:50:002
29550899391,3cyclictest131rcu_preempt11:15:002
29550299396,3cyclictest131rcu_preempt11:00:011
29550299396,28cyclictest309009-21cut11:30:001
295502993929,7cyclictest307941-21sshd11:07:401
295502993929,7cyclictest307941-21sshd11:07:391
295502993929,7cyclictest1-21systemd12:15:011
295502993926,9cyclictest310031-21cron11:50:001
295502993920,14cyclictest272-21dbus-daemon10:40:011
29549899393,3cyclictest131rcu_preempt12:15:000
295498993927,9cyclictest235-21systemd-journal10:50:030
295498993927,9cyclictest235-21systemd-journal10:50:020
295498993924,12cyclictest363-21snmpd12:05:160
295498993924,12cyclictest363-21snmpd12:05:160
29549899391,6cyclictest131rcu_preempt08:10:000
29550899386,5cyclictest131rcu_preempt09:04:592
29550899386,3cyclictest131rcu_preempt07:35:002
295508993826,9cyclictest1-21systemd12:05:012
29550299384,6cyclictest131rcu_preempt12:19:591
29550299384,4cyclictest131rcu_preempt08:45:031
29550299384,4cyclictest131rcu_preempt08:06:401
29550299384,3cyclictest131rcu_preempt11:15:051
29550299383,3cyclictest131rcu_preempt12:35:031
295502993826,9cyclictest297389-21sed07:45:031
29550299382,4cyclictest131rcu_preempt12:25:021
29550299382,4cyclictest131rcu_preempt09:27:381
29549899384,3cyclictest131rcu_preempt11:25:020
29549899383,7cyclictest12-21ksoftirqd/010:45:010
295498993827,8cyclictest296750-21sh07:35:010
295498993826,9cyclictest303574-21systemd-run09:45:000
29549899382,3cyclictest131rcu_preempt10:50:010
295498993822,11cyclictest272-21dbus-daemon09:30:000
29550899372,3cyclictest131rcu_preempt10:08:492
29550299374,3cyclictest131rcu_preempt09:20:031
29550299374,3cyclictest131rcu_preempt08:02:391
29550299373,3cyclictest131rcu_preempt08:55:011
295502993727,6cyclictest295947-21cron07:19:591
295502993726,8cyclictest23-21ksoftirqd/107:15:031
295502993726,8cyclictest23-21ksoftirqd/107:15:021
295502993725,9cyclictest23-21ksoftirqd/110:35:011
29550299372,4cyclictest131rcu_preempt11:44:401
295502993723,11cyclictest235-21systemd-journal12:29:591
29549899376,18cyclictest298304-21modprobe08:05:000
29549899372,5cyclictest131rcu_preempt12:35:010
295498993725,9cyclictest235-21systemd-journal07:47:270
29549899371,32cyclictest295767-21sed07:15:020
29549899371,32cyclictest295767-21sed07:15:010
29550899362,3cyclictest131rcu_preempt09:40:012
29550899361,3cyclictest131rcu_preempt07:25:002
29550299363,3cyclictest131rcu_preempt09:45:021
295502993628,5cyclictest296380-21latency_hist07:25:031
29550299362,4cyclictest131rcu_preempt08:25:381
29549899364,3cyclictest131rcu_preempt10:25:010
295498993632,2cyclictest0-21swapper/009:50:010
295513993525,7cyclictest299873-21sshd08:30:383
29550899354,3cyclictest131rcu_preempt10:13:392
295508993523,9cyclictest0-21swapper/207:10:022
29550299355,23cyclictest272-21dbus-daemon11:39:591
29550299354,26cyclictest304069-21grep09:55:011
29550299354,26cyclictest304069-21grep09:55:001
29550299353,3cyclictest131rcu_preempt09:00:021
29550299353,3cyclictest131rcu_preempt09:00:011
295502993525,5cyclictest23-21ksoftirqd/107:50:001
295502993524,7cyclictest235-21systemd-journal09:45:401
295502993522,10cyclictest305224-21sed10:15:011
29550299351,4cyclictest131rcu_preempt07:30:011
29550299351,4cyclictest131rcu_preempt07:30:011
295498993529,3cyclictest0-21swapper/008:50:000
29549899351,4cyclictest131rcu_preempt09:09:390
29549899351,4cyclictest131rcu_preempt09:09:380
29549899351,3cyclictest131rcu_preempt12:05:000
29549899351,3cyclictest131rcu_preempt08:55:010
29549899351,31cyclictest0-21swapper/011:47:460
295513993424,7cyclictest37-21ksoftirqd/310:30:003
295513993420,10cyclictest272-21dbus-daemon07:30:023
295513993420,10cyclictest272-21dbus-daemon07:30:013
29550299342,3cyclictest131rcu_preempt10:45:401
29550299341,4cyclictest1-21systemd07:30:261
295498993425,6cyclictest19050irq/34-mmc111:26:070
295498993423,8cyclictest295629-21ls07:10:020
29550299333,3cyclictest131rcu_preempt10:10:021
295502993317,12cyclictest272-21dbus-daemon09:35:011
295513993121,6cyclictest295624-21latency_hist07:10:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional