You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-11-25 - 14:21

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot5s.osadl.org (updated Mon Nov 25, 2024 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3231599260,25cyclictest0-21swapper/121:15:531
3232499250,24cyclictest12269-21latency_hist19:35:003
32311992421,2cyclictest16342-21munin-run20:50:000
3231199240,1cyclictest593-21dbus-daemon00:00:000
32324992321,1cyclictest0-21swapper/322:10:013
3232499230,0cyclictest0-21swapper/319:15:553
32320992323,0cyclictest0-21swapper/221:30:572
32320992322,1cyclictest2983-21apt-get19:15:552
3232099230,22cyclictest11198-21idleruntime-cro21:45:002
3232099230,22cyclictest0-21swapper/222:00:542
3232099230,22cyclictest0-21swapper/221:25:542
32315992320,3cyclictest0-21swapper/123:05:541
3231599230,23cyclictest0-21swapper/123:20:541
3231199230,22cyclictest21542-21sendmail-msp21:00:000
3231199230,1cyclictest21114-21apt-get22:05:550
32324992220,1cyclictest0-21swapper/323:15:003
3232499220,21cyclictest21530-21ls21:00:003
3232499220,21cyclictest0-21swapper/322:15:543
3232499220,21cyclictest0-21swapper/300:25:543
3232499220,1cyclictest11547-21munin-run20:40:003
3232099220,21cyclictest5863-21apt-get23:50:532
3232099220,21cyclictest22195-21chrt19:55:552
3232099220,21cyclictest17047-21apt-get20:50:532
32315992221,0cyclictest0-21swapper/120:45:531
32315992220,2cyclictest0-21swapper/100:10:561
32315992220,1cyclictest12272-21dump-pmu-power19:35:001
32315992219,3cyclictest0-21swapper/123:30:581
32315992216,5cyclictest13577-21latency_hist21:50:001
3231599220,21cyclictest5399-21apt-get19:20:541
3231599220,21cyclictest3939-21apt-get20:25:021
3231199222,2cyclictest593-21dbus-daemon23:45:000
32311992222,0cyclictest0-21swapper/022:20:540
32311992221,0cyclictest0-21swapper/022:05:000
32311992220,1cyclictest593-21dbus-daemon20:35:000
3231199220,21cyclictest23943-21munin-plugin-st21:05:000
3231199220,21cyclictest0-21swapper/021:40:530
3231199220,21cyclictest0-21swapper/020:15:550
3231199220,21cyclictest0-21swapper/019:50:570
3231199220,21cyclictest0-21swapper/000:10:560
32324992121,0cyclictest29098-21apt-get21:15:533
32324992120,1cyclictest0-21swapper/323:50:533
32324992120,1cyclictest0-21swapper/322:25:013
32324992116,5cyclictest0-21swapper/300:30:583
3232499210,20cyclictest17051-21runrttasks20:50:543
3232499210,20cyclictest0-21swapper/320:45:543
3232499210,20cyclictest0-21swapper/319:55:553
3232499210,20cyclictest0-21swapper/319:25:543
3232499210,1cyclictest0-21swapper/321:10:553
3232499210,0cyclictest28319-21apt-get22:20:543
3232499210,0cyclictest0-21swapper/321:05:543
3232499210,0cyclictest0-21swapper/321:00:533
3232499210,0cyclictest0-21swapper/320:20:533
32320992120,1cyclictest27001-21apt-get20:05:542
32320992120,1cyclictest21858-21apt-get21:00:532
3232099210,20cyclictest31845-21apt-get20:15:552
3232099210,20cyclictest25175-21apt-get23:20:542
3232099210,20cyclictest15010-21apt-get19:40:562
3232099210,20cyclictest0-21swapper/222:55:552
3232099210,20cyclictest0-21swapper/219:10:542
32315992121,0cyclictest0-21swapper/123:50:021
32315992120,1cyclictest9123-21latency_hist20:35:001
32315992120,1cyclictest612-21gdbus22:15:001
32315992120,1cyclictest2084-21cron23:40:001
32315992119,2cyclictest12839-21apt-get00:05:011
3231599210,20cyclictest0-21swapper/121:50:591
3231599210,1cyclictest593-21dbus-daemon20:05:001
32311992121,0cyclictest0-21swapper/021:50:590
32311992121,0cyclictest0-21swapper/020:00:540
32311992121,0cyclictest0-21swapper/019:55:550
32311992120,1cyclictest10767-21apt-get22:50:570
32311992120,0cyclictest0-21swapper/020:20:540
32311992119,1cyclictest6693-21cron20:30:000
3231199210,21cyclictest0-21swapper/023:10:590
3231199210,21cyclictest0-21swapper/021:30:570
3231199210,21cyclictest0-21swapper/021:05:540
3231199210,20cyclictest27961-21apt-get00:35:560
3231199210,20cyclictest0-21swapper/023:35:550
3231199210,20cyclictest0-21swapper/023:20:540
3231199210,20cyclictest0-21swapper/019:35:540
3231199210,0cyclictest0-21swapper/022:15:540
3231199210,0cyclictest0-21swapper/020:50:540
3231199210,0cyclictest0-21swapper/019:15:550
32324992019,1cyclictest18352-21apt-get00:15:553
32324992019,1cyclictest0-21swapper/322:40:553
32324992019,1cyclictest0-21swapper/322:00:543
32324992019,0cyclictest0-21swapper/319:10:013
32324992018,1cyclictest14667-21idleruntime-cro19:40:003
32324992018,1cyclictest0-21swapper/323:05:003
32324992015,0cyclictest0-21swapper/320:40:543
3232499200,19cyclictest0-21swapper/321:25:543
3232499200,0cyclictest0-21swapper/322:10:583
3232499200,0cyclictest0-21swapper/321:40:533
3232499200,0cyclictest0-21swapper/321:30:573
3232499200,0cyclictest0-21swapper/319:40:553
32320992020,0cyclictest5972-21apt-get22:40:552
32320992020,0cyclictest0-21swapper/223:55:552
32320992020,0cyclictest0-21swapper/223:15:542
32320992020,0cyclictest0-21swapper/222:25:012
32320992020,0cyclictest0-21swapper/221:35:532
32320992020,0cyclictest0-21swapper/221:15:532
32320992020,0cyclictest0-21swapper/220:10:542
32320992018,1cyclictest29709-21basename23:30:002
3232099200,20cyclictest0-21swapper/219:50:572
3232099200,0cyclictest0-21swapper/223:40:542
3232099200,0cyclictest0-21swapper/222:45:542
3232099200,0cyclictest0-21swapper/221:50:582
3232099200,0cyclictest0-21swapper/219:30:552
3232099200,0cyclictest0-21swapper/200:35:572
32315992020,0cyclictest23165-21apt-get00:25:531
32315992020,0cyclictest1907-21apt-get21:25:541
32315992020,0cyclictest18719-21apt-get22:00:541
32315992020,0cyclictest1859-21apt-get20:20:541
32315992020,0cyclictest0-21swapper/122:55:551
32315992020,0cyclictest0-21swapper/122:25:011
32315992020,0cyclictest0-21swapper/120:05:541
32315992020,0cyclictest0-21swapper/119:40:561
32315992019,1cyclictest4307-21apt-get21:30:571
32315992019,1cyclictest28698-21cron21:15:001
32315992019,1cyclictest0-21swapper/120:40:001
32315992018,1cyclictest24256-21apt-get21:05:541
3231599200,19cyclictest27620-21sh00:35:011
3231599200,0cyclictest12593-21apt-get19:35:541
3231599200,0cyclictest0-21swapper/122:35:541
3231599200,0cyclictest0-21swapper/122:20:541
3231599200,0cyclictest0-21swapper/119:10:011
32311992020,0cyclictest13161-21apt-get22:55:550
32311992020,0cyclictest0-21swapper/021:55:550
32311992020,0cyclictest0-21swapper/021:35:530
32311992020,0cyclictest0-21swapper/019:25:530
32311992020,0cyclictest0-21swapper/000:25:540
32311992019,1cyclictest0-21swapper/019:45:550
32311992018,1cyclictest0-21swapper/000:35:010
3231199200,20cyclictest0-21swapper/022:10:590
3231199200,0cyclictest0-21swapper/020:35:560
32324991919,0cyclictest4650-21apt-get20:25:543
32324991919,0cyclictest0-21swapper/323:40:543
32324991919,0cyclictest0-21swapper/323:15:543
32324991919,0cyclictest0-21swapper/322:45:553
32324991919,0cyclictest0-21swapper/322:35:543
32324991919,0cyclictest0-21swapper/321:45:543
32324991916,3cyclictest0-21swapper/321:55:553
3232499190,0cyclictest0-21swapper/323:25:563
32320991919,0cyclictest3553-21apt-get22:35:542
32320991919,0cyclictest26653-21apt-get21:10:562
32320991919,0cyclictest1150-21apt-get22:30:582
32320991919,0cyclictest0-21swapper/223:00:552
32320991919,0cyclictest0-21swapper/221:20:552
32320991919,0cyclictest0-21swapper/200:00:552
32320991918,1cyclictest0-21swapper/219:20:542
32320991916,2cyclictest11524-21dump-pmu-power20:40:002
32315991919,0cyclictest25902-21apt-get22:15:541
32315991919,0cyclictest22754-21apt-get23:15:531
32315991919,0cyclictest22192-21apt-get19:55:541
32315991919,0cyclictest0-21swapper/100:20:541
32315991919,0cyclictest0-21swapper/100:00:551
32315991917,2cyclictest0-21swapper/121:20:541
32315991917,1cyclictest21531-21perf21:00:001
32315991917,1cyclictest11197-21perf21:45:001
32315991916,2cyclictest22407-21cron23:15:001
32311991919,0cyclictest0-21swapper/022:30:580
32311991919,0cyclictest0-21swapper/021:15:530
32311991919,0cyclictest0-21swapper/019:40:550
32311991919,0cyclictest0-21swapper/000:15:550
32311991918,1cyclictest7449-21cron19:25:000
32311991918,1cyclictest0-21swapper/019:30:550
32324991818,0cyclictest17968-21apt-get23:05:543
32324991818,0cyclictest10769-21apt-get00:00:553
32324991818,0cyclictest0-21swapper/322:30:583
32324991818,0cyclictest0-21swapper/320:15:553
32324991818,0cyclictest0-21swapper/300:10:553
32324991816,1cyclictest8809-21idleruntime-cro21:40:003
32324991816,1cyclictest313-21systemd-journal23:40:003
32320991818,0cyclictest11514-21apt-get21:45:542
32320991818,0cyclictest0-21swapper/222:20:542
32320991818,0cyclictest0-21swapper/222:05:562
32320991818,0cyclictest0-21swapper/221:05:542
32315991818,0cyclictest7795-21apt-get19:25:541
32315991818,0cyclictest0-21swapper/123:25:561
32315991818,0cyclictest0-21swapper/122:05:561
32315991818,0cyclictest0-21swapper/119:45:551
32315991816,2cyclictest0-21swapper/119:15:551
32315991816,1cyclictest0-21swapper/120:50:541
3231599180,1cyclictest8262-21apt-get23:55:541
32311991818,0cyclictest0-21swapper/022:40:550
32311991818,0cyclictest0-21swapper/022:35:540
32311991818,0cyclictest0-21swapper/019:10:540
32311991817,1cyclictest31531-21munin-run20:15:000
32311991816,1cyclictest31131-21/usr/sbin/munin22:26:040
32324991717,0cyclictest0-21swapper/319:50:573
32324991717,0cyclictest0-21swapper/300:20:553
32324991716,1cyclictest0-21swapper/319:25:003
32324991715,1cyclictest29125-21latency_hist20:10:003
3232499170,14cyclictest0-21swapper/323:45:143
3232499170,10cyclictest0-21swapper/300:35:573
32320991717,0cyclictest0-21swapper/222:10:582
32320991717,0cyclictest0-21swapper/220:25:552
32320991717,0cyclictest0-21swapper/200:15:552
32320991716,0cyclictest0-21swapper/219:35:542
32315991717,0cyclictest0-21swapper/122:40:551
32315991717,0cyclictest0-21swapper/121:00:531
32311991717,0cyclictest8367-21apt-get22:45:550
3231199171,15cyclictest0-21swapper/023:05:550
3231199170,16cyclictest612-21gdbus00:25:000
32320991616,0cyclictest25567-21apt-get00:30:582
32320991616,0cyclictest0-21swapper/223:10:592
32320991616,0cyclictest0-21swapper/219:25:532
32320991616,0cyclictest0-21swapper/200:10:562
32320991614,1cyclictest0-21swapper/223:31:052
3232099160,15cyclictest14257-21apt-get20:45:542
32315991616,0cyclictest0-21swapper/120:15:551
3231599160,15cyclictest17476-21grep21:56:031
3231599160,0cyclictest0-21swapper/119:50:321
32311991616,0cyclictest0-21swapper/023:15:540
32311991616,0cyclictest0-21swapper/023:00:550
32311991616,0cyclictest0-21swapper/021:10:560
32311991614,1cyclictest13598-21munin-run21:50:000
32324991515,0cyclictest0-21swapper/323:20:543
32324991515,0cyclictest0-21swapper/320:00:543
32324991514,0cyclictest0-21swapper/321:20:543
3232499150,6cyclictest0-21swapper/322:50:583
3232099158,7cyclictest11495-21munin-node23:08:082
32320991515,0cyclictest13560-21apt-get00:05:542
32320991514,1cyclictest25250-21munin-run00:30:002
3231599157,3cyclictest0-21swapper/100:35:571
32315991510,0cyclictest11864-21apt-get20:40:541
3231599150,14cyclictest8357-21acpi22:45:541
32311991515,0cyclictest0-21swapper/023:30:590
32311991515,0cyclictest0-21swapper/021:25:010
32311991515,0cyclictest0-21swapper/021:20:540
32311991515,0cyclictest0-21swapper/020:05:540
32311991513,1cyclictest0-21swapper/000:05:010
3231199150,2cyclictest141rcuc/023:50:010
3232499140,14cyclictest0-21swapper/323:55:513
3232499140,14cyclictest0-21swapper/323:31:453
3232499140,14cyclictest0-21swapper/321:50:563
3232499140,14cyclictest0-21swapper/319:46:133
3232499140,0cyclictest0-21swapper/322:55:253
3232499140,0cyclictest0-21swapper/320:30:073
3232499140,0cyclictest0-21swapper/320:10:213
3232499140,0cyclictest0-21swapper/300:06:213
32320991414,0cyclictest0-21swapper/221:56:162
32320991414,0cyclictest0-21swapper/220:40:552
32320991414,0cyclictest0-21swapper/200:20:032
3232099140,3cyclictest0-21swapper/220:30:552
3232099140,14cyclictest0-21swapper/223:46:212
3232099140,14cyclictest0-21swapper/223:35:032
3232099140,14cyclictest0-21swapper/220:20:522
3232099140,14cyclictest0-21swapper/220:00:342
3232099140,0cyclictest0-21swapper/222:50:472
3232099140,0cyclictest0-21swapper/222:15:382
3232099140,0cyclictest0-21swapper/220:59:542
3232099140,0cyclictest0-21swapper/219:45:412
32315991414,0cyclictest0-21swapper/123:40:271
32315991414,0cyclictest0-21swapper/122:50:561
32315991414,0cyclictest0-21swapper/121:35:411
32315991413,1cyclictest0-21swapper/120:10:421
32315991412,1cyclictest15577-21apt-get23:00:551
3231599140,14cyclictest0-21swapper/123:45:371
3231599140,14cyclictest0-21swapper/122:30:371
32311991414,0cyclictest0-21swapper/000:00:550
3231199140,14cyclictest0-21swapper/020:40:270
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional