You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-11-23 - 20:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackfslot7s.osadl.org (updated Sat Nov 23, 2024 00:44:18)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
39053412201174,23sleep30-21swapper/319:08:333
39051552178147,27sleep20-21swapper/219:06:082
39054412141106,28sleep10-21swapper/119:09:471
39054162138111,22sleep00-21swapper/019:09:310
39231622950,1sleep23923165-21grep20:00:192
3905696997370,2cyclictest3988364-21kworker/u8:2+events_unbound00:15:021
3905699996864,3cyclictest3976864-21kworker/u8:1+flush-259:022:50:002
3905696996563,2cyclictest3913760-21kworker/u8:3+events_unbound21:55:011
3905696996256,4cyclictest3963686-21apt-get22:10:011
3905694996260,2cyclictest3988364-21kworker/u8:2+events_unbound23:52:540
3905694996260,2cyclictest3913760-21kworker/u8:3+events_unbound22:40:180
3905696996058,2cyclictest4006107-21kworker/u8:0+events_unbound00:39:591
3905696995957,2cyclictest3987525-21kworker/u8:3+flush-259:023:35:011
3905696995654,2cyclictest3908774-21kworker/u8:1+flush-259:021:30:201
3905694995654,2cyclictest3913760-21kworker/u8:3+events_unbound20:15:190
3905696995553,2cyclictest3976864-21kworker/u8:1+events_unbound23:10:011
3905696995452,1cyclictest3917078-21kworker/u8:2+flush-259:019:54:551
3905694995352,1cyclictest3908774-21kworker/u8:1+events_unbound20:25:180
3905694995351,2cyclictest3974202-21kworker/u8:2+flush-259:023:05:010
3905694994846,2cyclictest3908774-21kworker/u8:1+events_unbound21:30:200
3905696994745,2cyclictest3985531-21kworker/u8:0+events_unbound23:52:551
3905696994744,2cyclictest3913760-21kworker/u8:3+events_unbound20:40:151
3905696994644,2cyclictest3905507-21kworker/u8:0+flush-259:019:25:221
3905696994543,2cyclictest3988364-21kworker/u8:2+flush-259:023:55:161
3905696994543,2cyclictest3913760-21kworker/u8:3+events_unbound19:40:191
3905696994442,2cyclictest3960570-21kworker/u8:0+flush-259:022:29:551
3905694994442,2cyclictest3913760-21kworker/u8:3+events_unbound21:55:160
3905696994341,2cyclictest3908774-21kworker/u8:1+events_unbound21:05:211
3905694994341,2cyclictest3913760-21kworker/u8:3+events_unbound19:45:190
3905694994341,2cyclictest3903633-21kworker/u8:3+flush-259:019:15:000
3905696994241,1cyclictest3974202-21kworker/u8:2+flush-259:023:04:551
3905696994237,2cyclictest3985531-21kworker/u8:0+events_unbound23:40:191
3905694994241,1cyclictest3908774-21kworker/u8:1+flush-259:021:04:570
3905696994139,2cyclictest3936350-21kworker/u8:4+flush-259:021:45:221
3905694994139,2cyclictest3996063-21kworker/u8:3+events_unbound00:20:030
3905699994038,2cyclictest3913760-21kworker/u8:3+events_unbound21:40:002
3905696994037,2cyclictest3913760-21kworker/u8:3+events_unbound20:05:191
3905694994038,2cyclictest3988364-21kworker/u8:2+events_unbound00:10:200
3905696993937,2cyclictest3913760-21kworker/u8:3+flush-259:022:10:161
3905694993937,2cyclictest3936350-21kworker/u8:4+events_unbound20:55:180
3905694993936,2cyclictest3908774-21kworker/u8:1+flush-259:019:28:450
3905701993834,3cyclictest3975782-21/usr/sbin/munin22:45:153
3905701993833,3cyclictest3953933-21latency_hist21:40:003
3905699993834,3cyclictest3936350-21kworker/u8:4+flush-259:021:25:012
3905699993832,4cyclictest3960524-21latency_hist22:00:002
3905694993836,2cyclictest3988364-21kworker/u8:2+events_unbound00:03:040
3905694993836,2cyclictest3913760-21kworker/u8:3+events_unbound22:30:230
3905694993836,2cyclictest3908774-21kworker/u8:1+events_unbound20:09:370
3905699993735,2cyclictest4006107-21kworker/u8:0+flush-259:000:35:012
3905699993733,3cyclictest3988364-21kworker/u8:2+flush-259:000:10:012
3905696993734,3cyclictest3985531-21kworker/u8:0+flush-259:023:35:211
3905696993734,2cyclictest3913760-21kworker/u8:3+flush-259:021:25:201
3905696993734,2cyclictest3913760-21kworker/u8:3+events_unbound22:00:201
3905694993735,2cyclictest3913760-21kworker/u8:3+events_unbound21:23:520
3905699993633,2cyclictest3913760-21kworker/u8:3+flush-259:019:50:002
3905699993630,4cyclictest3971192-21meminfo22:30:172
3905696993633,2cyclictest3988364-21kworker/u8:2+flush-259:000:24:561
3905694993635,1cyclictest3908774-21kworker/u8:1+flush-259:019:24:550
3905701993531,3cyclictest433058-21systemd-journal00:10:013
3905699993532,3cyclictest3953987-21kworker/u8:1+flush-259:022:05:002
3905699993531,3cyclictest3963686-21apt-get22:10:012
3905696993534,1cyclictest3988364-21kworker/u8:2+flush-259:000:34:551
3905696993533,2cyclictest3908774-21kworker/u8:1+events_unbound20:24:561
3905694993533,2cyclictest3953987-21kworker/u8:1+events_unbound22:16:590
3905699993426,5cyclictest3982494-21awk23:10:002
3905696993432,2cyclictest3913760-21kworker/u8:3+flush-259:022:40:151
3905694993433,1cyclictest4006107-21kworker/u8:0+events_unbound00:25:180
3905694993432,2cyclictest3985531-21kworker/u8:0+flush-259:023:46:070
3905696993332,1cyclictest3936350-21kworker/u8:4+flush-259:020:54:561
3905696993331,2cyclictest3908774-21kworker/u8:1+flush-259:021:16:071
3905696993330,2cyclictest3976864-21kworker/u8:1+flush-259:023:25:001
3905696993328,2cyclictest3985531-21kworker/u8:0+events_unbound23:45:191
3905694993331,2cyclictest3974202-21kworker/u8:2+events_unbound22:54:090
3905694993331,2cyclictest3913760-21kworker/u8:3+events_unbound20:40:180
3905694993331,2cyclictest3913760-21kworker/u8:3+events_unbound20:00:140
3905701993229,2cyclictest3936350-21kworker/u8:4+events_unbound20:50:183
3905699993228,3cyclictest4004977-21diskstats00:20:142
3905699993226,4cyclictest3926104-21meminfo20:10:152
3905696993230,2cyclictest3936350-21kworker/u8:4+events_unbound21:40:231
3905696993230,2cyclictest3913760-21kworker/u8:3+events_unbound23:15:151
3905696993229,2cyclictest3953987-21kworker/u8:1+flush-259:022:20:231
3905694993231,1cyclictest3917078-21kworker/u8:2+events_unbound19:50:130
3905694993231,1cyclictest3913760-21kworker/u8:3+flush-259:022:00:080
3905694993230,2cyclictest3976864-21kworker/u8:1+flush-259:023:30:010
3905701993127,3cyclictest3988364-21kworker/u8:2+flush-259:000:35:013
3905699993128,2cyclictest3913760-21kworker/u8:3+events_unbound22:40:132
3905696993130,1cyclictest3896018-21kworker/u8:2+events_unbound19:10:211
3905696993127,3cyclictest3982712-21gpgv23:10:011
3905694993129,2cyclictest3936350-21kworker/u8:4+events_unbound21:45:020
3905694993129,2cyclictest3913760-21kworker/u8:3+events_unbound20:35:150
3905694993129,2cyclictest3913760-21kworker/u8:3+events_unbound20:30:140
3905696993027,2cyclictest3953987-21kworker/u8:1+events_unbound22:15:181
3905696993025,4cyclictest3948391-21ntpq21:20:161
3905696993025,4cyclictest3937362-21ntpq20:45:181
3905694993028,2cyclictest4009249-21kworker/u8:1+events_unbound00:38:130
3905694993028,2cyclictest3985531-21kworker/u8:0+events_unbound23:40:210
3905694993028,2cyclictest3913760-21kworker/u8:3+events_unbound21:25:370
3905701992923,4cyclictest3921762-21apt-get20:00:003
3905699992924,3cyclictest3908774-21kworker/u8:1+events_unbound19:25:002
3905696992927,2cyclictest3913760-21kworker/u8:3+flush-259:020:00:121
3905694992927,2cyclictest3974202-21kworker/u8:2+events_unbound22:49:530
3905694992926,2cyclictest3908774-21kworker/u8:1+events_unbound20:48:090
3905694992923,4cyclictest3968202-21ntpq22:20:190
3905701992823,3cyclictest3938140-21latency_hist20:50:013
3905696992826,2cyclictest3976864-21kworker/u8:1+flush-259:022:50:151
3905696992826,2cyclictest3913760-21kworker/u8:3+events_unbound20:30:121
3905696992825,2cyclictest3936350-21kworker/u8:4+events_unbound21:35:161
3905694992826,2cyclictest3996063-21kworker/u8:3+events_unbound00:05:150
3905694992826,2cyclictest3913760-21kworker/u8:3+events_unbound21:43:330
3905699992720,4cyclictest3941298-21latency_hist21:00:012
3905696992725,2cyclictest3913760-21kworker/u8:3+events_unbound20:35:191
3905694992725,2cyclictest3936350-21kworker/u8:4+events_unbound21:15:020
3905701992624,2cyclictest3913760-21kworker/u8:3+flush-259:020:30:173
3905696992625,1cyclictest3903633-21kworker/u8:3+events_unbound19:15:151
3905696992620,4cyclictest3958786-21cp21:55:001
3905694992625,1cyclictest3974202-21kworker/u8:2+events_unbound23:15:070
3905694992625,1cyclictest3913760-21kworker/u8:3+events_unbound22:36:140
3905694992624,2cyclictest3936350-21kworker/u8:4+events_unbound21:11:050
3905694992621,4cyclictest3908774-21kworker/u8:1+flush-259:020:20:140
3905694992620,4cyclictest3914621-21ntpq19:35:160
3905701992522,2cyclictest3953987-21kworker/u8:1+events_unbound21:45:003
3905701992522,2cyclictest3908774-21kworker/u8:1+flush-259:019:20:003
3905699992520,3cyclictest3999231-21latency_hist00:05:012
3905699992518,5cyclictest4002381-21latency_hist00:15:002
3905696992523,2cyclictest3976864-21kworker/u8:1+events_unbound22:55:031
3905696992523,2cyclictest3960570-21kworker/u8:0+events_unbound22:34:121
3905696992523,2cyclictest3908774-21kworker/u8:1+flush-259:021:00:001
3905694992524,1cyclictest3908774-21kworker/u8:1+events_unbound19:17:460
3905701992421,2cyclictest3963686-21apt-get22:10:013
3905701992419,3cyclictest3942887-21latency_hist21:05:013
3905699992422,2cyclictest3936350-21kworker/u8:4+events_unbound21:40:212
3905699992422,2cyclictest3903633-21kworker/u8:3+flush-259:019:15:132
3905699992418,4cyclictest3949990-21ntpq21:25:182
3905696992422,2cyclictest3988364-21kworker/u8:2+events_unbound00:06:031
3905696992422,2cyclictest3985531-21kworker/u8:0+events_unbound00:00:031
3905694992423,1cyclictest3908774-21kworker/u8:1+events_unbound19:43:480
3905694992422,2cyclictest3936350-21kworker/u8:4+events_unbound21:38:060
3905694992422,2cyclictest3913760-21kworker/u8:3+events_unbound22:13:420
3905696992321,2cyclictest3936350-21kworker/u8:4+events_unbound21:10:211
3905696992321,2cyclictest3913760-21kworker/u8:3+flush-259:022:45:041
3905696992321,2cyclictest3913760-21kworker/u8:3+events_unbound20:15:151
3905694992321,2cyclictest3988364-21kworker/u8:2+events_unbound00:34:120
3905701992218,3cyclictest3944445-21cat21:09:543
3905701992217,4cyclictest5055-10wireplumber22:30:003
3905699992218,3cyclictest3985531-21kworker/u8:0+events_unbound23:24:592
3905696992220,2cyclictest3913760-21kworker/u8:3+flush-259:019:47:091
3905694992221,1cyclictest3985531-21kworker/u8:0+events_unbound23:59:010
3905694992221,1cyclictest3917078-21kworker/u8:2+events_unbound20:10:350
3905694992220,2cyclictest3976864-21kworker/u8:1+events_unbound22:59:020
3905694992220,2cyclictest3913760-21kworker/u8:3+events_unbound23:13:020
3905694992220,2cyclictest3905507-21kworker/u8:0+events_unbound19:30:210
3905694992216,4cyclictest3957353-21/usr/sbin/munin21:50:140
3905701992117,3cyclictest631-21rs:main3
3905701992117,3cyclictest3988131-21latency_hist23:30:003
3905701992115,3cyclictest0-21swapper/320:40:003
3905699992119,2cyclictest3987525-21kworker/u8:3+events_unbound23:30:182
3905699992119,2cyclictest3976864-21kworker/u8:1+events_unbound22:55:192
3905699992118,2cyclictest3936350-21kworker/u8:4+flush-259:021:50:022
3905699992117,3cyclictest3908774-21kworker/u8:1+flush-259:020:30:002
3905699992115,4cyclictest3913128-21ntpq19:30:172
3905696992120,1cyclictest3996063-21kworker/u8:3+flush-259:000:29:561
3905696992120,1cyclictest3988364-21kworker/u8:2+events_unbound00:14:411
3905696992119,2cyclictest3905507-21kworker/u8:0+flush-259:019:38:001
3905696992118,2cyclictest3905507-21kworker/u8:0+events_unbound19:30:121
3905694992119,2cyclictest3936350-21kworker/u8:4+events_unbound21:05:020
3905694992119,2cyclictest3913760-21kworker/u8:3+events_unbound23:06:080
3905694992118,2cyclictest3913760-21kworker/u8:3+flush-259:020:00:010
3905699992018,2cyclictest3960570-21kworker/u8:0+flush-259:022:35:112
3905699992018,2cyclictest3913760-21kworker/u8:3+flush-259:023:14:552
3905699992016,2cyclictest3928596-21latency_hist20:20:012
3905696992018,2cyclictest3913760-21kworker/u8:3+flush-259:020:27:121
3905694992018,2cyclictest3996063-21kworker/u8:3+flush-259:000:18:170
3905701991915,3cyclictest3993116-21/usr/sbin/munin23:45:143
3905701991915,3cyclictest3960570-21kworker/u8:0+flush-259:022:35:003
3905699991914,4cyclictest3945278-21ntpq21:10:182
3905699991913,4cyclictest3978685-21idleruntime-cro22:54:592
3905696991918,1cyclictest3908774-21kworker/u8:1+events_unbound19:55:141
3905696991917,2cyclictest3960570-21kworker/u8:0+events_unbound22:39:531
3905694991918,1cyclictest3953987-21kworker/u8:1+events_unbound22:06:580
3905694991917,2cyclictest3960570-21kworker/u8:0+events_unbound22:25:250
3905701991815,2cyclictest3908774-21kworker/u8:1+events_unbound21:15:003
3905701991815,2cyclictest3905688-21cyclictest00:21:013
3905701991814,3cyclictest3952361-21idleruntime-cro21:35:003
3905701991813,3cyclictest0-21swapper/323:25:003
3905696991816,2cyclictest3985531-21kworker/u8:0+events_unbound23:25:011
3905696991816,2cyclictest3936350-21kworker/u8:4+flush-259:021:00:571
3905694991816,2cyclictest3987525-21kworker/u8:3+events_unbound23:34:150
3905701991715,1cyclictest3915439-21cron19:40:003
3905701991714,3cyclictest3913760-21kworker/u8:3+flush-259:020:00:013
3905701991713,3cyclictest3917024-21latency_hist19:45:003
3905701991712,3cyclictest3977677-21irqstats22:50:193
3905699991714,2cyclictest3988134-21idleruntime-cro23:29:592
3905699991713,3cyclictest3913760-21kworker/u8:3+events_unbound22:25:152
3905699991713,3cyclictest3908774-21kworker/u8:1+flush-259:019:35:342
3905699991712,4cyclictest3985143-21ntpq23:15:172
3905699991712,3cyclictest0-21swapper/222:15:012
3905696991712,4cyclictest3909939-21ntpq19:20:171
3905694991716,1cyclictest3985531-21kworker/u8:0+events_unbound23:24:340
3905694991716,1cyclictest3936350-21kworker/u8:4+events_unbound20:50:140
390570199161,13cyclictest75450irq/129-enp2s0-TxRx-322:40:053
3905699991613,2cyclictest3965528-21apt-get22:15:022
3905699991610,1cyclictest4006324-21/usr/sbin/munin00:25:192
3905694991615,1cyclictest3987525-21kworker/u8:3+events_unbound23:37:030
390570199157,5cyclictest631-21rs:main3
3905701991513,2cyclictest3953987-21kworker/u8:1+flush-259:022:15:213
3905701991513,1cyclictest637-21NetworkManager20:40:093
3905701991512,2cyclictest5256-21gnome-shell21:51:593
3905701991512,2cyclictest3976864-21kworker/u8:1+flush-259:023:00:213
3905701991512,2cyclictest3918874-21apt-get19:50:113
3905701991512,2cyclictest3913760-21kworker/u8:3+flush-259:022:00:133
3905701991512,2cyclictest3908774-21kworker/u8:1+flush-259:019:20:043
3905701991511,3cyclictest769-21runrttasks21:58:513
3905701991511,2cyclictest737-21mta-sts-daemon23:35:003
390570199150,14cyclictest5489-21gnome-software23:53:183
390569999159,4cyclictest433058-21systemd-journal20:39:382
390569999158,5cyclictest3925192-21apt-get20:10:012
3905699991513,2cyclictest3985531-21kworker/u8:0+flush-259:023:49:572
3905699991511,3cyclictest3992640-21seq23:42:122
3905699991511,3cyclictest3968948-21latency_hist22:25:002
3905699991511,3cyclictest3910976-21apt-get19:25:122
3905699991511,2cyclictest0-21swapper/200:00:012
390569999151,11cyclictest5256-21gnome-shell23:00:582
390569699150,14cyclictest5256-21gnome-shell20:11:581
3905701991412,1cyclictest3913553-21chrt19:31:153
3905701991410,3cyclictest3985900-21latency_hist23:20:003
3905701991410,3cyclictest3968816-21taskset22:23:263
390570199140,13cyclictest3949870-21/usr/sbin/munin21:25:173
390570199140,13cyclictest3924096-21/usr/sbin/munin20:05:133
390570199140,13cyclictest3907365-21munin-node00:13:373
3905699991412,2cyclictest3908774-21kworker/u8:1+flush-259:021:17:302
3905699991411,2cyclictest769-21runrttasks00:37:392
3905699991411,2cyclictest3939660-21chrt20:54:282
3905699991411,1cyclictest3951064-21apt-get21:30:182
390569999140,12cyclictest771-21snmpd19:56:372
390570199139,3cyclictest5104-40gmain19:45:573
390570199139,3cyclictest4004249-21awk00:20:003
390570199138,3cyclictest0-21swapper/300:05:013
390570199137,4cyclictest0-21swapper/322:40:003
3905701991311,1cyclictest771-21snmpd20:27:013
3905701991311,1cyclictest637-21NetworkManager00:36:123
3905701991311,1cyclictest3979882-21/usr/sbin/munin22:55:193
3905701991311,1cyclictest3926995-21taskset20:14:493
3905701991311,1cyclictest3912242-21chrt19:29:393
3905701991311,1cyclictest0-21swapper/323:57:333
390570199131,10cyclictest3928598-21munin-run20:20:003
3905701991310,2cyclictest650-21gdbus21:20:003
3905701991310,2cyclictest3905821-21apt-get19:10:123
390570199130,12cyclictest3955776-21/usr/sbin/munin21:45:143
390569999135,7cyclictest3913760-21kworker/u8:3+events_unbound20:20:202
390569999131,1cyclictest0-21swapper/220:45:122
3905699991311,1cyclictest3943256-21/usr/sbin/munin21:05:152
3905699991311,1cyclictest0-21swapper/221:49:532
3905699991310,2cyclictest3994935-21hddtemp_smartct23:50:132
390569999130,12cyclictest637-21NetworkManager19:52:082
390569999130,12cyclictest3905794-21/usr/sbin/munin19:10:162
390569999130,12cyclictest0-21swapper/221:03:012
390570199129,2cyclictest4007513-21taskset00:28:203
390570199129,2cyclictest3939960-21/usr/sbin/munin20:55:133
390570199126,5cyclictest739-21mta-sts-daemon23:35:193
390570199120,12cyclictest0-21swapper/322:07:443
390570199120,11cyclictest700-21sshd23:06:523
390570199120,0cyclictest0-21swapper/321:20:393
390569999128,3cyclictest769-21runrttasks19:42:562
3905699991210,1cyclictest4003643-21/usr/sbin/munin00:15:182
390569999120,2cyclictest3991126-21runrttasks23:38:122
390569999120,0cyclictest0-21swapper/220:34:362
390570199110,2cyclictest3992488-21users23:40:203
390569999119,2cyclictest212-21usb-storage20:40:162
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional