You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-04-11 - 22:51

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackfslot7s.osadl.org (updated Fri Apr 11, 2025 00:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
75416099281013,2793cyclictest800926-21kworker/0:2+events21:55:130
75416099280713,2790cyclictest809062-21kworker/0:1+events22:17:320
75416099276213,2746cyclictest782512-21kworker/0:2+events20:45:210
75416099275011,2734cyclictest819136-21kworker/0:2+events22:45:000
75416799272812,2712cyclictest834101-21kworker/2:2+events23:40:122
75416099271313,2696cyclictest775201-21kworker/0:2+events20:15:130
75416099259212,2577cyclictest795737-21kworker/0:0+events21:20:010
75416099256111,2546cyclictest813836-21kworker/0:2+events22:29:430
75416799253511,2520cyclictest799504-21kworker/2:2+events21:35:182
75417099252812,2514cyclictest801038-21kworker/3:2+events21:40:193
75416799247612,2461cyclictest815881-21kworker/2:1+events22:35:482
75416099247012,2455cyclictest847355-21kworker/0:0+events00:30:220
7541709924668,2454cyclictest830946-21kworker/3:2+events23:30:113
75417099244112,2425cyclictest778442-21kworker/3:1+events20:42:143
75416799242212,2406cyclictest762392-21kworker/2:2+events19:35:142
75416799241912,2403cyclictest848599-21kworker/2:0+events00:35:122
75416799241111,2397cyclictest787802-21kworker/2:1+events21:06:202
75417099240210,2389cyclictest753951-21kworker/3:2+events19:25:013
75416099240112,2387cyclictest841146-21kworker/0:0+events00:20:330
75416099239512,2379cyclictest806453-21kworker/0:1+events22:00:150
75416799238611,2372cyclictest753850-21kworker/2:0+events19:30:132
75417099235711,2343cyclictest815757-21kworker/3:2+events22:37:433
75416099235312,2339cyclictest755497-21kworker/0:0+events19:15:010
75416099235312,2339cyclictest755497-21kworker/0:0+events19:15:000
75416299233911,2324cyclictest821421-21kworker/1:0+events23:02:391
75416299232712,2312cyclictest762266-21kworker/1:1+events19:45:131
75416799230410,2290cyclictest810668-21kworker/2:2+events22:15:162
75417099229412,2278cyclictest764257-21kworker/3:1+events19:41:463
75416299228711,2272cyclictest775264-21kworker/1:0+events20:13:211
75416099227310,2259cyclictest841146-21kworker/0:0+events00:03:060
75416099227211,2258cyclictest782512-21kworker/0:2+events20:54:060
75416099227211,2257cyclictest830070-21kworker/0:1+events23:27:310
75416099227110,2258cyclictest819824-21kworker/0:1+events22:51:080
75416099227011,2256cyclictest765850-21kworker/0:0+events19:56:390
75416099226911,2256cyclictest782512-21kworker/0:2+events21:00:090
75416099226811,2254cyclictest814486-21kworker/0:1+events22:32:430
75416099226611,2252cyclictest832617-21kworker/0:2+events23:33:360
75417099226510,2251cyclictest792991-21kworker/3:0+events21:21:093
75416099226411,2249cyclictest753789-21kworker/0:1+events19:31:000
75416099226410,2251cyclictest776798-21kworker/0:1+events20:20:330
75416099226012,2245cyclictest779139-21kworker/0:0+events20:37:150
75416799225912,2244cyclictest828686-21kworker/2:1+events23:20:202
7541609922569,2244cyclictest767450-21kworker/0:1+events19:48:380
75416099225411,2240cyclictest825417-21kworker/0:1+events23:10:430
75416099225310,2239cyclictest767450-21kworker/0:1+events19:54:190
75417099224310,2229cyclictest819654-21kworker/3:1+events22:48:283
75417099224010,2228cyclictest786319-21kworker/3:0+events20:56:223
75417099223810,2225cyclictest799434-21kworker/3:0+events22:06:203
75416299223512,2220cyclictest768961-21kworker/1:0+events20:00:291
75416299223410,2221cyclictest798075-21kworker/1:2+events21:31:531
7541709922339,2220cyclictest769169-21kworker/3:1+events20:01:403
75417099223210,2218cyclictest808429-21kworker/3:1+events22:11:233
7541679922308,2219cyclictest819884-21kworker/2:0+events22:56:082
75416799223010,2216cyclictest803454-21kworker/2:1+events21:50:122
75416799222911,2215cyclictest766001-21kworker/2:1+events19:48:142
75417099222511,2210cyclictest843362-21kworker/3:0+events00:15:143
75417099222511,2210cyclictest765876-21kworker/3:2+events19:50:293
75417099222510,2212cyclictest778442-21kworker/3:1+events20:30:473
75417099222211,2208cyclictest786319-21kworker/3:0+events20:53:443
75417099222210,2208cyclictest778442-21kworker/3:1+events20:23:123
75416799222211,2207cyclictest819169-21kworker/2:2+events23:29:472
75416799222111,2207cyclictest834101-21kworker/2:2+events23:48:572
75416799222110,2208cyclictest834101-21kworker/2:2+events23:56:582
75416799222011,2206cyclictest799504-21kworker/2:2+events21:43:192
75416799222011,2206cyclictest753850-21kworker/2:0+events19:28:412
7541709922199,2207cyclictest799434-21kworker/3:0+events21:38:463
7541709922198,2207cyclictest797825-21kworker/3:2+events21:29:123
75416799221811,2203cyclictest832467-21kworker/2:1+events23:34:002
75417099221610,2203cyclictest804937-21kworker/3:1+events21:54:033
75417099221610,2202cyclictest789487-21kworker/3:1+events21:08:363
75416799221610,2203cyclictest775408-21kworker/2:0+events20:19:002
75416799221510,2202cyclictest824610-21kworker/2:1+events23:01:302
75417099221411,2200cyclictest837867-21kworker/3:2+events00:01:103
7541679922146,2205cyclictest780592-21kworker/2:0+events20:39:572
75417099221311,2198cyclictest797167-21kworker/3:1+events21:33:283
75417099221111,2197cyclictest778442-21kworker/3:1+events20:38:473
75417099221110,2198cyclictest789487-21kworker/3:1+events21:13:373
75417099220611,2191cyclictest819654-21kworker/3:1+events22:52:183
7541679922053,2199cyclictest808256-21kworker/2:2+events22:02:312
7541609922003,2193cyclictest837834-21kworker/0:0+events23:52:460
7541709921986,2189cyclictest821282-21kworker/3:0+events23:03:483
75417099219811,2183cyclictest762400-21kworker/3:0+events19:37:323
75417099219810,2185cyclictest828648-21kworker/3:0+events23:24:313
75416799219711,2183cyclictest812565-21kworker/2:1+events22:21:222
75416799219711,2183cyclictest773815-21kworker/2:1+events20:12:122
75416799219511,2181cyclictest834101-21kworker/2:2+events23:37:532
75416799218910,2175cyclictest775408-21kworker/2:0+events20:23:352
75416799218811,2173cyclictest845086-21kworker/2:1+events00:28:502
75416799218810,2174cyclictest841743-21kworker/2:1+events00:10:192
75416799218711,2173cyclictest825296-21kworker/2:0+events23:15:192
75416799218711,2173cyclictest808971-21kworker/2:1+events22:08:412
75416799218711,2173cyclictest753850-21kworker/2:0+events19:21:342
7541679921869,2174cyclictest786171-21kworker/2:2+events20:56:442
7541679921858,2173cyclictest792652-21kworker/2:0+events21:15:522
75417099218310,2171cyclictest770895-21kworker/3:0+events20:11:263
7541679921709,2157cyclictest819169-21kworker/2:2+events22:47:192
75417099216910,2156cyclictest815757-21kworker/3:2+events22:31:353
75416799216512,2151cyclictest814254-21kworker/2:0+events22:30:052
7541709921569,2144cyclictest755673-21kworker/3:1+events19:16:553
7541709921569,2144cyclictest755673-21kworker/3:1+events19:16:543
75416299214911,2134cyclictest772280-21kworker/1:1+events20:06:131
75417099214810,2135cyclictest832839-21kworker/3:1+events23:39:253
7541679921447,2134cyclictest805187-21kworker/2:0+events22:14:302
7541679921446,2134cyclictest782396-21kworker/2:2+events20:40:412
75417099214210,2129cyclictest818975-21kworker/3:0+events22:44:153
75416299214211,2128cyclictest828535-21kworker/1:2+events23:49:181
75416299214111,2126cyclictest810458-21kworker/1:0+events22:29:221
75416299214110,2128cyclictest846680-21kworker/1:0+events00:25:291
75416299214011,2126cyclictest775264-21kworker/1:0+events20:36:081
75416299213911,2125cyclictest828535-21kworker/1:2+events23:34:231
75416299213711,2123cyclictest837928-21kworker/1:1+events23:55:271
75416299213411,2111cyclictest775264-21kworker/1:0+events20:27:221
75416299212911,2115cyclictest759837-21kworker/1:0+events19:28:211
75416299212910,2116cyclictest803211-21kworker/1:0+events21:47:301
7541629921288,2117cyclictest832737-21kworker/1:0+events23:38:161
75416299212811,2114cyclictest779285-21kworker/1:1+events20:31:551
75416299212611,2112cyclictest841654-21kworker/1:0+events00:11:271
75416299212510,2112cyclictest791217-21kworker/1:2+events21:07:271
75416099212410,2111cyclictest835966-21kworker/0:2+events23:58:300
75416099212110,2108cyclictest787651-21kworker/0:0+events21:05:330
75416299212011,2106cyclictest825234-21kworker/1:2+events23:09:331
7541609921209,2107cyclictest800926-21kworker/0:2+events21:36:280
75416099211810,2105cyclictest798106-21kworker/0:0+events21:34:120
75416099211710,2106cyclictest790935-21kworker/0:1+events21:24:370
75416099211710,2104cyclictest841146-21kworker/0:0+events00:17:080
75416099211710,2104cyclictest800926-21kworker/0:2+events21:44:510
75416299211611,2102cyclictest798075-21kworker/1:2+events21:39:551
75416099211610,2102cyclictest764228-21kworker/0:2+events19:42:290
75416099211510,2102cyclictest834283-21kworker/0:0+events23:43:590
75416299211411,2101cyclictest762266-21kworker/1:1+events19:56:161
75416299211311,2100cyclictest776978-21kworker/1:1+events20:20:091
7541609921137,2102cyclictest830070-21kworker/0:1+events23:24:520
75416099211310,2100cyclictest839467-21kworker/0:1+events00:11:480
7541609921129,2099cyclictest809062-21kworker/0:1+events22:10:370
75416099211210,2099cyclictest821478-21kworker/0:2+events22:59:340
75416099211110,2097cyclictest800926-21kworker/0:2+events21:51:210
75416799211010,2096cyclictest792652-21kworker/2:0+events21:23:022
7541609921109,2098cyclictest808374-21kworker/0:2+events22:09:050
7541609921109,2098cyclictest753789-21kworker/0:1+events19:21:090
75416099211010,2098cyclictest830070-21kworker/0:1+events23:45:070
7541609921098,2098cyclictest821478-21kworker/0:2+events23:08:020
75416099210910,2095cyclictest770742-21kworker/0:2+events20:04:180
7541609921088,2097cyclictest797450-21kworker/0:2+events21:28:250
75416099210710,2094cyclictest753789-21kworker/0:1+events19:13:290
75416099210710,2093cyclictest753789-21kworker/0:1+events19:37:090
7541609921065,2098cyclictest817455-21kworker/0:0+events23:02:150
75416299210511,2090cyclictest810458-21kworker/1:0+events22:12:561
7541609921059,2093cyclictest758900-21kworker/0:2+events19:25:470
7541609921049,2092cyclictest830070-21kworker/0:1+events23:39:020
75416299210311,2089cyclictest804909-21kworker/1:2+events21:57:081
75417099210110,2088cyclictest847228-21kworker/3:2+events00:32:373
7541679920986,2089cyclictest825296-21kworker/2:0+events23:07:392
75416099209810,2086cyclictest790935-21kworker/0:1+events21:45:350
7541629920974,2090cyclictest810458-21kworker/1:0+events22:22:321
7541609920979,2085cyclictest817455-21kworker/0:0+events22:49:140
7541609920978,2085cyclictest847355-21kworker/0:0+events00:38:130
75416099209710,2083cyclictest794143-21kworker/0:2+events21:14:210
75417099209610,2083cyclictest837867-21kworker/3:2+events23:53:333
75416099209510,2082cyclictest787651-21kworker/0:0+events20:57:080
7541709920935,2085cyclictest753951-21kworker/3:2+events19:34:493
7541609920919,2079cyclictest772418-21kworker/0:1+events20:07:430
7541629920899,2077cyclictest762266-21kworker/1:1+events19:32:331
75417099208610,2073cyclictest773605-21kworker/3:2+events20:09:123
75417099208310,2071cyclictest841767-21kworker/3:2+events00:20:103
75417099208310,2069cyclictest824798-21kworker/3:1+events23:05:193
7541709920818,2070cyclictest753951-21kworker/3:2+events19:29:523
7541709920815,2073cyclictest795539-21kworker/3:2+events21:18:293
75417099208110,2069cyclictest810690-21kworker/3:0+events22:19:043
7541679920807,2070cyclictest767630-21kworker/2:2+events20:05:502
75417099207910,2065cyclictest839469-21kworker/3:1+events23:57:453
7541609920798,2068cyclictest765850-21kworker/0:0+events20:11:030
75417099207810,2065cyclictest753951-21kworker/3:2+events19:14:133
75417099207810,2064cyclictest814099-21kworker/3:0+events22:27:053
7541709920779,2064cyclictest808429-21kworker/3:1+events22:04:043
75416799207710,2064cyclictest778660-21kworker/2:2+events20:28:532
75417099207610,2063cyclictest848836-21kworker/3:1+events00:35:353
7541709920759,2063cyclictest799434-21kworker/3:0+events21:49:023
7541709920756,2066cyclictest825448-21kworker/3:2+events23:18:253
7541709920747,2064cyclictest825448-21kworker/3:2+events23:14:113
75417099207410,2061cyclictest786319-21kworker/3:0+events21:00:563
7541679920748,2063cyclictest802742-21kworker/2:0+events21:45:132
75416299207411,2060cyclictest826871-21kworker/1:0+events23:21:271
75416299207410,2060cyclictest797298-21kworker/1:0+events21:24:591
7541709920735,2064cyclictest836265-21kworker/3:0+events23:47:483
75417099207310,2061cyclictest819654-21kworker/3:1+events22:55:453
7541679920734,2066cyclictest777011-21kworker/2:1+events20:34:112
75416799207310,2060cyclictest767630-21kworker/2:2+events19:50:082
7541679920709,2057cyclictest766001-21kworker/2:1+events19:44:512
75416799207010,2057cyclictest787802-21kworker/2:1+events21:00:332
7541709920697,2059cyclictest809085-21kworker/3:2+events22:23:183
75417099206810,2055cyclictest778442-21kworker/3:1+events20:25:503
75416799206810,2054cyclictest819169-21kworker/2:2+events22:54:142
7541629920679,2055cyclictest843278-21kworker/1:2+events00:22:051
7541679920665,2057cyclictest753850-21kworker/2:0+events19:19:372
7541679920665,2057cyclictest753850-21kworker/2:0+events19:19:372
7541679920662,2061cyclictest791034-21kworker/2:2+events21:13:152
75416799206610,2053cyclictest834101-21kworker/2:2+events23:53:092
7541679920659,2052cyclictest772158-21kworker/2:0+events20:03:102
7541679920654,2057cyclictest780592-21kworker/2:0+events20:46:502
75416799206510,2051cyclictest797898-21kworker/2:1+events21:32:402
7541679920649,2052cyclictest843336-21kworker/2:0+events00:23:132
75416799206410,2051cyclictest810668-21kworker/2:2+events22:28:142
75416799206410,2050cyclictest848599-21kworker/2:0+events00:31:282
7541679920637,2053cyclictest819169-21kworker/2:2+events23:12:172
7541679920636,2054cyclictest792652-21kworker/2:0+events21:28:492
75416799206310,2050cyclictest834101-21kworker/2:2+events00:08:502
7541709920618,2050cyclictest832839-21kworker/3:1+events23:42:263
75416799206110,2048cyclictest780592-21kworker/2:0+events20:51:272
75417099206010,2047cyclictest776804-21kworker/3:2+events20:16:423
7541679920607,2050cyclictest805187-21kworker/2:0+events21:59:042
75416799206010,2047cyclictest834101-21kworker/2:2+events00:03:292
75416799205910,2045cyclictest819169-21kworker/2:2+events22:44:372
7541709920569,2043cyclictest828648-21kworker/3:0+events23:26:453
75417099205510,2042cyclictest846561-21kworker/3:0+events00:26:143
7541679920558,2044cyclictest834101-21kworker/2:2+events00:15:592
75416299205510,2042cyclictest775264-21kworker/1:0+events20:46:291
75416099205210,2039cyclictest839467-21kworker/0:1+events00:09:580
7541609920454,2038cyclictest817455-21kworker/0:0+events22:38:060
75417099203810,2025cyclictest804937-21kworker/3:1+events21:55:353
75417099203710,2024cyclictest841767-21kworker/3:2+events00:11:063
75417099203110,2018cyclictest765876-21kworker/3:2+events19:59:213
7541609920289,2017cyclictest843396-21kworker/0:2+events00:27:430
7541629920238,2011cyclictest762266-21kworker/1:1+events19:39:061
75417099202010,2007cyclictest841767-21kworker/3:2+events00:08:273
75417099200710,1994cyclictest784457-21kworker/3:2+events20:45:433
7541679920069,1994cyclictest769881-21kworker/2:1+events19:57:022
75416799200611,1992cyclictest750565-21kworker/2:2+events19:13:062
75416299200411,1990cyclictest795678-21kworker/1:2+events21:18:541
7541709919954,1988cyclictest767493-21kworker/3:0+events19:49:233
7541629919877,1977cyclictest819587-21kworker/1:1+events22:46:571
7541629919869,1974cyclictest775264-21kworker/1:0+events20:52:131
75416299198510,1972cyclictest789397-21kworker/1:1+events20:58:371
75416299198410,1971cyclictest815941-21kworker/1:2+events22:53:511
7541629919838,1973cyclictest828535-21kworker/1:2+events00:05:021
75416299198310,1971cyclictest810458-21kworker/1:0+events22:35:041
75416299198310,1969cyclictest797298-21kworker/1:0+events21:29:361
75416299198210,1969cyclictest775264-21kworker/1:0+events20:43:001
7541629919819,1970cyclictest791217-21kworker/1:2+events21:10:071
75416299198110,1968cyclictest803211-21kworker/1:0+events22:01:241
75416299198010,1967cyclictest847324-21kworker/1:1+events00:34:071
75416299197410,1960cyclictest846680-21kworker/1:0+events00:37:261
75416299197310,1960cyclictest837928-21kworker/1:1+events00:00:241
75416299197310,1960cyclictest775264-21kworker/1:0+events20:18:361
7541629919723,1966cyclictest799682-21kworker/1:1+events21:41:061
75416299197111,1957cyclictest834436-21kworker/1:1+events23:41:191
75416299196910,1956cyclictest808788-21kworker/1:2+events22:07:301
7541609919698,1958cyclictest776798-21kworker/0:1+events20:27:450
7541629919645,1956cyclictest804909-21kworker/1:2+events21:53:401
7541629919449,1932cyclictest762266-21kworker/1:1+events19:52:021
7541629919408,1929cyclictest826871-21kworker/1:0+events23:17:371
7541609919379,1925cyclictest812093-21kworker/0:0+events22:24:260
7541629919319,1919cyclictest828535-21kworker/1:2+events23:28:401
7541629919313,1924cyclictest815941-21kworker/1:2+events22:33:531
7541629919299,1916cyclictest775264-21kworker/1:0+events21:02:521
7541629919199,1906cyclictest843278-21kworker/1:2+events00:18:391
7541629919188,1907cyclictest755530-21kworker/1:0+events19:16:341
7541629919188,1907cyclictest755530-21kworker/1:0+events19:16:341
7541629919148,1903cyclictest828535-21kworker/1:2+events23:52:001
7541629919049,1892cyclictest753700-21kworker/1:2+events19:13:521
7541629918799,1867cyclictest823424-21kworker/1:1+events23:11:301
7541629918729,1860cyclictest757678-21kworker/1:1+events19:23:271
7533502159103,46sleep10-21swapper/119:05:241
7537632144111,30sleep30-21swapper/319:07:193
7539382141111,24sleep20-21swapper/219:09:342
7536412140109,26sleep00-21swapper/019:05:440
754160991912,1cyclictest0-21swapper/023:15:130
754162991711,1cyclictest764738-21/usr/sbin/munin19:40:211
75416299170,5cyclictest822283-21/usr/sbin/munin22:55:161
75416299148,4cyclictest819027-21seq22:41:531
75416299141,9cyclictest811555-21ntpq22:15:191
75416099148,4cyclictest798-21runrttasks20:33:550
754160991410,3cyclictest783574-21/usr/sbin/munin20:40:170
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional