You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-11-25 - 11:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot4s.osadl.org (updated Mon Nov 25, 2024 00:44:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2289399188178,9cyclictest0-21swapper/019:10:010
2289999131129,1cyclictest0-21swapper/219:10:012
226852123104,9sleep30-21swapper/319:09:263
225152116104,9sleep20-21swapper/219:07:122
22492211399,10sleep00-21swapper/019:06:540
2289599112108,1cyclictest0-21swapper/119:14:381
17588210794,9sleep10-21swapper/119:05:101
22899999591,3cyclictest11237-21kworker/u16:0+events_unbound00:00:012
22899999086,3cyclictest9910-21kworker/u16:2+events_unbound20:05:252
22899998673,4cyclictest11237-21kworker/u16:0+events_unbound22:55:252
22899998581,3cyclictest11237-21kworker/u16:0+events_unbound00:25:242
22899998076,3cyclictest9910-21kworker/u16:2+events_unbound21:40:232
22899997974,3cyclictest9910-21kworker/u16:2+events_unbound23:35:252
22899997972,3cyclictest9910-21kworker/u16:2+events_unbound20:55:252
22899997874,3cyclictest9910-21kworker/u16:2+events_unbound23:15:012
22899997874,3cyclictest9910-21kworker/u16:2+events_unbound22:20:242
22899997773,3cyclictest11237-21kworker/u16:0+events_unbound23:20:252
22899997772,3cyclictest9910-21kworker/u16:2+events_unbound21:25:252
22899997672,3cyclictest11237-21kworker/u16:0+events_unbound21:50:312
22899997268,3cyclictest9910-21kworker/u16:2+events_unbound21:55:272
22899997268,3cyclictest11237-21kworker/u16:0+events_unbound21:20:262
22899997167,3cyclictest11237-21kworker/u16:0+events_unbound20:10:262
22899997165,3cyclictest9910-21kworker/u16:2+events_unbound22:15:252
22899997163,3cyclictest9910-21kworker/u16:2+events_unbound00:10:022
22899997067,2cyclictest11237-21kworker/u16:0+events_unbound21:00:242
22899997066,3cyclictest9910-21kworker/u16:2+events_unbound21:30:282
22899997063,3cyclictest9910-21kworker/u16:2+events_unbound19:45:142
22899996965,3cyclictest9910-21kworker/u16:2+events_unbound22:50:292
22899996965,3cyclictest11237-21kworker/u16:0+events_unbound20:00:252
22899996864,3cyclictest11237-21kworker/u16:0+events_unbound20:25:272
22899996763,3cyclictest9910-21kworker/u16:2+events_unbound20:30:282
22899996763,3cyclictest9910-21kworker/u16:2+events_unbound19:35:252
22899996763,3cyclictest11237-21kworker/u16:0+events_unbound19:20:262
22899996763,3cyclictest11237-21kworker/u16:0+events_unbound19:20:252
22899996762,3cyclictest9910-21kworker/u16:2+events_unbound23:25:162
22899996761,3cyclictest9910-21kworker/u16:2+events_unbound00:00:132
22899996662,3cyclictest9910-21kworker/u16:2+events_unbound21:10:152
22899996659,3cyclictest11237-21kworker/u16:0+events_unbound19:15:022
22899996561,3cyclictest9910-21kworker/u16:2+events_unbound23:40:252
22899996561,3cyclictest11237-21kworker/u16:0+events_unbound20:40:262
22899996460,3cyclictest11237-21kworker/u16:0+events_unbound20:20:262
22899996458,3cyclictest11237-21kworker/u16:0+events_unbound20:15:272
22899996360,2cyclictest11237-21kworker/u16:0+events_unbound19:25:242
22899996359,3cyclictest11237-21kworker/u16:0+events_unbound19:50:182
22899996258,3cyclictest9910-21kworker/u16:2+events_unbound19:55:162
22899996258,3cyclictest11237-21kworker/u16:0+events_unbound23:05:262
22899996157,3cyclictest9910-21kworker/u16:2+events_unbound22:25:262
22899996157,3cyclictest9910-21kworker/u16:2+events_unbound22:10:182
22899996157,3cyclictest9910-21kworker/u16:2+events_unbound20:35:282
22899996157,3cyclictest9910-21kworker/u16:2+events_unbound00:30:172
22899996157,3cyclictest11237-21kworker/u16:0+events_unbound20:50:162
63962600,1sleep30-21swapper/320:20:153
22899996056,3cyclictest9910-21kworker/u16:2+events_unbound22:30:312
22899996056,3cyclictest11237-21kworker/u16:0+events_unbound21:45:252
22899995955,3cyclictest9910-21kworker/u16:2+events_unbound22:45:262
22899995955,3cyclictest11237-21kworker/u16:0+events_unbound23:30:192
22899995955,3cyclictest11237-21kworker/u16:0+events_unbound22:05:282
22899995955,3cyclictest11237-21kworker/u16:0+events_unbound00:05:142
22899995954,3cyclictest9910-21kworker/u16:2+events_unbound22:40:252
67422580,1sleep1261rcuc/121:45:251
22899995854,3cyclictest9910-21kworker/u16:2+events_unbound21:35:252
22899995854,3cyclictest9910-21kworker/u16:2+events_unbound21:35:252
22899995853,3cyclictest11237-21kworker/u16:0+events_unbound00:20:132
22899995551,3cyclictest11237-21kworker/u16:0+events_unbound21:15:242
22899995446,3cyclictest11237-21kworker/u16:0+events_unbound22:35:242
22899995349,3cyclictest11237-21kworker/u16:0+events_unbound00:15:142
22899995247,3cyclictest9910-21kworker/u16:2+events_unbound20:45:132
22899995245,3cyclictest11237-21kworker/u16:0+events_unbound21:05:272
22899994845,2cyclictest11237-21kworker/u16:0+events_unbound00:40:012
22899994642,3cyclictest9910-21kworker/u16:2+events_unbound23:10:312
22895994644,1cyclictest9910-21kworker/u16:2+events_unbound23:35:141
22899994338,3cyclictest11237-21kworker/u16:0+events_unbound23:50:012
22895994338,4cyclictest9910-21kworker/u16:2+events_unbound00:30:291
22895994337,4cyclictest11237-21kworker/u16:0+events_unbound21:40:171
22899994238,3cyclictest11237-21kworker/u16:0+events_unbound19:40:182
22899994037,3cyclictest9910-21kworker/u16:2+events_unbound23:50:252
22899994036,3cyclictest11237-21kworker/u16:0+events_unbound22:00:242
22895993731,4cyclictest11237-21kworker/u16:0+events_unbound00:20:001
22899993532,3cyclictest9910-21kworker/u16:2+events_unbound19:30:192
2289399320,30cyclictest0-21swapper/000:00:120
22899992926,2cyclictest9910-21kworker/u16:2+events_unbound23:00:292
22895992924,4cyclictest9910-21kworker/u16:2+events_unbound23:10:191
22895992824,3cyclictest9910-21kworker/u16:2+events_unbound21:55:251
22895992723,3cyclictest11237-21kworker/u16:0+events_unbound22:55:241
22895992521,3cyclictest9910-21kworker/u16:2+events_unbound22:30:181
220572250,1chrt45-21kworker/3:0+events22:30:243
22895992421,2cyclictest27496-21apt20:40:001
22895992420,3cyclictest9910-21kworker/u16:2+events_unbound20:30:221
22895992419,4cyclictest9910-21kworker/u16:2+events_unbound21:30:301
2289599223,13cyclictest14710-21apt-get19:30:131
2289599222,14cyclictest11479-21turbostat20:55:001
2289599222,11cyclictest10797-21taskset20:21:181
22895992218,3cyclictest16395-40logrotate00:00:001
22893992219,2cyclictest9910-21kworker/u16:2+events_unbound19:30:270
22893992212,3cyclictest16066-21cron22:10:010
2289599214,14cyclictest0-21swapper/119:56:541
2289599212,16cyclictest17562-21taskset21:26:421
2289599210,18cyclictest26092-21runrttasks23:32:341
2289399214,7cyclictest0-21swapper/020:40:190
2289399210,15cyclictest10082-21taskset23:20:110
2289599204,12cyclictest717-21runrttasks22:12:021
2289599202,15cyclictest7878-21taskset22:17:061
22895992015,4cyclictest9910-21kworker/u16:2+events_unbound00:35:021
2289599196,8cyclictest24870-21timerwakeupswit19:35:261
2289599195,8cyclictest26062-21diskstats23:05:141
2289599195,11cyclictest0-21swapper/120:25:191
2289599194,14cyclictest0-21swapper/119:15:461
2289599194,14cyclictest0-21swapper/100:22:461
2289599194,12cyclictest0-21swapper/123:54:421
2289599194,12cyclictest0-21swapper/123:46:461
2289599194,12cyclictest0-21swapper/123:44:171
2289599194,12cyclictest0-21swapper/123:25:421
2289599194,12cyclictest0-21swapper/123:21:061
2289599194,12cyclictest0-21swapper/122:48:461
2289599194,12cyclictest0-21swapper/122:08:261
2289599194,12cyclictest0-21swapper/121:51:061
2289599194,12cyclictest0-21swapper/121:22:411
2289599194,12cyclictest0-21swapper/121:17:251
2289599194,12cyclictest0-21swapper/121:12:261
2289599194,12cyclictest0-21swapper/121:01:421
2289599194,12cyclictest0-21swapper/120:57:101
2289599194,12cyclictest0-21swapper/120:06:051
2289599194,12cyclictest0-21swapper/120:00:331
2289599194,12cyclictest0-21swapper/119:52:501
2289599194,12cyclictest0-21swapper/119:43:141
2289599194,12cyclictest0-21swapper/119:24:301
2289599194,12cyclictest0-21swapper/119:24:301
2289599193,13cyclictest0-21swapper/122:52:101
2289599192,14cyclictest0-21swapper/123:15:061
2289599192,14cyclictest0-21swapper/122:39:021
22895991914,3cyclictest9910-21kworker/u16:2+events_unbound22:25:121
2289599191,15cyclictest9243-21/usr/sbin/munin19:25:131
2289599191,12cyclictest0-21swapper/120:14:101
2289599190,17cyclictest0-21swapper/100:00:121
2289399194,6cyclictest0-21swapper/000:22:140
22893991916,2cyclictest27406-21idleruntime-cro00:10:000
2289599184,12cyclictest0-21swapper/122:42:421
2289599184,11cyclictest0-21swapper/123:00:331
2289599184,11cyclictest0-21swapper/122:02:181
2289599184,11cyclictest0-21swapper/121:05:101
2289599184,11cyclictest0-21swapper/120:46:331
2289599183,12cyclictest0-21swapper/120:41:011
2289599183,12cyclictest0-21swapper/100:12:301
2289599182,12cyclictest0-21swapper/100:05:101
2289599181,14cyclictest0-21swapper/122:20:051
2289599181,14cyclictest0-21swapper/121:35:061
2289599181,14cyclictest0-21swapper/121:35:061
2289599180,12cyclictest0-21swapper/100:25:101
2289399181,6cyclictest3937-21awk23:15:000
22893991815,2cyclictest0-21swapper/000:35:010
2289599174,8cyclictest3624-21chrt19:46:061
2289599172,10cyclictest32161-21apt-get20:15:021
2289399173,11cyclictest31410-21grep20:10:230
2289399171,6cyclictest8998-21idleruntime-cro19:25:000
2289399171,6cyclictest8998-21idleruntime-cro19:25:000
2289399164,5cyclictest0-21swapper/022:30:210
22893991612,3cyclictest9910-21kworker/u16:2+events_unbound22:00:270
2289399157,7cyclictest0-21swapper/021:45:000
2289399154,6cyclictest11922-21/usr/sbin/munin20:55:130
2289399154,6cyclictest0-21swapper/021:04:550
2289399154,6cyclictest0-21swapper/020:36:220
2289399154,6cyclictest0-21swapper/020:17:390
2289399154,6cyclictest0-21swapper/020:07:170
2289399154,6cyclictest0-21swapper/000:27:010
2289399152,8cyclictest6876-21/usr/sbin/munin21:45:250
2289399151,7cyclictest11773-21diskstats20:25:150
22893991510,4cyclictest9910-21kworker/u16:2+events_unbound20:45:240
2289399150,1cyclictest0-21swapper/021:30:150
2289399146,6cyclictest141ktimers/023:35:120
2289399145,8cyclictest1349-21awk21:15:000
2289399145,8cyclictest0-21swapper/000:36:580
2289399144,5cyclictest0-21swapper/022:10:230
2289399144,5cyclictest0-21swapper/019:35:170
2289399143,6cyclictest9399-21munin-run19:55:010
2289399143,6cyclictest851-21apt00:15:000
2289399143,6cyclictest10937-21basename23:55:000
2289399143,6cyclictest0-21swapper/022:50:400
2289399143,6cyclictest0-21swapper/021:59:050
22893991411,2cyclictest28790-21systemctl21:40:000
22893991411,2cyclictest28790-21systemctl21:40:000
2289399140,4cyclictest13005-21sed22:20:260
2289399139,3cyclictest1-21systemd21:20:240
2289399139,3cyclictest10939-21irqcore19:55:200
2289399138,4cyclictest26530-21kthreadcore21:05:210
2289399133,8cyclictest0-21swapper/019:15:180
2289399133,5cyclictest0-21swapper/023:15:160
2289399132,6cyclictest0-21swapper/022:45:180
2289399132,6cyclictest0-21swapper/022:44:130
2289399132,6cyclictest0-21swapper/019:28:080
2289399130,12cyclictest4061-21cat19:50:010
2289399130,10cyclictest16587-21sed00:00:010
221672130,0sleep30-21swapper/321:30:253
2289399127,4cyclictest25832-21ps22:35:180
2289399125,5cyclictest0-21swapper/022:55:190
2289399124,8cyclictest0-21swapper/023:01:310
2289399124,6cyclictest0-21swapper/023:42:020
2289399124,6cyclictest0-21swapper/021:16:070
2289399124,6cyclictest0-21swapper/020:52:480
2289399124,6cyclictest0-21swapper/019:40:480
2289399122,6cyclictest0-21swapper/023:48:220
2289399122,6cyclictest0-21swapper/023:31:590
2289399122,6cyclictest0-21swapper/023:06:450
2289399122,6cyclictest0-21swapper/020:25:000
2289399121,6cyclictest0-21swapper/000:17:030
2289399120,11cyclictest0-21swapper/020:00:130
2289399114,5cyclictest0-21swapper/023:27:260
2289399114,5cyclictest0-21swapper/021:51:250
2289399114,5cyclictest0-21swapper/021:27:490
2289399104,5cyclictest0-21swapper/022:25:160
2289399102,5cyclictest0-21swapper/020:30:270
228939990,8cyclictest3160-21expr22:15:140
13322280,0sleep30-21swapper/321:25:163
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
14356270,1sleep30-21swapper/322:55:143
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
9918260,4sleep30-21swapper/319:55:023
8380260,4sleep30-21swapper/322:20:113
4562260,4sleep30-21swapper/323:15:023
3779260,4sleep30-21swapper/319:20:113
3779260,4sleep30-21swapper/319:20:113
32045260,4sleep30-21swapper/323:40:113
28543260,4sleep30-21swapper/321:10:133
28043260,4sleep30-21swapper/300:10:133
23545260,4sleep30-21swapper/321:35:103
23545260,4sleep30-21swapper/321:35:093
23183260,4sleep30-21swapper/300:35:023
2295260,2sleep30-21swapper/322:10:373
22276260,4sleep30-21swapper/320:35:153
18906260,4sleep30-21swapper/322:00:113
16809260,4sleep30-21swapper/320:30:133
15811260,4sleep30-21swapper/320:00:043
1551260,3sleep30-21swapper/321:41:283
10074260,4sleep30-21swapper/323:20:113
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional