You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-04-11 - 23:12

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Fri Apr 11, 2025 12:44:38)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
476899154145,8cyclictest0-21swapper/007:12:120
476899118113,4cyclictest8931-21kworker/u16:0+events_unbound08:30:020
45912117104,9sleep30-21swapper/307:09:473
45182117104,10sleep20-21swapper/207:08:502
4391211491,8sleep00-21swapper/007:07:110
31867210995,10sleep10-21swapper/107:05:031
477299107103,1cyclictest0-21swapper/107:12:121
477599105103,1cyclictest0-21swapper/207:12:122
46402950,0sleep30-21swapper/309:00:233
128202500,1sleep012821-21cat07:40:210
299012450,0chrt0-21swapper/008:55:190
4768993834,3cyclictest16334-21kworker/u16:3+events_unbound09:55:240
4768993732,4cyclictest16334-21kworker/u16:3+events_unbound11:15:260
4768993429,4cyclictest8931-21kworker/u16:0+events_unbound09:05:250
477299320,16cyclictest0-21swapper/110:20:121
4768993228,3cyclictest8931-21kworker/u16:0+events_unbound10:35:300
4768993026,3cyclictest16334-21kworker/u16:3+events_unbound11:10:290
477299293,21cyclictest973-21cron11:25:001
477299282,20cyclictest298672sleep112:00:141
4768992724,2cyclictest16334-21kworker/u16:3+events_unbound07:30:300
4768992622,3cyclictest16334-21kworker/u16:3+events_unbound11:50:210
4768992620,4cyclictest8931-21kworker/u16:0+events_unbound09:10:220
4772992517,7cyclictest13950-21sadc07:45:001
4768992520,4cyclictest8931-21kworker/u16:0+events_unbound11:00:170
4772992315,7cyclictest31608-21latency_hist10:50:011
4768992319,3cyclictest8931-21kworker/u16:0+events_unbound08:45:270
4768992319,3cyclictest8931-21kworker/u16:0+events_unbound08:45:270
4768992316,5cyclictest8931-21kworker/u16:0+events_unbound10:50:030
4768992218,3cyclictest8931-21kworker/u16:0+events_unbound07:50:280
144572220,6sleep2341rcuc/210:30:002
477299214,16cyclictest0-21swapper/112:10:251
477299210,1cyclictest0-21swapper/108:20:131
4768992115,4cyclictest5137-21munin-run09:05:000
4768992115,3cyclictest0-21swapper/007:35:000
476899210,19cyclictest25147-21runrttasks07:55:130
477299204,11cyclictest0-21swapper/111:55:191
477299202,14cyclictest0-21swapper/112:30:071
477299201,15cyclictest0-21swapper/109:50:081
477299200,18cyclictest25147-21chrt07:55:131
4768992018,1cyclictest8931-21kworker/u16:0+events_unbound10:15:160
4768992016,3cyclictest8931-21kworker/u16:0+events_unbound10:40:270
4768992015,4cyclictest16334-21kworker/u16:3+events_unbound12:00:150
4772991915,3cyclictest547-21avahi-daemon08:20:001
476899193,11cyclictest2930-21unixbench_multi08:00:250
476899191,11cyclictest12180-21idleruntime-cro09:44:590
476899190,6cyclictest0-21swapper/008:20:130
477599180,4cyclictest29248-21irqcore09:30:222
477599170,1cyclictest0-21swapper/210:20:122
477299172,14cyclictest32422-21cut10:10:211
477299171,13cyclictest0-21swapper/108:50:141
4772991710,6cyclictest25046-21irqrtprio10:00:181
477299170,9cyclictest17787-21tr10:30:201
477299170,4cyclictest15919-21cut07:45:191
477299170,2cyclictest0-21swapper/112:15:121
476899176,6cyclictest0-21swapper/012:29:430
476899173,11cyclictest27027-21apt09:25:000
476899172,10cyclictest12751-21python307:15:030
4768991713,3cyclictest8931-21kworker/u16:0+events_unbound11:55:260
4768991713,3cyclictest16334-21kworker/u16:3+events_unbound09:50:210
477599168,7cyclictest0-21swapper/209:54:592
477599160,5cyclictest717-21runrttasks10:15:402
477299161,11cyclictest0-21swapper/109:55:101
477299160,8cyclictest24946-21unixbench_multi10:35:301
477299160,5cyclictest2957-21kthreadcore10:50:171
477299160,4cyclictest8329-21kthreadcore08:35:221
477299160,4cyclictest5052-21grep07:35:201
477299160,4cyclictest19611-21gltestperf11:50:121
477299160,4cyclictest17604-21unixbench_multi11:40:261
477299160,4cyclictest10610-21taskset08:40:181
477299160,3cyclictest15625-21taskset11:01:031
477299160,1cyclictest0-21swapper/108:25:151
476899165,8cyclictest0-21swapper/008:05:520
476899165,6cyclictest0-21swapper/007:27:330
476899164,8cyclictest0-21swapper/012:10:530
477599150,8cyclictest7240-21cut12:10:282
477599150,8cyclictest6077-21cut07:35:202
477599150,8cyclictest23763-21kthreadcore09:20:212
477599150,5cyclictest25182-21kthreadcore11:15:202
477599150,5cyclictest21227-21cut11:50:152
477599150,5cyclictest2071-21cut09:00:172
477599150,5cyclictest14591-21cut09:10:252
477599150,4cyclictest8717-21aten2_r5power_c07:40:132
477599150,4cyclictest717-21runrttasks10:52:352
477599150,4cyclictest717-21runrttasks10:35:282
477599150,4cyclictest717-21runrttasks10:01:022
477599150,4cyclictest717-21runrttasks08:10:042
477599150,4cyclictest717-21runrttasks08:02:222
477599150,4cyclictest717-21runrttasks07:51:482
477599150,4cyclictest15407-21hddtemp_smartct10:30:172
477599150,4cyclictest14212-21latency_hist12:20:002
477599150,1cyclictest0-21swapper/208:15:252
477299157,7cyclictest16509-21irqrtprio08:45:221
477299157,7cyclictest16509-21irqrtprio08:45:211
477299156,8cyclictest306-21fschecks_count09:00:121
477299155,6cyclictest0-21swapper/109:45:471
477299154,6cyclictest0-21swapper/110:43:371
477299152,6cyclictest0-21swapper/109:35:001
477299151,12cyclictest0-21swapper/107:30:151
477299151,10cyclictest0-21swapper/110:55:121
477299150,8cyclictest4749-21grep10:15:211
477299150,8cyclictest31674-21cut08:30:171
477299150,6cyclictest689-21snmpd08:10:171
477299150,4cyclictest717-21runrttasks12:26:371
477299150,4cyclictest717-21runrttasks08:55:021
477299150,4cyclictest27960-21kthreadcore07:25:201
477299150,4cyclictest26324-21expr12:35:171
477299150,4cyclictest23973-21kthreadcore09:20:201
477299150,4cyclictest22212-21latency_hist11:15:001
477299150,4cyclictest21140-21grep09:15:261
477299150,4cyclictest18246-21cut12:20:231
477299150,4cyclictest13793-21kthreadcore09:10:251
477299150,4cyclictest10707-21latency_hist09:10:001
477299150,3cyclictest32672-21cut08:00:181
477299150,2cyclictest0-21swapper/111:35:151
477299150,1cyclictest0-21swapper/109:40:181
477299150,14cyclictest17560-21switchtime07:15:251
476899159,5cyclictest141ktimers/008:40:140
476899154,6cyclictest8725-21strings08:35:230
476899154,6cyclictest0-21swapper/012:32:580
476899154,6cyclictest0-21swapper/012:22:010
476899154,6cyclictest0-21swapper/012:15:160
476899154,6cyclictest0-21swapper/011:21:590
476899154,6cyclictest0-21swapper/009:34:100
476899154,10cyclictest0-21swapper/011:05:040
4768991512,2cyclictest6229-21irqrtprio10:55:200
4768991511,3cyclictest8931-21kworker/u16:0+events_unbound11:40:250
4768991510,4cyclictest16334-21kworker/u16:3+events_unbound10:00:140
477599141,9cyclictest15482-21apt-get08:45:142
477599141,9cyclictest15482-21apt-get08:45:142
477599140,4cyclictest7653-21cstates11:35:152
477599140,4cyclictest717-21runrttasks07:34:532
477599140,4cyclictest7020-21cut08:05:202
477599140,4cyclictest6977-21kthreadcore08:35:212
477599140,4cyclictest3282-21latency_hist12:10:012
477599140,4cyclictest31082-21cut12:00:212
477599140,4cyclictest22592-21cut08:50:222
477599140,4cyclictest22589-21cut12:30:142
477599140,4cyclictest19060-21kthreadcore11:10:232
477599140,4cyclictest17602-21grep11:40:262
477599140,4cyclictest17395-21cut09:15:192
477599140,4cyclictest1224-21cut08:30:232
477599140,4cyclictest11050-21cstates11:00:152
477599140,4cyclictest10730-21sort09:10:002
477599140,3cyclictest27862-21cut11:55:232
477599140,3cyclictest25555-21cut07:25:182
477599140,3cyclictest10997-21kthreadcore09:40:332
477599140,12cyclictest30275-21needreboot12:35:242
477599140,12cyclictest27466-21cut07:55:202
477599140,12cyclictest25779-21tr08:25:142
477599140,12cyclictest23142-21cut08:20:202
477299144,6cyclictest0-21swapper/110:25:241
477299143,6cyclictest0-21swapper/111:48:031
477299141,9cyclictest0-21swapper/108:05:111
477299140,6cyclictest21964-21tr07:50:231
477299140,4cyclictest24097-21taskset07:24:151
477299140,2cyclictest1247-21taskset11:25:241
477299140,1cyclictest0-21swapper/111:30:171
477299140,1cyclictest0-21swapper/111:15:121
477299140,1cyclictest0-21swapper/109:35:141
476899144,8cyclictest0-21swapper/011:35:180
476899143,6cyclictest0-21swapper/010:21:000
476899143,6cyclictest0-21swapper/009:29:280
476899143,6cyclictest0-21swapper/007:20:210
4768991411,2cyclictest6647-21cron09:40:000
4768991410,3cyclictest8931-21kworker/u16:0+events_unbound08:25:250
4768991410,3cyclictest16334-21kworker/u16:3+events_unbound07:45:250
477599134,7cyclictest10614-21sed11:00:002
477599133,8cyclictest689-21snmpd11:09:022
477599130,7cyclictest1872-21apt-get11:30:182
477599130,6cyclictest26795-21apt-get08:55:122
477599130,5cyclictest1867-21grep09:35:212
477599130,3cyclictest717-21runrttasks10:06:142
477599130,3cyclictest30380-21tr10:10:162
477599130,3cyclictest29128-21cut11:20:202
477599130,3cyclictest21791-21kthreadcore07:20:162
477599130,3cyclictest20402-21cut09:55:182
477599130,3cyclictest17938-21cut07:45:202
477599130,3cyclictest15979-21cut12:20:222
477599130,2cyclictest717-21runrttasks11:47:022
477599130,2cyclictest717-21runrttasks10:45:302
476899135,5cyclictest0-21swapper/010:45:580
476899133,5cyclictest0-21swapper/008:50:070
476899132,8cyclictest0-21swapper/012:35:200
476899132,6cyclictest0-21swapper/010:10:200
476899130,4cyclictest16531-21cut10:30:200
476899130,11cyclictest0-21swapper/010:29:420
476899130,10cyclictest0-21swapper/008:10:160
477599122,8cyclictest689-21snmpd12:25:072
477599122,8cyclictest689-21snmpd11:27:112
477599122,8cyclictest689-21snmpd09:25:522
477599120,6cyclictest25663-21apt-get10:40:132
477599120,4cyclictest10973-21grep07:15:012
477599120,11cyclictest11061-21cut08:40:212
477299122,6cyclictest0-21swapper/111:06:101
477299121,6cyclictest0-21swapper/112:06:141
477299120,5cyclictest29826-21sh10:10:011
477299120,5cyclictest27403-21runrttasks09:26:531
476899125,5cyclictest0-21swapper/012:09:590
476899125,5cyclictest0-21swapper/009:18:280
477599110,3cyclictest12170-21latency_hist09:45:002
476899118,2cyclictest0-21swapper/011:50:000
476899117,3cyclictest2159-21tr11:30:200
476899114,5cyclictest0-21swapper/011:26:470
476899114,5cyclictest0-21swapper/010:05:110
476899114,5cyclictest0-21swapper/008:19:270
47689996,2cyclictest0-21swapper/009:45:330
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
19664270,2sleep30-21swapper/310:31:583
18936270,5sleep30-21swapper/307:20:093
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
8322260,3sleep30-21swapper/310:20:003
5300260,4sleep30-21swapper/307:10:033
29859260,5sleep30-21swapper/312:00:073
28176260,4sleep30-21swapper/309:30:023
26972260,5sleep30-21swapper/309:24:293
26791260,4sleep30-21swapper/308:55:113
26037260,4sleep30-21swapper/312:35:143
25659260,4sleep30-21swapper/310:40:123
24047260,2sleep30-21swapper/311:53:593
20939260,4sleep30-21swapper/308:50:143
19949260,5sleep30-21swapper/312:25:173
1868260,4sleep30-21swapper/311:30:173
14483260,4sleep30-21swapper/312:20:153
14404260,5sleep30-21swapper/310:29:383
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
7551250,3sleep30-21swapper/312:10:293
6400250,4sleep30-21swapper/309:36:593
4710250,4sleep30-21swapper/310:52:023
31248250,4sleep30-21swapper/310:46:533
27548250,4sleep30-21swapper/309:28:463
2738250,2sleep30-21swapper/307:35:003
25039250,4sleep30-21swapper/310:35:363
23671250,4sleep30-21swapper/309:59:333
21187250,4sleep30-21swapper/309:15:313
18667250,4sleep30-21swapper/311:49:573
1516250,4sleep30-21swapper/311:28:533
14017251,2sleep30-21swapper/311:40:193
12688250,4sleep30-21swapper/309:48:423
10278250,4sleep30-21swapper/309:05:493
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
9710240,2sleep30-21swapper/308:40:003
8669240,3sleep30-21swapper/308:07:343
8601240,2sleep30-21swapper/310:20:123
851240,3sleep30-21swapper/311:23:283
8231240,3sleep30-21swapper/307:39:373
8073240,2sleep30-21swapper/309:40:323
5295240,2sleep30-21swapper/310:55:153
31365240,2sleep30-21swapper/308:30:033
30337240,2sleep30-21swapper/308:00:013
29583240,3sleep30-21swapper/310:06:573
29256240,3sleep30-21swapper/311:55:433
28943240,2sleep30-21swapper/307:25:263
28772240,2sleep30-21swapper/308:25:223
2845240,2sleep30-21swapper/310:14:553
26289240,2sleep30-21swapper/307:55:203
23709240,2sleep30-21swapper/310:00:003
22666240,2sleep30-21swapper/311:15:033
21793240,3sleep30-21swapper/311:12:023
20834240,2sleep30-21swapper/307:50:233
19786240,2sleep30-21swapper/308:20:013
19414240,2sleep30-21swapper/307:49:553
18243240,2sleep30-21swapper/309:54:553
16416240,2sleep30-21swapper/308:45:223
16416240,2sleep30-21swapper/308:45:223
15930240,2sleep30-21swapper/311:05:003
15912240,3sleep30-21swapper/309:13:003
15004240,3sleep30-21swapper/308:15:163
14153240,3sleep30-21swapper/308:12:513
13877240,3sleep30-21swapper/312:15:503
12848240,2sleep30-21swapper/307:15:053
12523240,3sleep30-21swapper/311:39:353
8378230,2sleep30-21swapper/307:40:013
4424230,2sleep30-21swapper/308:35:093
2891230,2sleep30-21swapper/312:05:043
20560230,2sleep30-21swapper/312:30:023
10718230,2sleep30-21swapper/311:00:033
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional