You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-11-25 - 14:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot5s.osadl.org (updated Mon Nov 25, 2024 00:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
838335995953,4cyclictest843721-21kworker/u8:0+events_unbound19:55:431
838343995650,4cyclictest916522-21kworker/u8:3+events_unbound23:11:103
838335995344,5cyclictest847386-21debian-sa119:35:001
838343995245,5cyclictest843721-21kworker/u8:0+events_unbound20:30:463
838343995245,5cyclictest843721-21kworker/u8:0+events_unbound20:30:463
838333995042,5cyclictest946352-21munin-plugin-st00:25:000
838343994936,10cyclictest391ktimers/320:15:143
838340994836,8cyclictest863042-21apt-config20:20:012
838333994836,8cyclictest916660-21sh22:55:010
838333994737,7cyclictest885088-21grep21:20:260
838343994638,6cyclictest850735-21kworker/u8:2+events_unbound19:45:403
838343994636,6cyclictest891907-21unixbench_multi21:40:243
838343994537,6cyclictest904460-21kworker/u8:3+events_unbound22:36:023
838333994538,4cyclictest849096-21apt19:40:000
838343994337,4cyclictest859199-21kworker/u8:1+events_unbound20:10:443
838343994337,4cyclictest843721-21kworker/u8:0+events_unbound19:25:373
838333994336,4cyclictest838325-21cyclictest22:16:000
838343994236,4cyclictest934342-21kworker/u8:2+events_unbound00:33:513
838343994236,4cyclictest928519-21kworker/u8:2+events_unbound23:41:123
838343994229,5cyclictest883510-21kworker/u8:3+events_unbound21:20:553
838335994234,4cyclictest0-21swapper/122:35:001
838343994135,4cyclictest934342-21kworker/u8:2+events_unbound00:38:553
838343994134,5cyclictest911074-21kworker/u8:2+events_unbound22:51:103
838343994119,10cyclictest131rcu_preempt21:03:433
838333994131,7cyclictest845687-21apt19:30:000
838343994025,11cyclictest391ktimers/322:15:113
838343994022,14cyclictest40-21ksoftirqd/320:25:123
838333994033,4cyclictest856126-21munin-run20:00:010
838333994030,6cyclictest864405-21unixbench_multi20:20:260
838343993931,4cyclictest0-21swapper/320:40:013
838343993928,8cyclictest880419-21cron21:10:013
838335993931,5cyclictest877012-21munin-plugin-st21:00:011
838335993930,6cyclictest215-21dbus-daemon00:24:181
838333993928,6cyclictest879958-21grep21:05:260
838343993832,4cyclictest880393-21kworker/u8:1+events_unbound21:25:543
838343993832,4cyclictest880393-21kworker/u8:1+events_unbound21:25:543
838343993826,9cyclictest391ktimers/323:35:123
838343993825,5cyclictest131rcu_preempt19:35:183
838343993820,5cyclictest131rcu_preempt20:56:503
838340993831,4cyclictest880436-21sh21:10:002
838340993822,11cyclictest311ktimers/221:35:122
838335993831,3cyclictest0-21swapper/123:55:001
838343993727,6cyclictest0-21swapper/323:50:233
838343993719,4cyclictest131rcu_preempt22:43:543
838343993718,15cyclictest391ktimers/321:39:513
838340993730,5cyclictest897415-21kworker/u8:0+events_unbound22:26:022
838335993713,12cyclictest131rcu_preempt22:05:271
838333993730,4cyclictest892385-21munin-plugin-st21:45:000
838333993728,5cyclictest0-21swapper/020:30:140
838333993728,5cyclictest0-21swapper/020:30:140
83834399362,16cyclictest391ktimers/320:45:153
838343993621,4cyclictest131rcu_preempt22:32:133
838343993620,5cyclictest131rcu_preempt23:08:413
838343993617,4cyclictest53-21kcompactd022:02:373
838340993628,4cyclictest0-21swapper/221:55:012
838333993626,7cyclictest886796-21grep21:25:250
838333993626,7cyclictest886796-21grep21:25:250
838333993624,7cyclictest883359-21grep21:15:240
838343993525,6cyclictest0-21swapper/322:05:273
838343993525,6cyclictest0-21swapper/300:10:003
838343993521,4cyclictest131rcu_preempt23:26:513
838343993521,4cyclictest131rcu_preempt23:26:513
838343993519,5cyclictest131rcu_preempt21:46:453
838343993518,10cyclictest131rcu_preempt00:25:523
838343993516,5cyclictest131rcu_preempt20:09:033
838343993515,4cyclictest131rcu_preempt21:50:293
838343993513,11cyclictest0-21swapper/319:11:543
838335993527,4cyclictest897471-21sh22:00:011
838343993425,5cyclictest0-21swapper/322:15:003
838343993423,8cyclictest881657-21grep21:10:273
838343993420,5cyclictest131rcu_preempt21:55:493
838343993415,12cyclictest843721-21kworker/u8:0-events_power_efficient20:24:503
838343993413,11cyclictest131rcu_preempt19:43:533
838343993410,16cyclictest40-21ksoftirqd/322:25:253
838340993428,4cyclictest870216-21kworker/u8:3+events_unbound20:50:502
838340993427,4cyclictest0-21swapper/220:00:162
838340993424,6cyclictest0-21swapper/200:25:242
838335993423,7cyclictest0-21swapper/122:40:001
83833399344,6cyclictest11-21ksoftirqd/021:05:010
838333993427,4cyclictest902340-21tail22:10:300
838333993427,4cyclictest899207-21munin-plugin-st22:05:010
838333993410,8cyclictest873938-21seq20:50:130
83834399338,14cyclictest40-21ksoftirqd/300:15:243
838343993325,4cyclictest0-21swapper/323:20:003
838343993317,5cyclictest131rcu_preempt19:55:233
838343993315,10cyclictest131rcu_preempt22:46:193
838343993313,4cyclictest0-21swapper/320:04:173
838340993326,4cyclictest0-21swapper/220:30:002
838340993324,6cyclictest0-21swapper/221:05:002
838340993324,5cyclictest868275-21auditctl20:35:002
838340993324,5cyclictest868275-21auditctl20:35:002
838340993318,11cyclictest311ktimers/223:00:142
838333993327,3cyclictest0-21swapper/019:35:000
838333993326,4cyclictest0-21swapper/021:15:000
838333993323,7cyclictest911328-21sh22:40:000
83834399329,16cyclictest40-21ksoftirqd/321:15:193
83834399329,15cyclictest40-21ksoftirqd/319:30:253
83834399327,16cyclictest40-21ksoftirqd/323:50:013
838343993219,5cyclictest131rcu_preempt20:40:403
838343993216,5cyclictest131rcu_preempt20:50:243
838343993214,4cyclictest0-21swapper/322:59:293
838343993211,10cyclictest0-21swapper/319:16:283
838343993210,14cyclictest40-21ksoftirqd/323:35:003
838343993210,14cyclictest40-21ksoftirqd/300:20:253
838340993224,4cyclictest0-21swapper/200:00:152
838340993221,7cyclictest933735-21idleruntime-cro23:45:002
83834099321,5cyclictest131rcu_preempt20:35:142
83834099321,5cyclictest131rcu_preempt19:50:162
838335993210,4cyclictest131rcu_preempt23:30:161
83833399328,7cyclictest11-21ksoftirqd/023:45:010
838333993225,3cyclictest0-21swapper/022:55:260
838333993222,7cyclictest859541-21auditctl20:10:010
83834399319,14cyclictest40-21ksoftirqd/323:55:233
838343993120,4cyclictest131rcu_preempt22:20:163
838343993112,9cyclictest131rcu_preempt19:20:253
838343993111,6cyclictest925030-21kworker/u8:2+events_unbound23:20:463
838340993123,4cyclictest0-21swapper/219:55:272
838340993123,4cyclictest0-21swapper/219:25:252
838340993118,11cyclictest838325-21cyclictest21:20:122
838335993124,4cyclictest944635-21idleruntime-cro00:20:001
838335993123,6cyclictest928519-21kworker/u8:2+events_unbound23:36:121
838335993123,4cyclictest0-21swapper/121:45:261
83833399317,6cyclictest11-21ksoftirqd/020:15:200
83833399316,6cyclictest0-21swapper/020:40:160
838333993121,6cyclictest929884-21grep23:30:290
838333993121,6cyclictest841861-21grep19:15:260
83834399309,14cyclictest40-21ksoftirqd/300:10:223
83834399309,11cyclictest40-21ksoftirqd/321:30:243
83834399309,11cyclictest40-21ksoftirqd/321:30:233
83834399308,12cyclictest40-21ksoftirqd/319:50:313
838343993017,4cyclictest131rcu_preempt23:00:193
838340993024,4cyclictest934342-21kworker/u8:2+events_unbound00:24:182
838340993022,5cyclictest0-21swapper/222:40:002
838340993022,5cyclictest0-21swapper/200:10:162
838340993020,7cyclictest0-21swapper/223:55:012
838335993023,3cyclictest0-21swapper/122:15:251
838335993022,4cyclictest0-21swapper/121:05:161
838335993022,4cyclictest0-21swapper/119:15:171
838335993015,7cyclictest24-21ksoftirqd/120:35:231
83833399307,6cyclictest11-21ksoftirqd/023:25:020
83833399307,5cyclictest11-21ksoftirqd/022:10:000
83833399306,7cyclictest11-21ksoftirqd/023:00:200
83833399304,7cyclictest0-21swapper/022:40:140
838333993019,7cyclictest0-21swapper/000:35:000
838333993015,10cyclictest852704-21apt-key19:50:010
838333993014,5cyclictest131rcu_preempt23:46:200
838333993012,4cyclictest131rcu_preempt22:31:010
83833399301,20cyclictest0-21swapper/020:25:240
83834099297,12cyclictest131rcu_preempt19:20:362
838340992923,4cyclictest843721-21kworker/u8:0+events_unbound19:35:392
838340992922,4cyclictest875676-21fschecks_count20:55:152
838340992922,4cyclictest0-21swapper/223:25:272
838340992922,4cyclictest0-21swapper/223:25:262
838340992922,3cyclictest0-21swapper/200:35:272
83833599293,3cyclictest131rcu_preempt00:25:111
838335992923,3cyclictest937772-21kthreadd00:00:001
838335992921,4cyclictest0-21swapper/123:20:001
838335992921,4cyclictest0-21swapper/119:30:001
838335992919,6cyclictest0-21swapper/119:15:021
83833599291,5cyclictest0-21swapper/119:35:121
83833399299,5cyclictest946658-21awk00:25:120
83833399298,6cyclictest0-21swapper/023:35:220
83833399297,7cyclictest11-21ksoftirqd/000:14:250
83833399296,6cyclictest11-21ksoftirqd/000:00:010
83833399296,6cyclictest0-21swapper/021:55:150
83833399296,5cyclictest151rcuc/021:35:170
83833399296,11cyclictest11-21ksoftirqd/000:02:360
83833399293,8cyclictest11-21ksoftirqd/022:45:210
838333992922,4cyclictest0-21swapper/021:30:280
838333992922,4cyclictest0-21swapper/021:30:280
838333992919,7cyclictest121ktimers/000:15:110
83834099286,5cyclictest440-21cron23:10:002
838340992822,4cyclictest913060-21kworker/u8:0+events_unbound22:56:142
838340992821,5cyclictest897003-21unixbench_multi21:55:262
838340992821,4cyclictest0-21swapper/221:15:252
838340992819,6cyclictest840530-21fschecks_count19:15:042
838340992819,6cyclictest0-21swapper/222:10:202
838340992817,7cyclictest0-21swapper/221:45:252
838335992823,3cyclictest851903-21timerandwakeup19:45:251
838335992822,4cyclictest864731-21kworker/u8:2+events_unbound20:25:411
838335992822,4cyclictest857467-21kworker/u8:2+events_unbound20:00:441
838335992820,4cyclictest0-21swapper/122:21:011
838335992820,4cyclictest0-21swapper/121:50:291
838335992817,7cyclictest0-21swapper/120:50:011
83833599281,6cyclictest916658-21cron22:55:001
838335992814,6cyclictest916522-21kworker/u8:3+events_unbound23:10:241
83833399285,7cyclictest11-21ksoftirqd/021:45:180
83833399285,6cyclictest838325-21cyclictest19:50:240
83833399284,8cyclictest11-21ksoftirqd/020:00:250
83833399284,7cyclictest11-21ksoftirqd/020:55:240
83833399284,7cyclictest0-21swapper/019:10:230
83833399284,5cyclictest11-21ksoftirqd/021:50:280
83833399284,5cyclictest11-21ksoftirqd/019:40:270
838333992822,4cyclictest13650irq/42-30be0000.ethernet19:22:000
838333992821,3cyclictest0-21swapper/000:38:540
838333992820,3cyclictest0-21swapper/020:35:180
838340992720,4cyclictest0-21swapper/223:15:242
838340992720,4cyclictest0-21swapper/219:40:272
83833599278,7cyclictest131rcu_preempt23:05:161
838335992721,4cyclictest868234-21kworker/u8:2+events_unbound20:40:481
838335992721,3cyclictest861242-21kthreadd20:15:011
838335992719,4cyclictest0-21swapper/121:30:001
838335992719,4cyclictest0-21swapper/121:30:001
838335992718,4cyclictest0-21swapper/119:45:001
838335992714,7cyclictest24-21ksoftirqd/121:35:001
838335992714,7cyclictest24-21ksoftirqd/121:35:001
838335992713,7cyclictest24-21ksoftirqd/120:20:241
838335992710,11cyclictest24-21ksoftirqd/122:55:211
83833399277,6cyclictest11-21ksoftirqd/023:30:000
83833399277,6cyclictest11-21ksoftirqd/023:30:000
83833399274,7cyclictest11-21ksoftirqd/022:25:130
83833399273,6cyclictest11-21ksoftirqd/022:25:010
838333992721,3cyclictest0-21swapper/000:05:240
838333992720,3cyclictest0-21swapper/023:10:200
83833399271,7cyclictest11-21ksoftirqd/023:50:140
83833399271,21cyclictest873629-21latency_hist20:50:010
838340992620,3cyclictest0-21swapper/200:00:002
838340992619,5cyclictest944619-21sendmail00:20:002
838340992618,6cyclictest857467-21kworker/u8:2+events_unbound20:12:522
838340992618,5cyclictest0-21swapper/220:05:252
838340992618,4cyclictest881677-21unixbench_multi21:10:272
838340992617,6cyclictest948432-21fschecks_count00:30:192
838340992617,5cyclictest0-21swapper/219:10:172
838340992616,7cyclictest913215-21seq22:44:342
838340992614,4cyclictest131rcu_preempt23:13:042
83833599262,7cyclictest0-21swapper/122:10:161
838335992620,4cyclictest934342-21kworker/u8:2+events_unbound00:33:041
838335992619,4cyclictest862951-21munin-run20:20:011
838335992612,7cyclictest24-21ksoftirqd/123:25:001
838335992611,7cyclictest24-21ksoftirqd/100:05:221
838335992610,3cyclictest131rcu_preempt21:40:201
83833399261,7cyclictest11-21ksoftirqd/023:15:210
838340992519,4cyclictest932012-21latency_hist23:40:002
838340992518,5cyclictest930238-21kworker/u8:0+events_unbound23:49:432
838340992517,4cyclictest0-21swapper/219:30:222
838340992515,7cyclictest871346-21seq20:40:522
838340992514,7cyclictest940768-21grep00:05:242
83833599258,5cyclictest878348-21kworker/u8:2+events_unbound21:12:381
838335992519,3cyclictest0-21swapper/121:35:221
838335992517,4cyclictest0-21swapper/123:25:261
838335992517,4cyclictest0-21swapper/123:25:261
83833599251,6cyclictest874873-21grep20:50:261
838335992516,6cyclictest884220-21fschecks_count21:20:161
838335992515,8cyclictest899328-21latency_hist22:05:011
838335992513,3cyclictest24-21ksoftirqd/119:20:211
83833599251,12cyclictest0-21swapper/123:02:001
83833399253,7cyclictest0-21swapper/020:10:210
83834099242,3cyclictest131rcu_preempt22:30:202
838340992418,3cyclictest0-21swapper/222:00:202
838340992418,3cyclictest0-21swapper/219:45:172
838340992417,4cyclictest0-21swapper/223:25:002
838340992416,5cyclictest0-21swapper/221:30:002
838340992416,5cyclictest0-21swapper/221:30:002
838340992414,7cyclictest899638-21apt-get22:05:142
83833599247,7cyclictest131rcu_preempt21:15:251
838335992418,3cyclictest0-21swapper/100:35:151
838335992416,5cyclictest0-21swapper/119:50:221
838335992413,6cyclictest0-21swapper/120:35:011
838335992413,6cyclictest0-21swapper/120:35:001
838340992317,3cyclictest0-21swapper/222:45:192
838340992314,7cyclictest891316-21sed21:40:172
83833599235,8cyclictest131rcu_preempt23:40:121
83833599232,3cyclictest131rcu_preempt21:05:011
83833599231,5cyclictest9384082cat00:00:191
83833599231,12cyclictest0-21swapper/122:47:151
83834099226,7cyclictest131rcu_preempt22:20:012
838340992214,5cyclictest0-21swapper/220:50:012
838340992213,6cyclictest905208-21memory22:20:192
83834099221,14cyclictest0-21swapper/220:20:112
83834099221,13cyclictest0-21swapper/221:33:022
83834099221,13cyclictest0-21swapper/221:33:022
83834099220,12cyclictest0-21swapper/222:54:172
83833599227,7cyclictest131rcu_preempt22:25:201
83833599223,7cyclictest131rcu_preempt00:11:041
83833599221,7cyclictest859547-21grep20:10:011
838335992214,6cyclictest231ktimers/122:40:051
838335992116,3cyclictest930238-21kworker/u8:0+events_unbound23:45:081
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional