You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-11-22 - 02:51
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rackdslot1.osadl.org (updated Thu Nov 21, 2024 12:46:29)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1166911790,15ptp4l0-21swapper/007:09:120
1219921730,8sleep31581299cyclictest10:30:293
1166911730,14ptp4l0-21swapper/207:08:082
1166911570,15ptp4l0-21swapper/107:06:581
1166911450,14ptp4l0-21swapper/307:05:503
189572890,25sleep218961-21irqrtprio07:15:192
15809997969,6cyclictest9-21ksoftirqd/010:40:130
15810997823,10cyclictest25-21ksoftirqd/111:55:281
15810997724,9cyclictest25-21ksoftirqd/111:35:161
15809997765,6cyclictest9-21ksoftirqd/012:05:110
15809997664,6cyclictest9-21ksoftirqd/007:45:110
15810997543,4cyclictest25-21ksoftirqd/110:15:351
15809997565,5cyclictest9-21ksoftirqd/011:50:200
15809997565,5cyclictest9-21ksoftirqd/008:20:160
15809997563,7cyclictest9-21ksoftirqd/010:00:110
15810997434,11cyclictest25-21ksoftirqd/112:20:251
15810997422,9cyclictest25-21ksoftirqd/107:20:201
15810997235,10cyclictest25-21ksoftirqd/110:40:261
160412710,7sleep21581199cyclictest11:50:242
15810997120,9cyclictest25-21ksoftirqd/110:55:251
15810997035,10cyclictest25-21ksoftirqd/109:40:201
15810997032,10cyclictest25-21ksoftirqd/112:35:251
15810997021,9cyclictest25-21ksoftirqd/110:50:171
15810997021,9cyclictest25-21ksoftirqd/110:50:171
15809997029,4cyclictest9-21ksoftirqd/012:15:330
15809997028,4cyclictest9-21ksoftirqd/009:05:320
15810996932,10cyclictest25-21ksoftirqd/108:00:221
15810996931,10cyclictest25-21ksoftirqd/109:35:181
15810996929,9cyclictest25-21ksoftirqd/108:10:011
15809996927,5cyclictest9-21ksoftirqd/009:15:170
15809996927,5cyclictest9-21ksoftirqd/009:15:170
15809996926,8cyclictest9-21ksoftirqd/007:25:000
116691690,2ptp4l0-21swapper/009:55:180
15810996829,8cyclictest25-21ksoftirqd/109:11:381
15810996826,5cyclictest25-21ksoftirqd/111:33:321
15809996859,5cyclictest9-21ksoftirqd/008:15:130
15809996856,6cyclictest9-21ksoftirqd/011:30:120
15810996761,3cyclictest25-21ksoftirqd/112:00:041
15810996739,4cyclictest25-21ksoftirqd/108:50:271
15810996736,10cyclictest25-21ksoftirqd/108:45:231
15810996729,10cyclictest25-21ksoftirqd/111:20:151
1581099667,3cyclictest25-21ksoftirqd/108:35:211
1581099665,9cyclictest25-21ksoftirqd/110:00:011
15810996655,5cyclictest25-21ksoftirqd/109:00:131
15810996614,10cyclictest25-21ksoftirqd/112:10:241
15809996656,5cyclictest9-21ksoftirqd/007:30:110
116691660,2ptp4l0-21swapper/208:19:522
15810996549,4cyclictest25-21ksoftirqd/110:00:141
15810996529,10cyclictest25-21ksoftirqd/111:15:001
1581099646,9cyclictest25-21ksoftirqd/108:00:001
15810996446,5cyclictest25-21ksoftirqd/107:50:241
15810996446,5cyclictest25-21ksoftirqd/107:50:231
15810996429,10cyclictest25-21ksoftirqd/111:00:191
1581299632,4cyclictest41-21ksoftirqd/307:10:133
15810996346,4cyclictest25-21ksoftirqd/109:15:241
15810996346,4cyclictest25-21ksoftirqd/109:15:231
15810996323,7cyclictest25-21ksoftirqd/109:48:271
116691630,2ptp4l0-21swapper/012:34:380
15810996226,10cyclictest25-21ksoftirqd/112:25:291
15810996226,10cyclictest25-21ksoftirqd/112:25:291
1581099621,6cyclictest116691ptp4l07:20:001
1581099621,4cyclictest121rcu_preempt07:45:261
202442610,2sleep00-21swapper/010:50:130
202442610,2sleep00-21swapper/010:50:130
179392610,2sleep00-21swapper/009:35:190
1581099617,9cyclictest25-21ksoftirqd/108:10:211
15810996150,3cyclictest25-21ksoftirqd/112:15:251
15810996148,3cyclictest25-21ksoftirqd/110:45:141
15810996129,9cyclictest25-21ksoftirqd/112:35:011
15810996122,10cyclictest25-21ksoftirqd/108:55:201
1580999618,5cyclictest9-21ksoftirqd/009:50:010
116691610,2ptp4l0-21swapper/111:50:281
1581299604,4cyclictest121rcu_preempt08:40:203
1581099607,4cyclictest25-21ksoftirqd/110:10:151
15810996054,3cyclictest25-21ksoftirqd/111:30:001
15810996054,3cyclictest25-21ksoftirqd/109:20:051
15810996054,3cyclictest25-21ksoftirqd/109:20:041
1581099604,9cyclictest25-21ksoftirqd/111:15:311
15810996048,3cyclictest25-21ksoftirqd/107:25:201
15810996046,4cyclictest25-21ksoftirqd/108:20:301
15810996046,4cyclictest25-21ksoftirqd/108:15:281
1581099604,4cyclictest25-21ksoftirqd/111:40:211
15810996040,8cyclictest25-21ksoftirqd/107:40:011
1581099603,9cyclictest25-21ksoftirqd/112:05:161
1581099602,5cyclictest25-21ksoftirqd/108:30:301
1581099597,8cyclictest25-21ksoftirqd/110:25:221
1581099595,3cyclictest25-21ksoftirqd/109:30:111
1581099594,9cyclictest25-21ksoftirqd/108:40:221
1580999596,4cyclictest9-21ksoftirqd/008:45:230
15809995948,3cyclictest9-21ksoftirqd/012:10:230
15809995945,4cyclictest9-21ksoftirqd/009:50:230
116691590,2ptp4l0-21swapper/309:54:233
1581099587,9cyclictest25-21ksoftirqd/107:30:201
1581099586,8cyclictest25-21ksoftirqd/111:05:181
15810995852,3cyclictest25-21ksoftirqd/108:25:231
15810995851,4cyclictest25-21ksoftirqd/109:50:341
1581099583,8cyclictest25-21ksoftirqd/110:35:151
1581099580,7cyclictest25-21ksoftirqd/110:20:201
1581099580,3cyclictest121rcu_preempt07:10:191
15809995847,6cyclictest9-21ksoftirqd/010:30:120
15809995840,5cyclictest9-21ksoftirqd/011:20:150
15809995816,5cyclictest9-21ksoftirqd/007:15:250
1581099575,9cyclictest25-21ksoftirqd/111:45:311
15810995751,3cyclictest25-21ksoftirqd/110:30:141
1581099572,8cyclictest25-21ksoftirqd/110:05:191
1581099572,7cyclictest25-21ksoftirqd/109:05:131
1581099570,3cyclictest121rcu_preempt07:45:001
15809995745,3cyclictest9-21ksoftirqd/010:45:270
15809995744,3cyclictest9-21ksoftirqd/012:25:210
15809995744,3cyclictest9-21ksoftirqd/012:25:210
15809995744,3cyclictest9-21ksoftirqd/011:20:000
15809995741,4cyclictest9-21ksoftirqd/009:40:210
15809995740,7cyclictest9-21ksoftirqd/008:35:200
15810995650,3cyclictest25-21ksoftirqd/109:30:001
15809995646,6cyclictest9-21ksoftirqd/007:50:110
15809995646,6cyclictest9-21ksoftirqd/007:50:110
15809995646,5cyclictest9-21ksoftirqd/008:40:120
15809995645,3cyclictest9-21ksoftirqd/010:15:350
15809995644,3cyclictest9-21ksoftirqd/012:00:260
15809995644,3cyclictest9-21ksoftirqd/010:20:190
15809995643,4cyclictest9-21ksoftirqd/007:25:320
15809995643,3cyclictest9-21ksoftirqd/010:35:140
15809995637,4cyclictest9-21ksoftirqd/011:40:310
15809995637,4cyclictest9-21ksoftirqd/010:10:170
116691560,2ptp4l0-21swapper/308:00:243
15812995549,3cyclictest41-21ksoftirqd/311:35:003
1581299550,6cyclictest0-21swapper/308:15:193
15809995549,4cyclictest9-21ksoftirqd/007:40:170
15809995549,3cyclictest9-21ksoftirqd/009:00:230
1580999554,3cyclictest121rcu_preempt10:10:000
15809995542,4cyclictest9-21ksoftirqd/009:10:120
15809995541,4cyclictest9-21ksoftirqd/007:10:280
15809995538,4cyclictest9-21ksoftirqd/008:10:210
116691550,3ptp4l2693-21irqrtprio12:30:253
15809995448,4cyclictest9-21ksoftirqd/008:00:000
15809995448,3cyclictest9-21ksoftirqd/011:05:220
1580999540,6cyclictest121rcu_preempt07:35:300
1580999540,3cyclictest121rcu_preempt11:55:140
116691540,5ptp4l13274-21cstates10:35:122
116691540,1ptp4l0-21swapper/009:30:290
15812995346,4cyclictest41-21ksoftirqd/311:00:003
15811995346,4cyclictest33-21ksoftirqd/207:30:002
15809995347,3cyclictest9-21ksoftirqd/008:30:010
15809995347,3cyclictest9-21ksoftirqd/008:05:180
15809995346,4cyclictest9-21ksoftirqd/011:25:200
15809995340,3cyclictest9-21ksoftirqd/011:35:180
15809995338,4cyclictest9-21ksoftirqd/012:20:200
15809995336,5cyclictest9-21ksoftirqd/009:20:250
15809995336,5cyclictest9-21ksoftirqd/009:20:240
15809995336,4cyclictest9-21ksoftirqd/010:25:210
1580999533,4cyclictest121rcu_preempt10:55:180
116691530,2ptp4l0-21swapper/210:40:292
116691530,1ptp4l0-21swapper/310:45:233
15812995245,4cyclictest41-21ksoftirqd/311:59:593
15811995247,3cyclictest33-21ksoftirqd/211:20:012
15811995245,4cyclictest11158-21grep10:30:162
15809995247,3cyclictest9-21ksoftirqd/012:35:150
15809995246,3cyclictest9-21ksoftirqd/011:45:320
15809995245,4cyclictest9-21ksoftirqd/011:00:310
15809995240,4cyclictest9-21ksoftirqd/011:15:010
116691520,2ptp4l0-21swapper/208:33:252
15812995145,3cyclictest41-21ksoftirqd/309:10:123
15812995143,4cyclictest41-21ksoftirqd/311:10:203
15811995117,7cyclictest33-21ksoftirqd/211:55:262
15811995113,10cyclictest33-21ksoftirqd/212:10:152
15809995146,3cyclictest9-21ksoftirqd/008:50:310
15809995146,3cyclictest9-21ksoftirqd/008:00:170
1580999510,3cyclictest121rcu_preempt08:55:180
116691510,2ptp4l0-21swapper/311:39:243
15812995045,3cyclictest41-21ksoftirqd/307:40:213
15812995044,4cyclictest41-21ksoftirqd/310:45:003
15812995044,4cyclictest41-21ksoftirqd/310:40:003
15812995041,5cyclictest41-21ksoftirqd/308:30:123
116691500,1ptp4l0-21swapper/310:54:053
116691500,1ptp4l0-21swapper/310:54:053
116691500,1ptp4l0-21swapper/309:08:053
15812994942,4cyclictest41-21ksoftirqd/307:20:003
15811994942,4cyclictest33-21ksoftirqd/212:20:002
15809994943,3cyclictest9-21ksoftirqd/008:30:140
116691490,2ptp4l0-21swapper/210:45:592
116691490,1ptp4l0-21swapper/209:00:472
15812994843,3cyclictest41-21ksoftirqd/310:30:003
15812994841,4cyclictest41-21ksoftirqd/312:30:003
15812994841,4cyclictest41-21ksoftirqd/312:30:003
15812994841,3cyclictest41-21ksoftirqd/309:45:213
15812994834,4cyclictest41-21ksoftirqd/309:30:253
15811994842,4cyclictest33-21ksoftirqd/211:00:202
15811994841,5cyclictest33-21ksoftirqd/208:40:002
15811994841,4cyclictest33-21ksoftirqd/207:39:592
1581199481,4cyclictest121rcu_preempt11:05:152
116691480,1ptp4l0-21swapper/311:07:373
15812994741,4cyclictest41-21ksoftirqd/307:40:003
15812994740,3cyclictest41-21ksoftirqd/308:40:003
15811994741,4cyclictest33-21ksoftirqd/212:30:002
15811994741,4cyclictest33-21ksoftirqd/212:30:002
15811994725,5cyclictest33-21ksoftirqd/208:50:202
116691470,8ptp4l0-21swapper/212:08:232
116691470,2ptp4l0-21swapper/211:11:342
116691470,15ptp4l41-21ksoftirqd/309:20:053
116691470,15ptp4l41-21ksoftirqd/309:20:043
15812994641,3cyclictest41-21ksoftirqd/307:45:193
15812994640,4cyclictest41-21ksoftirqd/312:05:193
15812994640,4cyclictest41-21ksoftirqd/311:15:143
15812994639,3cyclictest41-21ksoftirqd/307:30:003
15812994629,4cyclictest41-21ksoftirqd/311:00:273
15811994640,4cyclictest33-21ksoftirqd/208:55:152
15811994640,4cyclictest33-21ksoftirqd/207:14:592
15811994639,4cyclictest33-21ksoftirqd/209:20:132
15811994639,4cyclictest33-21ksoftirqd/209:20:132
15809994641,3cyclictest9-21ksoftirqd/009:30:000
116691460,8ptp4l0-21swapper/210:07:382
116691460,7ptp4l0-21swapper/210:20:102
116691460,4ptp4l14991-21apt-get09:30:092
116691460,1ptp4l0-21swapper/311:42:223
116691460,11ptp4l24150-21taskset10:57:172
15812994539,3cyclictest41-21ksoftirqd/308:55:003
15812994539,3cyclictest10745-21grep08:05:333
15812994538,4cyclictest41-21ksoftirqd/310:10:003
15812994528,5cyclictest41-21ksoftirqd/312:35:183
15811994540,3cyclictest33-21ksoftirqd/210:25:272
116691450,8ptp4l0-21swapper/210:01:152
116691450,8ptp4l0-21swapper/209:52:412
116691450,8ptp4l0-21swapper/207:34:292
116691450,7ptp4l0-21swapper/211:34:012
116691450,7ptp4l0-21swapper/210:13:142
116691450,7ptp4l0-21swapper/207:41:292
116691450,2ptp4l0-21swapper/209:38:252
15812994439,3cyclictest41-21ksoftirqd/307:50:283
15812994439,3cyclictest41-21ksoftirqd/307:50:283
15812994438,4cyclictest41-21ksoftirqd/312:10:353
15812994437,4cyclictest41-21ksoftirqd/308:25:133
15812994437,4cyclictest41-21ksoftirqd/307:55:123
1581299443,4cyclictest121rcu_preempt10:15:193
1581299440,4cyclictest121rcu_preempt09:55:343
15811994439,3cyclictest33-21ksoftirqd/209:40:182
15811994438,3cyclictest33-21ksoftirqd/208:45:202
116691440,8ptp4l0-21swapper/207:58:202
116691440,7ptp4l0-21swapper/212:36:592
116691440,7ptp4l0-21swapper/209:29:452
116691440,7ptp4l0-21swapper/207:46:112
116691440,1ptp4l0-21swapper/212:02:572
1581299434,4cyclictest121rcu_preempt11:45:263
15812994338,3cyclictest41-21ksoftirqd/311:25:273
15812994338,3cyclictest41-21ksoftirqd/310:20:213
15812994338,3cyclictest41-21ksoftirqd/308:50:003
15812994337,4cyclictest41-21ksoftirqd/311:25:003
15812994336,4cyclictest41-21ksoftirqd/308:20:173
1581299430,7cyclictest2333-21/usr/sbin/munin10:10:223
15811994338,3cyclictest33-21ksoftirqd/208:40:152
15811994338,3cyclictest33-21ksoftirqd/208:05:222
15811994336,4cyclictest33-21ksoftirqd/209:12:472
116691430,7ptp4l0-21swapper/209:49:162
116691430,4ptp4l33-21ksoftirqd/210:54:352
116691430,4ptp4l33-21ksoftirqd/210:54:352
116691430,10ptp4l0-21swapper/211:37:292
15812994237,3cyclictest41-21ksoftirqd/310:05:013
15812994236,4cyclictest41-21ksoftirqd/309:15:233
15812994236,4cyclictest41-21ksoftirqd/309:15:223
15812994235,4cyclictest41-21ksoftirqd/312:20:003
15812994235,4cyclictest41-21ksoftirqd/308:55:183
15812994235,4cyclictest41-21ksoftirqd/307:30:123
15812994227,4cyclictest41-21ksoftirqd/312:20:223
1581299421,5cyclictest0-21swapper/312:00:283
15811994237,3cyclictest33-21ksoftirqd/212:20:292
15811994236,4cyclictest33-21ksoftirqd/207:20:132
116691420,6ptp4l17152-21/usr/sbin/munin08:20:272
116691420,4ptp4l41-21ksoftirqd/307:23:423
15812994135,4cyclictest41-21ksoftirqd/309:35:233
15812994135,4cyclictest41-21ksoftirqd/309:29:313
15812994135,3cyclictest41-21ksoftirqd/309:00:133
15812994135,3cyclictest41-21ksoftirqd/308:13:543
15811994136,3cyclictest33-21ksoftirqd/207:50:202
15811994136,3cyclictest33-21ksoftirqd/207:50:202
15811994135,3cyclictest33-21ksoftirqd/211:45:182
116691410,2ptp4l0-21swapper/212:31:362
116691410,2ptp4l0-21swapper/210:16:242
116691410,2ptp4l0-21swapper/209:16:192
116691410,2ptp4l0-21swapper/209:16:182
116691410,2ptp4l0-21swapper/209:08:202
15811994035,3cyclictest33-21ksoftirqd/208:25:112
15811994034,4cyclictest33-21ksoftirqd/211:20:202
116691400,2ptp4l0-21swapper/211:43:052
116691400,2ptp4l0-21swapper/209:55:422
116691400,2ptp4l0-21swapper/208:00:172
15812993933,4cyclictest41-21ksoftirqd/309:40:103
116691390,2ptp4l0-21swapper/211:26:082
116691390,2ptp4l0-21swapper/208:11:132
116691380,2ptp4l0-21swapper/311:50:573
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional