You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-01-15 - 07:57
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack7slot0.osadl.org (updated Wed Jan 15, 2025 00:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
110050660,0irq/25-eth00-21swapper/319:05:133
117950580,0irq/26-eth1-rx-0-21swapper/119:07:131
110050560,0irq/25-eth00-21swapper/219:09:542
927724320,0sleep00-21swapper/019:05:470
9681991917,0cyclictest27399-21sshd23:02:521
968099190,0cyclictest28024-21rm21:43:450
968299180,0cyclictest30876-21sshd23:20:182
271180,0ktimersoftd/22821-21sshd00:18:512
968399160,0cyclictest0-21swapper/321:26:113
9683991514,0cyclictest0-21swapper/321:12:083
9683991514,0cyclictest0-21swapper/300:20:043
9683991512,0cyclictest0-21swapper/323:09:213
9683991512,0cyclictest0-21swapper/322:18:483
9683991512,0cyclictest0-21swapper/321:36:593
968399151,0cyclictest0-21swapper/323:56:023
9683991413,0cyclictest1716-21diskmemload22:57:443
9683991411,0cyclictest0-21swapper/322:24:173
9682991413,0cyclictest0-21swapper/221:29:032
968299140,0cyclictest1264-21bash21:44:232
968299140,0cyclictest0-21swapper/200:10:392
9681991413,0cyclictest1555-21fschecks_time21:20:121
9681991413,0cyclictest0-21swapper/122:28:511
9681991413,0cyclictest0-21swapper/100:14:411
9681991412,0cyclictest20449-21sshd23:46:271
968199140,0cyclictest11217-21sshd21:31:351
968099141,0cyclictest4952-21id23:51:440
9680991410,0cyclictest0-21swapper/021:12:560
968099140,0cyclictest32068-21sshd23:30:360
9683991312,0cyclictest0-21swapper/323:26:253
9683991312,0cyclictest0-21swapper/322:48:543
9683991312,0cyclictest0-21swapper/320:05:203
9683991312,0cyclictest0-21swapper/300:08:133
9683991311,0cyclictest15974-21sshd00:31:003
9683991311,0cyclictest0-21swapper/300:36:283
9683991310,0cyclictest0-21swapper/321:16:183
968399130,0cyclictest110050irq/25-eth022:33:063
968399130,0cyclictest0-21swapper/321:33:243
968399130,0cyclictest0-21swapper/321:00:113
968399130,0cyclictest0-21swapper/300:04:183
9682991312,0cyclictest0-21swapper/223:49:162
9682991312,0cyclictest0-21swapper/223:15:422
9682991312,0cyclictest0-21swapper/223:09:532
9682991312,0cyclictest0-21swapper/222:23:542
9682991312,0cyclictest0-21swapper/222:09:222
9682991311,0cyclictest0-21swapper/222:10:532
968299130,0cyclictest1064-21sshd22:15:242
9681991312,0cyclictest27614-21sshd00:04:211
9681991312,0cyclictest18209-21sshd00:06:481
968199130,0cyclictest15083-21sshd23:28:561
9680991312,0cyclictest23450-21sshd23:22:560
9680991312,0cyclictest0-21swapper/000:14:370
9680991311,0cyclictest0-21swapper/000:23:280
968099130,0cyclictest21925-21sshd23:29:400
968099130,0cyclictest0-21swapper/023:18:590
968099130,0cyclictest0-21swapper/021:52:200
110050130,0irq/25-eth010531-21sshd23:41:561
9683991212,0cyclictest0-21swapper/300:16:083
9683991211,0cyclictest1716-21diskmemload22:01:373
9683991211,0cyclictest0-21swapper/323:11:473
9683991211,0cyclictest0-21swapper/323:11:463
9683991211,0cyclictest0-21swapper/321:55:213
9683991211,0cyclictest0-21swapper/300:12:113
9683991210,0cyclictest0-21swapper/322:40:593
968399120,0cyclictest31754-21sshd21:40:353
968399120,0cyclictest11153-21bash23:01:053
968399120,0cyclictest0-21swapper/323:23:583
968399120,0cyclictest0-21swapper/323:17:363
968399120,0cyclictest0-21swapper/322:37:033
968399120,0cyclictest0-21swapper/300:29:303
968299129,0cyclictest0-21swapper/200:34:552
9682991211,0cyclictest3256-21sshd23:55:042
9682991211,0cyclictest30201-21sshd22:49:272
9682991211,0cyclictest0-21swapper/200:08:132
9682991211,0cyclictest0-21swapper/200:00:542
9682991210,0cyclictest5639-21sshd23:31:162
9682991210,0cyclictest0-21swapper/200:38:532
968299120,0cyclictest1716-21diskmemload23:52:392
968299120,0cyclictest0-21swapper/222:00:042
968299120,0cyclictest0-21swapper/221:58:352
968299120,0cyclictest0-21swapper/221:34:102
9681991212,0cyclictest0-21swapper/123:13:221
9681991212,0cyclictest0-21swapper/123:13:211
9681991212,0cyclictest0-21swapper/121:53:331
9681991212,0cyclictest0-21swapper/121:13:571
9681991211,0cyclictest0-21swapper/123:05:061
9681991210,0cyclictest0-21swapper/122:02:511
968199120,0cyclictest0-21swapper/123:50:181
968199120,0cyclictest0-21swapper/122:59:171
968199120,0cyclictest0-21swapper/121:43:541
968199120,0cyclictest0-21swapper/100:37:281
9680991211,0cyclictest20712-21sshd22:58:460
9680991211,0cyclictest1716-21diskmemload22:09:100
9680991210,0cyclictest21641-21sshd23:39:460
9680991210,0cyclictest0-21swapper/023:59:040
968099120,0cyclictest31697-21bash22:29:100
968099120,0cyclictest0-21swapper/021:46:180
968099120,0cyclictest0-21swapper/000:30:250
968099120,0cyclictest0-21swapper/000:19:310
41120,0ktimersoftd/032732-21sshd21:58:050
41120,0ktimersoftd/01790-21cp22:39:330
110050120,0irq/25-eth00-21swapper/122:23:531
110050120,0irq/25-eth00-21swapper/021:32:060
9683991111,0cyclictest0-21swapper/321:20:303
9683991110,0cyclictest4834-21id23:34:393
9683991110,0cyclictest0-21swapper/323:52:413
9683991110,0cyclictest0-21swapper/322:52:503
9683991110,0cyclictest0-21swapper/321:08:313
968399110,0cyclictest0-21swapper/319:10:443
9682991111,0cyclictest0-21swapper/200:22:292
9682991110,0cyclictest1125-21sshd23:44:242
9682991110,0cyclictest0-21swapper/223:01:392
9682991110,0cyclictest0-21swapper/222:53:232
968299110,0cyclictest24443-21sshd22:35:102
968299110,0cyclictest0-21swapper/223:14:542
968299110,0cyclictest0-21swapper/223:14:532
968299110,0cyclictest0-21swapper/221:02:562
968299110,0cyclictest0-21swapper/220:57:272
9681991111,0cyclictest0-21swapper/123:58:331
9681991111,0cyclictest0-21swapper/123:19:101
9681991111,0cyclictest0-21swapper/122:41:381
9681991111,0cyclictest0-21swapper/122:35:161
9681991111,0cyclictest0-21swapper/119:35:051
9681991111,0cyclictest0-21swapper/119:25:051
9681991111,0cyclictest0-21swapper/100:33:311
9681991110,0cyclictest0-21swapper/123:23:071
9681991110,0cyclictest0-21swapper/122:45:361
9681991110,0cyclictest0-21swapper/120:55:141
968199110,0cyclictest0-21swapper/121:59:351
9680991111,0cyclictest0-21swapper/022:50:320
9680991111,0cyclictest0-21swapper/019:50:210
9680991110,0cyclictest21149-21sshd22:10:410
9680991110,0cyclictest17247-21sshd21:15:020
9680991110,0cyclictest12273-21sshd23:45:350
968099110,0cyclictest0-21swapper/023:01:380
968099110,0cyclictest0-21swapper/022:32:510
968099110,0cyclictest0-21swapper/021:24:190
968099110,0cyclictest0-21swapper/020:10:200
968099110,0cyclictest0-21swapper/000:08:150
41110,0ktimersoftd/08884-21sshd23:41:450
41110,0ktimersoftd/00-21swapper/022:46:360
41110,0ktimersoftd/00-21swapper/000:26:500
351110,0ktimersoftd/30-21swapper/320:34:433
271110,0ktimersoftd/20-21swapper/200:26:502
191110,0ktimersoftd/10-21swapper/100:26:501
117950110,0irq/26-eth1-rx-0-21swapper/219:28:012
110050110,0irq/25-eth00-21swapper/322:26:073
110050110,0irq/25-eth00-21swapper/122:09:341
110050110,0irq/25-eth00-21swapper/100:17:571
968299109,0cyclictest4563-21sshd21:37:472
968299109,0cyclictest12825-21bash21:52:312
968299108,0cyclictest0-21swapper/219:55:472
9682991010,0cyclictest0-21swapper/223:36:082
9682991010,0cyclictest0-21swapper/220:22:302
968299100,0cyclictest0-21swapper/219:19:402
968199109,0cyclictest3586-21sshd22:53:291
968199109,0cyclictest2347-21sshd22:32:481
968199109,0cyclictest0-21swapper/120:39:341
968199109,0cyclictest0-21swapper/119:23:491
968199108,0cyclictest788-40kipmi022:10:121
9681991010,0cyclictest0-21swapper/122:18:311
9681991010,0cyclictest0-21swapper/121:16:011
9681991010,0cyclictest0-21swapper/120:08:111
9681991010,0cyclictest0-21swapper/119:53:261
9681991010,0cyclictest0-21swapper/100:22:351
968199100,0cyclictest0-21swapper/120:10:371
968099109,0cyclictest23297-21sshd00:39:140
968099109,0cyclictest0-21swapper/021:35:080
9680991010,0cyclictest26888-21bash21:26:260
968099100,0cyclictest15733-21bash23:05:070
968099100,0cyclictest0-21swapper/021:00:200
41100,0ktimersoftd/08545-21sshd22:40:120
41100,0ktimersoftd/026228-21id22:00:470
351100,0ktimersoftd/30-21swapper/320:42:163
1599100,0watchdog/00-21swapper/022:15:060
117950100,0irq/26-eth1-rx-28-21ksoftirqd/221:49:322
96839999,0cyclictest0-21swapper/320:58:323
96839999,0cyclictest0-21swapper/320:26:423
96839999,0cyclictest0-21swapper/320:18:273
96839999,0cyclictest0-21swapper/320:02:533
96839999,0cyclictest0-21swapper/320:02:533
96839999,0cyclictest0-21swapper/319:23:173
96839998,0cyclictest0-21swapper/323:41:593
96839998,0cyclictest0-21swapper/321:53:503
96839995,0cyclictest29236-21bash23:37:083
96839990,0cyclictest20213-21bash21:49:573
96839990,0cyclictest0-21swapper/323:49:403
96839990,0cyclictest0-21swapper/319:38:583
96829999,0cyclictest0-21swapper/222:58:172
96829999,0cyclictest0-21swapper/222:32:442
96829999,0cyclictest0-21swapper/221:23:232
96829999,0cyclictest0-21swapper/220:52:002
96829999,0cyclictest0-21swapper/220:32:362
96829999,0cyclictest0-21swapper/220:09:572
96829999,0cyclictest0-21swapper/219:50:472
96829990,0cyclictest2145-21sshd22:42:542
96829990,0cyclictest0-21swapper/221:18:292
96819999,0cyclictest0-21swapper/123:34:441
96819999,0cyclictest0-21swapper/120:53:431
96819999,0cyclictest0-21swapper/120:27:431
96819999,0cyclictest0-21swapper/119:15:481
96819999,0cyclictest0-21swapper/119:11:371
96819998,0cyclictest1716-21diskmemload21:48:131
96819998,0cyclictest0-21swapper/119:55:181
96819998,0cyclictest0-21swapper/119:42:531
96809995,0cyclictest0-21swapper/023:10:400
96809995,0cyclictest0-21swapper/023:10:390
4190,0ktimersoftd/00-21swapper/000:00:550
11005090,0irq/25-eth022424-21sshd22:24:390
11005090,0irq/25-eth018-21rcuc/123:37:441
11005090,0irq/25-eth016143-21sshd21:35:291
96839988,0cyclictest0-21swapper/319:34:543
96839988,0cyclictest0-21swapper/319:29:543
96829988,0cyclictest0-21swapper/221:11:252
96829988,0cyclictest0-21swapper/220:43:312
96829988,0cyclictest0-21swapper/219:20:562
96829988,0cyclictest0-21swapper/219:12:132
96829987,0cyclictest0-21swapper/222:27:502
96829980,0cyclictest0-21swapper/220:13:202
96809981,0cyclictest0-21swapper/019:10:150
96809980,0cyclictest0-21swapper/020:20:140
96809980,0cyclictest0-21swapper/020:00:170
96809980,0cyclictest0-21swapper/020:00:160
11005080,0irq/25-eth09341-21bash22:06:013
11005080,0irq/25-eth036-21ksoftirqd/322:10:123
11005080,0irq/25-eth020-21ksoftirqd/121:25:081
11005080,0irq/25-eth010383-21seq20:16:140
96839977,0cyclictest0-21swapper/319:44:543
96839977,0cyclictest0-21swapper/319:17:503
96839970,0cyclictest0-21swapper/320:45:183
96829976,0cyclictest0-21swapper/221:08:232
96829970,0cyclictest0-21swapper/220:38:132
96819977,0cyclictest0-21swapper/121:01:171
96819977,0cyclictest0-21swapper/120:49:111
96819973,0cyclictest0-21swapper/119:45:151
96809974,0cyclictest0-21swapper/019:20:180
96809970,0cyclictest0-21swapper/020:37:150
96809970,0cyclictest0-21swapper/019:55:200
179970,0migration/111174-21cpuspeed_turbos20:20:121
159970,0watchdog/025395-21sed20:50:160
11795070,0irq/26-eth1-rx-0-21swapper/019:35:130
11005070,0irq/25-eth00-21swapper/223:25:112
11005070,0irq/25-eth00-21swapper/020:30:250
96839966,0cyclictest0-21swapper/320:10:143
96839965,0cyclictest27207-21munin-node19:45:123
96839962,0cyclictest0-21swapper/320:50:183
96839962,0cyclictest0-21swapper/319:50:173
96829962,0cyclictest0-21swapper/220:45:152
96829962,0cyclictest0-21swapper/220:25:132
96829962,0cyclictest0-21swapper/220:15:142
96829962,0cyclictest0-21swapper/219:40:162
96829962,0cyclictest0-21swapper/219:35:172
96829962,0cyclictest0-21swapper/219:30:182
96819966,0cyclictest0-21swapper/120:30:081
96819965,0cyclictest1620-21runrttasks20:19:101
96819962,0cyclictest0-21swapper/120:40:161
96819962,0cyclictest0-21swapper/120:00:171
96819962,0cyclictest0-21swapper/120:00:161
96819960,0cyclictest0-21swapper/119:30:211
96809965,0cyclictest23263-21fschecks_time20:45:130
96809965,0cyclictest18288-21fschecks_time19:25:110
96809965,0cyclictest15384-21munin-run20:30:010
96809962,0cyclictest0-21swapper/021:05:140
96809962,0cyclictest0-21swapper/020:05:160
96809962,0cyclictest0-21swapper/019:30:190
96809962,0cyclictest0-21swapper/019:15:010
96809961,0cyclictest0-21swapper/020:55:230
4160,0ktimersoftd/00-21swapper/019:45:140
339960,0migration/31298-21taskset20:00:003
339960,0migration/312115-21nfsd420:20:183
259960,0migration/228087-21nfsd419:45:172
259960,0migration/22783-21ntp_offset20:00:192
259960,0migration/22783-21ntp_offset20:00:182
149960,0migration/024770-21cpuspeed_turbos19:40:120
149960,0migration/021019-21fschecks_time20:40:140
11005060,0irq/25-eth01453-21nfsd21:09:591
11795050,0irq/26-eth1-rx-9709-21kworker/3:220:35:123
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional