You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-16 - 08:49
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rackdslot2.osadl.org (updated Mon Jul 15, 2024 12:46:25)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1235911130,4ptp4l401ktimersoftd/307:07:253
123591870,2ptp4l401ktimersoftd/311:44:353
57698850,15rtkit-daemon0-21swapper/007:05:570
123591830,11ptp4l0-21swapper/309:22:143
123591830,11ptp4l0-21swapper/309:22:143
3049999761,26cyclictest7621-21cat08:39:080
3050199704,12cyclictest6868-21gunzip10:50:322
3050199702,12cyclictest583-21polkitd08:40:022
230362700,5sleep023038-21switchtime08:00:390
3050199683,18cyclictest27904-21latency_hist09:20:012
3049999682,62cyclictest19511-21tr07:55:120
3050199673,13cyclictest18561-21latency_hist09:00:002
213772670,2sleep20-21swapper/209:05:152
284112663,48sleep10-21swapper/107:05:131
123591660,2ptp4l401ktimersoftd/307:47:463
3050199653,12cyclictest11722-21switchtime11:00:412
3050199653,11cyclictest3743-21grep07:20:302
3050199652,12cyclictest11189-21irqrtprio12:10:262
3050199648,8cyclictest20805-21latency_hist09:05:012
3050199642,17cyclictest1327-21kernelversion09:30:272
3050199642,14cyclictest31314-21irqrtprio09:25:242
3050199642,14cyclictest31314-21irqrtprio09:25:242
3050199641,13cyclictest12643-21fschecks_count09:55:152
3050199627,8cyclictest19656-21cat12:30:002
3050199627,8cyclictest19656-21cat12:30:002
3050199626,9cyclictest22365-21irqrtprio08:00:252
3050199626,8cyclictest6830-21unixbench_singl09:40:412
3050199623,17cyclictest3607-21sed09:35:292
3050199623,17cyclictest32069-21phc2sys-jitter08:20:312
3050199611,12cyclictest2687-21latency_hist07:20:002
3050199592,11cyclictest8542-21if_enp1s010:55:272
3050199591,12cyclictest17853-21cat11:15:202
209332590,2sleep20-21swapper/211:20:332
3050299582,4cyclictest41-21ksoftirqd/308:40:363
293022580,3sleep00-21swapper/010:30:290
30500995647,4cyclictest25-21ksoftirqd/108:39:291
3050199532,14cyclictest11758-21/usr/sbin/munin08:45:132
3050199530,10cyclictest16207-21ls07:45:372
123591530,1ptp4l401ktimersoftd/310:21:573
123591530,1ptp4l401ktimersoftd/307:27:473
57698520,10rtkit-daemon0-21swapper/110:42:031
30502995246,3cyclictest41-21ksoftirqd/307:14:593
30502995230,11cyclictest1126-21runrttasks12:10:133
30500995246,4cyclictest25-21ksoftirqd/111:35:001
30502995146,3cyclictest41-21ksoftirqd/308:40:003
30502995145,3cyclictest41-21ksoftirqd/311:40:003
30502995043,4cyclictest41-21ksoftirqd/307:20:003
30500995041,5cyclictest25-21ksoftirqd/108:40:101
30502994942,4cyclictest41-21ksoftirqd/307:55:123
30502994843,3cyclictest41-21ksoftirqd/311:30:013
30502994843,3cyclictest41-21ksoftirqd/309:40:003
30502994841,4cyclictest41-21ksoftirqd/308:55:003
30502994841,4cyclictest12102-21latency_hist07:40:003
62082470,2sleep10-21swapper/109:40:321
30502994741,4cyclictest41-21ksoftirqd/310:15:003
30502994741,4cyclictest41-21ksoftirqd/308:05:003
30502994741,3cyclictest41-21ksoftirqd/310:35:013
30502994741,3cyclictest41-21ksoftirqd/308:05:433
30502994740,4cyclictest41-21ksoftirqd/310:29:593
30502994740,4cyclictest41-21ksoftirqd/309:00:003
30502994738,6cyclictest41-21ksoftirqd/309:50:013
3050299470,3cyclictest121rcu_preempt10:37:183
3050199473,4cyclictest0-21swapper/209:10:522
123591470,1ptp4l401ktimersoftd/307:50:043
30502994640,3cyclictest41-21ksoftirqd/312:15:133
30502994639,4cyclictest41-21ksoftirqd/312:40:013
30501994638,4cyclictest33-21ksoftirqd/208:39:212
30499994633,7cyclictest8054-21kworker/0:008:40:260
3001124615,19sleep20-21swapper/207:07:252
123591460,1ptp4l401ktimersoftd/309:43:453
123591460,1ptp4l401ktimersoftd/307:30:183
30502994540,3cyclictest41-21ksoftirqd/309:15:003
30502994539,4cyclictest41-21ksoftirqd/308:20:013
30502994539,3cyclictest41-21ksoftirqd/312:30:003
30502994539,3cyclictest41-21ksoftirqd/312:30:003
30502994538,4cyclictest41-21ksoftirqd/312:05:003
30502994538,4cyclictest41-21ksoftirqd/311:55:153
3050199450,21cyclictest19237-21sed07:55:012
30502994439,3cyclictest41-21ksoftirqd/312:05:143
30502994438,3cyclictest41-21ksoftirqd/312:35:003
30500994437,4cyclictest25-21ksoftirqd/108:00:011
30502994337,4cyclictest41-21ksoftirqd/308:45:153
30502994337,3cyclictest41-21ksoftirqd/309:50:233
30502994336,4cyclictest41-21ksoftirqd/310:10:003
30502994336,4cyclictest41-21ksoftirqd/309:04:593
30500994337,4cyclictest25-21ksoftirqd/107:55:001
30500994337,3cyclictest25-21ksoftirqd/109:00:001
123591430,1ptp4l401ktimersoftd/309:55:123
123591430,1ptp4l401ktimersoftd/308:25:013
30502994237,3cyclictest41-21ksoftirqd/308:15:003
30502994235,4cyclictest41-21ksoftirqd/311:10:003
30502994235,4cyclictest41-21ksoftirqd/309:30:153
3050299421,4cyclictest41-21ksoftirqd/311:00:003
30500994236,4cyclictest25-21ksoftirqd/111:10:461
30500994235,4cyclictest25-21ksoftirqd/110:25:001
30502994135,4cyclictest41-21ksoftirqd/311:00:173
30502994135,4cyclictest41-21ksoftirqd/310:00:293
30502994135,4cyclictest41-21ksoftirqd/309:15:353
30502994135,4cyclictest41-21ksoftirqd/307:40:143
30502994135,3cyclictest41-21ksoftirqd/311:54:593
30502994134,4cyclictest41-21ksoftirqd/311:31:343
30502994134,4cyclictest41-21ksoftirqd/310:40:383
30502994134,4cyclictest41-21ksoftirqd/309:25:153
30502994134,4cyclictest41-21ksoftirqd/309:25:143
3050199416,7cyclictest16174-21ptp4l11:10:342
30501994135,4cyclictest33-21ksoftirqd/210:25:142
30501994133,5cyclictest33-21ksoftirqd/208:13:052
30500994136,3cyclictest25-21ksoftirqd/108:20:011
30500994135,4cyclictest25-21ksoftirqd/110:50:161
30500994135,3cyclictest25-21ksoftirqd/108:55:001
30500994134,4cyclictest25-21ksoftirqd/111:05:001
30499994134,4cyclictest9-21ksoftirqd/012:14:590
30502994035,3cyclictest41-21ksoftirqd/311:45:233
30502994034,4cyclictest41-21ksoftirqd/312:20:223
30502994034,4cyclictest41-21ksoftirqd/312:20:213
30502994034,3cyclictest41-21ksoftirqd/309:10:003
30502994032,5cyclictest41-21ksoftirqd/310:50:433
30501994033,4cyclictest33-21ksoftirqd/210:00:152
30501994032,5cyclictest33-21ksoftirqd/211:28:192
30500994034,4cyclictest25-21ksoftirqd/107:15:381
30500994034,3cyclictest25-21ksoftirqd/112:18:301
30500994034,3cyclictest25-21ksoftirqd/110:20:001
30500994033,4cyclictest25-21ksoftirqd/112:38:351
30500994033,4cyclictest25-21ksoftirqd/109:50:521
30500994033,4cyclictest25-21ksoftirqd/107:49:141
30499994034,3cyclictest9-21ksoftirqd/010:09:460
30499994033,4cyclictest9-21ksoftirqd/012:36:100
30499994033,4cyclictest9-21ksoftirqd/007:30:390
30499994032,5cyclictest9-21ksoftirqd/012:19:000
30499994032,5cyclictest9-21ksoftirqd/011:22:350
30502993934,3cyclictest41-21ksoftirqd/311:20:093
30502993934,3cyclictest41-21ksoftirqd/310:45:273
30502993933,3cyclictest41-21ksoftirqd/311:20:013
30502993933,3cyclictest41-21ksoftirqd/307:20:173
30502993932,4cyclictest41-21ksoftirqd/310:18:553
30502993932,4cyclictest41-21ksoftirqd/308:30:323
30501993934,3cyclictest33-21ksoftirqd/210:05:152
30501993932,4cyclictest33-21ksoftirqd/209:22:232
30501993932,4cyclictest33-21ksoftirqd/209:22:222
30500993933,4cyclictest25-21ksoftirqd/112:05:201
30500993933,3cyclictest25-21ksoftirqd/111:53:291
30500993933,3cyclictest25-21ksoftirqd/110:35:051
30500993932,4cyclictest25-21ksoftirqd/108:04:121
30500993931,5cyclictest25-21ksoftirqd/109:01:251
30499993933,4cyclictest9-21ksoftirqd/009:40:460
30499993933,4cyclictest9-21ksoftirqd/009:31:460
30499993932,4cyclictest9-21ksoftirqd/007:24:290
30499993931,5cyclictest9-21ksoftirqd/008:30:090
30499993931,5cyclictest9-21ksoftirqd/008:16:280
30502993832,4cyclictest41-21ksoftirqd/308:25:233
30501993832,4cyclictest33-21ksoftirqd/212:05:192
30501993832,4cyclictest33-21ksoftirqd/208:53:212
30501993832,4cyclictest33-21ksoftirqd/208:15:112
30501993831,4cyclictest33-21ksoftirqd/212:16:382
30501993831,4cyclictest33-21ksoftirqd/211:45:582
30500993832,4cyclictest25-21ksoftirqd/109:29:191
30500993832,4cyclictest25-21ksoftirqd/109:29:191
30500993832,4cyclictest25-21ksoftirqd/107:20:331
30500993832,3cyclictest25-21ksoftirqd/112:14:201
30500993832,3cyclictest25-21ksoftirqd/111:27:401
30500993832,3cyclictest25-21ksoftirqd/107:39:591
30500993831,4cyclictest25-21ksoftirqd/112:04:351
30500993831,4cyclictest25-21ksoftirqd/111:47:011
30500993831,4cyclictest25-21ksoftirqd/111:20:081
30500993831,4cyclictest25-21ksoftirqd/111:17:311
30500993831,4cyclictest25-21ksoftirqd/110:28:491
30500993831,4cyclictest25-21ksoftirqd/110:09:231
30500993831,4cyclictest25-21ksoftirqd/109:55:361
30500993831,4cyclictest25-21ksoftirqd/108:45:151
30500993831,4cyclictest25-21ksoftirqd/108:32:571
30500993831,4cyclictest25-21ksoftirqd/108:21:571
30500993831,4cyclictest25-21ksoftirqd/107:25:521
30499993831,4cyclictest9-21ksoftirqd/011:40:540
30499993831,4cyclictest9-21ksoftirqd/011:12:430
30499993830,5cyclictest9-21ksoftirqd/011:32:430
30499993830,5cyclictest9-21ksoftirqd/010:03:480
30499993830,5cyclictest9-21ksoftirqd/008:58:270
30499993816,19cyclictest21338-21unixbench_multi12:30:380
30502993730,4cyclictest41-21ksoftirqd/311:12:393
30501993732,3cyclictest33-21ksoftirqd/207:57:502
30501993730,4cyclictest33-21ksoftirqd/211:57:052
30501993730,4cyclictest33-21ksoftirqd/207:32:532
30501993730,4cyclictest33-21ksoftirqd/207:14:512
30501993729,5cyclictest33-21ksoftirqd/210:17:022
30501993729,4cyclictest33-21ksoftirqd/210:37:142
30500993732,3cyclictest25-21ksoftirqd/112:35:001
30500993731,4cyclictest25-21ksoftirqd/110:12:231
30500993731,4cyclictest25-21ksoftirqd/109:21:281
30500993731,4cyclictest25-21ksoftirqd/109:21:271
30500993731,4cyclictest25-21ksoftirqd/107:31:121
30500993731,3cyclictest25-21ksoftirqd/112:25:541
30500993731,3cyclictest25-21ksoftirqd/112:25:541
30500993730,4cyclictest25-21ksoftirqd/111:37:501
30500993730,4cyclictest25-21ksoftirqd/109:31:431
30500993730,4cyclictest25-21ksoftirqd/108:28:421
30500993730,4cyclictest25-21ksoftirqd/108:09:141
30500993730,4cyclictest25-21ksoftirqd/107:42:121
30500993729,5cyclictest25-21ksoftirqd/109:35:011
30500993729,5cyclictest25-21ksoftirqd/109:09:121
30499993730,4cyclictest9-21ksoftirqd/012:23:050
30499993730,4cyclictest9-21ksoftirqd/012:23:050
30499993730,4cyclictest9-21ksoftirqd/012:07:480
30499993730,4cyclictest9-21ksoftirqd/010:11:540
30499993730,4cyclictest9-21ksoftirqd/007:13:530
30499993729,5cyclictest9-21ksoftirqd/010:54:020
30499993729,5cyclictest9-21ksoftirqd/009:24:280
30499993729,5cyclictest9-21ksoftirqd/009:24:280
30499993720,14cyclictest9-21ksoftirqd/010:48:510
30501993630,4cyclictest33-21ksoftirqd/210:20:462
30501993629,4cyclictest33-21ksoftirqd/209:49:512
30501993629,4cyclictest33-21ksoftirqd/207:40:152
30501993629,4cyclictest33-21ksoftirqd/207:39:452
30501993628,5cyclictest33-21ksoftirqd/211:50:522
30501993628,5cyclictest33-21ksoftirqd/207:28:572
30500993630,4cyclictest25-21ksoftirqd/111:55:291
30500993630,4cyclictest25-21ksoftirqd/109:15:391
30500993629,4cyclictest25-21ksoftirqd/111:06:151
30500993629,4cyclictest25-21ksoftirqd/107:12:501
30500993628,5cyclictest25-21ksoftirqd/110:02:511
30499993630,4cyclictest9-21ksoftirqd/011:51:060
30499993630,4cyclictest9-21ksoftirqd/007:48:580
30499993630,3cyclictest5754-21acpi12:00:110
30499993629,4cyclictest9-21ksoftirqd/011:17:160
30499993629,4cyclictest9-21ksoftirqd/010:21:540
30499993629,4cyclictest9-21ksoftirqd/009:45:120
30499993629,4cyclictest9-21ksoftirqd/008:26:590
30499993629,4cyclictest9-21ksoftirqd/008:06:040
30499993628,5cyclictest9-21ksoftirqd/011:05:090
30499993616,17cyclictest14265-21readlink10:00:000
30499993614,19cyclictest21899-21basename11:25:120
30501993529,4cyclictest33-21ksoftirqd/210:48:492
30501993529,4cyclictest33-21ksoftirqd/210:10:122
30501993529,4cyclictest33-21ksoftirqd/208:31:462
30501993529,4cyclictest33-21ksoftirqd/208:29:392
30501993528,4cyclictest33-21ksoftirqd/212:20:102
30501993528,4cyclictest33-21ksoftirqd/212:20:102
30501993528,4cyclictest33-21ksoftirqd/211:43:452
30501993528,4cyclictest33-21ksoftirqd/211:30:242
30500993527,5cyclictest25-21ksoftirqd/110:59:001
30500993527,5cyclictest25-21ksoftirqd/110:47:451
3049999357,25cyclictest32766-21systemd10:37:150
3049999356,11cyclictest57698rtkit-daemon09:06:560
30499993529,4cyclictest9-21ksoftirqd/009:02:440
30499993528,4cyclictest9-21ksoftirqd/010:41:450
30499993528,4cyclictest9-21ksoftirqd/009:15:450
30499993528,4cyclictest9-21ksoftirqd/007:40:580
30499993528,4cyclictest9-21ksoftirqd/007:37:540
30499993528,4cyclictest9-21ksoftirqd/007:19:410
30499993527,5cyclictest9-21ksoftirqd/011:56:560
30499993527,5cyclictest9-21ksoftirqd/008:45:510
30499993527,5cyclictest9-21ksoftirqd/007:54:200
30499993512,20cyclictest10675-21df_abs11:00:190
30501993427,4cyclictest33-21ksoftirqd/212:35:122
30501993427,4cyclictest33-21ksoftirqd/212:02:492
30501993427,4cyclictest33-21ksoftirqd/211:38:232
30501993427,4cyclictest33-21ksoftirqd/209:52:012
30500993428,4cyclictest25-21ksoftirqd/109:45:411
30500993427,4cyclictest25-21ksoftirqd/111:45:011
30499993428,3cyclictest9-21ksoftirqd/010:26:010
30499993427,4cyclictest9-21ksoftirqd/012:28:280
30499993427,4cyclictest9-21ksoftirqd/012:28:280
30499993427,4cyclictest9-21ksoftirqd/009:27:430
30499993427,4cyclictest9-21ksoftirqd/009:27:420
30499993426,5cyclictest9-21ksoftirqd/011:45:240
30499993426,5cyclictest9-21ksoftirqd/010:58:230
30499993415,15cyclictest21413-21/usr/sbin/munin10:15:170
30499993412,19cyclictest6158-21missed_timers07:25:280
30499993412,18cyclictest10689-21irqrtprio09:50:230
30501993327,4cyclictest33-21ksoftirqd/212:30:572
30500993326,4cyclictest25-21ksoftirqd/109:11:321
30499993327,3cyclictest9-21ksoftirqd/011:38:360
30499993326,4cyclictest9-21ksoftirqd/008:14:030
30501993225,4cyclictest33-21ksoftirqd/211:06:282
30500993226,3cyclictest25-21ksoftirqd/112:20:141
30500993226,3cyclictest25-21ksoftirqd/112:20:131
30500993225,4cyclictest25-21ksoftirqd/110:30:151
30500993225,4cyclictest25-21ksoftirqd/108:12:411
3049999322,27cyclictest30885-21/usr/sbin/munin08:20:430
30499993212,17cyclictest1-21systemd09:10:380
30501993126,3cyclictest33-21ksoftirqd/210:30:242
3049999312,24cyclictest14145-21apt-get08:50:110
30501993024,4cyclictest33-21ksoftirqd/210:40:252
30501993023,4cyclictest33-21ksoftirqd/208:07:312
3049999304,23cyclictest3520-21interrupts09:35:270
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional