You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-04-03 - 11:34
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackdslot4.osadl.org (updated Thu Apr 03, 2025 00:45:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
90542224158,22sleep10-21swapper/119:08:111
134791220155,21phc2sys0-21swapper/319:06:473
91322211163,37sleep20-21swapper/219:09:132
90032205171,22sleep00-21swapper/019:07:300
1347919762,26phc2sys0-21swapper/319:10:003
134991660,1ptp4l401ktimersoftd/320:25:433
170342590,4sleep30-21swapper/300:20:003
134991580,1ptp4l401ktimersoftd/323:13:333
134991570,1ptp4l391rcuc/319:45:223
244232560,2sleep30-21swapper/320:45:173
42282510,1sleep10-21swapper/123:50:091
134991510,1ptp4l401ktimersoftd/321:14:563
97952490,3sleep0111rcuc/019:10:140
95022480,1sleep10-21swapper/122:40:171
9486994818,28cyclictest5344-21kworker/1:219:27:081
130691480,7getstats948899cyclictest22:25:063
9488994639,4cyclictest28557-21ls20:55:003
36998450,2rtkit-daemon0-21swapper/321:39:143
134991430,0ptp4l401ktimersoftd/322:32:303
134991430,0ptp4l401ktimersoftd/322:32:303
134991420,0ptp4l401ktimersoftd/321:07:163
134991420,0ptp4l401ktimersoftd/321:00:183
134991420,0ptp4l401ktimersoftd/320:34:483
134991420,0ptp4l401ktimersoftd/319:36:593
9487994134,5cyclictest32741-21grep23:39:592
36998410,2rtkit-daemon0-21swapper/323:28:073
134991410,0ptp4l401ktimersoftd/323:35:193
134991410,0ptp4l401ktimersoftd/322:05:053
134991410,0ptp4l401ktimersoftd/320:11:483
134991410,0ptp4l401ktimersoftd/300:39:353
134991410,0ptp4l401ktimersoftd/300:26:033
948899391,35cyclictest30220-21cron22:15:013
9487993933,4cyclictest33-21ksoftirqd/223:45:012
9488993832,3cyclictest41-21ksoftirqd/323:50:143
9486993815,4cyclictest23120-21fw_packets23:15:141
130691380,1getstats0-21swapper/322:45:063
130691380,1getstats0-21swapper/322:40:063
9488993732,3cyclictest41-21ksoftirqd/321:35:003
9488993731,4cyclictest41-21ksoftirqd/322:18:363
9486993732,3cyclictest25-21ksoftirqd/100:10:081
9486993731,4cyclictest25-21ksoftirqd/121:57:281
9486993731,4cyclictest25-21ksoftirqd/100:02:401
9486993730,5cyclictest25-21ksoftirqd/122:16:221
9485993731,4cyclictest9-21ksoftirqd/023:00:000
130691370,2getstats0-21swapper/323:45:063
130691370,1getstats0-21swapper/322:35:063
9488993630,4cyclictest41-21ksoftirqd/300:01:173
9487993630,4cyclictest33-21ksoftirqd/220:47:582
9487993630,4cyclictest33-21ksoftirqd/200:33:422
948799360,2cyclictest0-21swapper/200:35:272
9486993630,4cyclictest25-21ksoftirqd/121:52:391
9486993630,4cyclictest25-21ksoftirqd/120:41:461
9486993630,4cyclictest25-21ksoftirqd/119:15:011
9486993630,4cyclictest25-21ksoftirqd/100:22:591
9486993629,5cyclictest25-21ksoftirqd/120:28:031
9485993629,5cyclictest9-21ksoftirqd/021:48:130
9488993531,3cyclictest41-21ksoftirqd/321:55:183
9488993530,3cyclictest41-21ksoftirqd/321:55:003
9488993529,4cyclictest41-21ksoftirqd/322:01:153
9488993529,4cyclictest41-21ksoftirqd/322:01:153
9487993530,3cyclictest33-21ksoftirqd/220:28:272
9487993529,4cyclictest33-21ksoftirqd/222:53:172
9487993529,4cyclictest33-21ksoftirqd/222:32:432
9487993529,4cyclictest33-21ksoftirqd/222:32:432
9487993529,4cyclictest33-21ksoftirqd/220:22:252
9487993528,4cyclictest33-21ksoftirqd/221:46:352
9486993529,4cyclictest25-21ksoftirqd/123:06:041
9486993529,4cyclictest25-21ksoftirqd/122:32:301
9486993529,4cyclictest25-21ksoftirqd/122:32:301
9486993529,4cyclictest25-21ksoftirqd/119:56:331
9486993529,4cyclictest25-21ksoftirqd/100:39:481
9485993530,3cyclictest9-21ksoftirqd/019:24:590
9485993529,4cyclictest9-21ksoftirqd/023:40:120
9485993529,4cyclictest9-21ksoftirqd/023:36:520
9485993529,4cyclictest9-21ksoftirqd/019:31:440
9485993513,19cyclictest15002-21expr00:15:140
9488993430,3cyclictest41-21ksoftirqd/321:45:003
9488993430,3cyclictest41-21ksoftirqd/319:25:013
9488993429,3cyclictest41-21ksoftirqd/323:45:013
9488993429,3cyclictest41-21ksoftirqd/323:21:193
9488993429,3cyclictest41-21ksoftirqd/323:18:303
9488993429,3cyclictest41-21ksoftirqd/323:04:023
9488993428,4cyclictest41-21ksoftirqd/320:23:163
9488993428,4cyclictest41-21ksoftirqd/300:21:523
9487993429,3cyclictest3976-21latency_hist20:05:012
9487993428,4cyclictest33-21ksoftirqd/223:02:082
9487993428,4cyclictest33-21ksoftirqd/222:58:312
9487993428,4cyclictest33-21ksoftirqd/221:41:492
9487993428,4cyclictest33-21ksoftirqd/221:12:202
9486993428,4cyclictest25-21ksoftirqd/123:40:341
9486993428,4cyclictest25-21ksoftirqd/122:13:371
9486993428,4cyclictest25-21ksoftirqd/121:39:191
9486993428,4cyclictest25-21ksoftirqd/121:17:401
9486993428,4cyclictest25-21ksoftirqd/120:08:161
9486993428,4cyclictest25-21ksoftirqd/119:40:091
9485993428,4cyclictest9-21ksoftirqd/023:28:020
9485993428,4cyclictest9-21ksoftirqd/022:21:500
9485993428,4cyclictest9-21ksoftirqd/022:09:270
9485993428,4cyclictest9-21ksoftirqd/021:41:510
9485993428,4cyclictest9-21ksoftirqd/021:05:480
9485993428,4cyclictest9-21ksoftirqd/000:37:290
9485993412,20cyclictest17292-21expr23:00:170
36998340,2rtkit-daemon0-21swapper/200:03:512
134991340,0ptp4l401ktimersoftd/320:55:193
9488993328,3cyclictest41-21ksoftirqd/321:26:333
9488993328,3cyclictest41-21ksoftirqd/321:18:593
9488993327,4cyclictest41-21ksoftirqd/320:41:203
9488993327,4cyclictest41-21ksoftirqd/320:03:573
9488993327,4cyclictest41-21ksoftirqd/319:30:043
9488993327,4cyclictest41-21ksoftirqd/300:33:043
9488993327,3cyclictest41-21ksoftirqd/322:55:123
9487993328,3cyclictest33-21ksoftirqd/223:12:572
9487993328,3cyclictest33-21ksoftirqd/220:53:592
9487993328,3cyclictest33-21ksoftirqd/219:12:092
9487993328,3cyclictest33-21ksoftirqd/200:30:002
9487993328,3cyclictest14536-21cron00:15:012
9487993327,4cyclictest33-21ksoftirqd/221:50:562
9487993327,4cyclictest33-21ksoftirqd/221:05:342
9487993327,4cyclictest33-21ksoftirqd/221:00:362
9487993327,4cyclictest33-21ksoftirqd/200:07:192
9487993326,5cyclictest33-21ksoftirqd/220:34:182
9486993328,3cyclictest25-21ksoftirqd/120:01:061
9486993327,4cyclictest25-21ksoftirqd/123:22:411
9486993327,4cyclictest25-21ksoftirqd/123:03:271
9486993327,4cyclictest25-21ksoftirqd/121:14:151
9486993327,4cyclictest25-21ksoftirqd/121:07:011
9486993327,4cyclictest25-21ksoftirqd/120:33:291
9486993326,5cyclictest25-21ksoftirqd/100:27:161
9486993326,4cyclictest25-21ksoftirqd/123:46:011
9485993328,3cyclictest9-21ksoftirqd/021:35:110
9485993328,3cyclictest9-21ksoftirqd/019:39:550
9485993327,4cyclictest9-21ksoftirqd/023:52:050
9485993327,4cyclictest9-21ksoftirqd/023:48:030
9485993327,4cyclictest9-21ksoftirqd/023:23:160
9485993327,4cyclictest9-21ksoftirqd/021:58:560
9485993327,4cyclictest9-21ksoftirqd/021:22:290
9485993327,4cyclictest9-21ksoftirqd/020:12:040
9485993313,18cyclictest22646-21seq00:31:200
1347913326,3phc2sys41-21ksoftirqd/319:17:263
9488993228,3cyclictest41-21ksoftirqd/319:45:013
9488993227,3cyclictest41-21ksoftirqd/322:52:493
9488993227,3cyclictest41-21ksoftirqd/322:25:003
9488993227,3cyclictest41-21ksoftirqd/320:39:203
9487993228,3cyclictest33-21ksoftirqd/223:49:352
9487993227,3cyclictest33-21ksoftirqd/221:17:112
9487993227,3cyclictest33-21ksoftirqd/219:21:392
9487993226,4cyclictest33-21ksoftirqd/223:29:322
9487993226,4cyclictest33-21ksoftirqd/223:07:542
9487993226,4cyclictest33-21ksoftirqd/222:39:172
9487993226,4cyclictest33-21ksoftirqd/222:22:062
9487993226,4cyclictest33-21ksoftirqd/219:44:302
9487993226,4cyclictest33-21ksoftirqd/200:17:062
9486993227,3cyclictest25-21ksoftirqd/123:34:551
9486993226,4cyclictest25-21ksoftirqd/122:52:401
9486993226,4cyclictest25-21ksoftirqd/121:26:271
9486993226,4cyclictest25-21ksoftirqd/120:15:001
9486993226,4cyclictest25-21ksoftirqd/119:51:351
9485993227,3cyclictest9-21ksoftirqd/020:29:330
9485993226,4cyclictest9-21ksoftirqd/022:41:160
9485993226,4cyclictest9-21ksoftirqd/022:15:520
9485993226,4cyclictest9-21ksoftirqd/022:04:170
9485993226,4cyclictest9-21ksoftirqd/022:04:170
9485993226,4cyclictest9-21ksoftirqd/019:27:390
9485993226,4cyclictest9-21ksoftirqd/019:19:530
9488993127,3cyclictest41-21ksoftirqd/320:16:263
9488993127,2cyclictest41-21ksoftirqd/323:10:003
9488993126,3cyclictest41-21ksoftirqd/323:55:143
9488993126,3cyclictest41-21ksoftirqd/320:05:203
9488993126,3cyclictest41-21ksoftirqd/319:25:523
9488993125,3cyclictest41-21ksoftirqd/319:50:163
9487993126,3cyclictest33-21ksoftirqd/222:45:032
9487993126,3cyclictest33-21ksoftirqd/221:34:502
9487993126,3cyclictest33-21ksoftirqd/219:30:122
9487993125,4cyclictest33-21ksoftirqd/223:51:552
9487993125,4cyclictest33-21ksoftirqd/219:49:282
9486993126,3cyclictest25-21ksoftirqd/122:05:001
9486993126,3cyclictest25-21ksoftirqd/122:05:001
9486993125,4cyclictest25-21ksoftirqd/123:55:591
9486993125,4cyclictest25-21ksoftirqd/122:27:051
9486993125,4cyclictest25-21ksoftirqd/122:07:071
9486993125,4cyclictest25-21ksoftirqd/120:36:241
9486993125,4cyclictest25-21ksoftirqd/119:22:081
9486993124,5cyclictest25-21ksoftirqd/122:49:111
948699310,29cyclictest22932-21cron00:35:001
9485993126,3cyclictest9-21ksoftirqd/023:15:460
9485993126,3cyclictest9-21ksoftirqd/023:06:030
9485993126,3cyclictest9-21ksoftirqd/022:48:020
9485993126,3cyclictest9-21ksoftirqd/020:30:020
9485993125,4cyclictest9-21ksoftirqd/022:35:390
9485993125,4cyclictest9-21ksoftirqd/021:04:480
9485993125,4cyclictest9-21ksoftirqd/020:38:360
9485993125,4cyclictest9-21ksoftirqd/020:01:020
9485993125,4cyclictest9-21ksoftirqd/019:56:330
9485993125,4cyclictest9-21ksoftirqd/000:27:430
9485993124,5cyclictest9-21ksoftirqd/022:29:400
9485993113,15cyclictest26563-21cstates20:50:180
9485993110,19cyclictest12091-21latency_hist00:10:010
9485993110,18cyclictest29103-21expr20:55:150
9488993024,4cyclictest41-21ksoftirqd/321:46:473
9488993024,4cyclictest41-21ksoftirqd/321:21:083
9487993025,3cyclictest33-21ksoftirqd/222:40:122
9487993025,3cyclictest33-21ksoftirqd/222:01:042
9487993025,3cyclictest33-21ksoftirqd/222:01:042
9487993025,3cyclictest33-21ksoftirqd/221:28:272
9487993025,3cyclictest33-21ksoftirqd/219:55:352
9487993025,3cyclictest33-21ksoftirqd/219:16:222
948699302,8cyclictest28795-21apt-get20:55:121
9486993025,3cyclictest8733-21dump-pmu-power22:40:001
9486993024,4cyclictest25-21ksoftirqd/121:24:441
9486993024,4cyclictest25-21ksoftirqd/119:39:171
9486993023,5cyclictest25-21ksoftirqd/121:46:371
9485993026,3cyclictest9-21ksoftirqd/021:34:350
9485993025,3cyclictest9-21ksoftirqd/021:50:080
9485993025,3cyclictest9-21ksoftirqd/021:10:130
9485993025,3cyclictest9-21ksoftirqd/000:01:460
9485993024,4cyclictest9-21ksoftirqd/023:32:390
9485993024,4cyclictest9-21ksoftirqd/020:21:070
9485993024,4cyclictest9-21ksoftirqd/019:42:070
9488992924,3cyclictest41-21ksoftirqd/300:10:423
9487992924,3cyclictest33-21ksoftirqd/223:16:462
9487992924,3cyclictest33-21ksoftirqd/220:37:292
9487992924,3cyclictest33-21ksoftirqd/220:08:482
9487992924,3cyclictest33-21ksoftirqd/219:51:542
9487992923,4cyclictest33-21ksoftirqd/222:05:072
9487992923,4cyclictest33-21ksoftirqd/221:36:152
9487992923,4cyclictest33-21ksoftirqd/220:41:192
9487992923,4cyclictest33-21ksoftirqd/220:13:032
9487992923,4cyclictest33-21ksoftirqd/219:38:482
9486992924,3cyclictest25-21ksoftirqd/100:07:211
9486992923,4cyclictest25-21ksoftirqd/121:41:521
948599299,3cyclictest6366-21acpi23:55:120
948599299,3cyclictest30279-21sed19:50:220
948599299,3cyclictest14013-21cat00:10:220
948599298,3cyclictest28979-21latency_hist19:49:590
948599297,3cyclictest6957-21uniq21:15:150
948599296,3cyclictest9973-21cut20:15:190
9485992924,3cyclictest9-21ksoftirqd/022:31:570
9485992924,3cyclictest9-21ksoftirqd/022:31:570
9485992924,3cyclictest9-21ksoftirqd/021:25:300
9485992923,4cyclictest9-21ksoftirqd/020:42:250
9487992823,3cyclictest33-21ksoftirqd/222:17:352
9487992823,3cyclictest33-21ksoftirqd/221:24:312
9487992822,4cyclictest33-21ksoftirqd/222:13:182
9486992823,3cyclictest25-21ksoftirqd/122:21:431
9486992823,3cyclictest25-21ksoftirqd/120:49:411
9486992823,3cyclictest25-21ksoftirqd/100:16:541
9486992822,4cyclictest25-21ksoftirqd/122:55:411
948599289,4cyclictest5498-21phc2sys20:05:250
9485992822,4cyclictest9-21ksoftirqd/023:13:370
9485992822,4cyclictest9-21ksoftirqd/022:54:480
9485992822,4cyclictest9-21ksoftirqd/022:10:550
9485992822,4cyclictest9-21ksoftirqd/000:23:100
9488992723,3cyclictest41-21ksoftirqd/300:06:353
9488992722,3cyclictest41-21ksoftirqd/323:30:103
9488992721,3cyclictest41-21ksoftirqd/320:00:003
9487992722,3cyclictest33-21ksoftirqd/223:55:542
9487992722,3cyclictest33-21ksoftirqd/220:57:062
9487992721,4cyclictest33-21ksoftirqd/220:18:122
9486992722,3cyclictest25-21ksoftirqd/120:15:111
9486992722,3cyclictest25-21ksoftirqd/119:32:341
9486992722,3cyclictest22313-21perf23:15:011
9487992621,3cyclictest33-21ksoftirqd/200:22:492
9487992620,4cyclictest33-21ksoftirqd/223:22:262
9486992620,4cyclictest25-21ksoftirqd/123:36:571
9487992521,3cyclictest33-21ksoftirqd/223:33:012
9487992519,4cyclictest33-21ksoftirqd/219:28:462
948599256,3cyclictest24925-21kernelversion20:45:210
9487992319,3cyclictest33-21ksoftirqd/221:55:182
9487992318,3cyclictest33-21ksoftirqd/222:26:072
9486992317,4cyclictest25-21ksoftirqd/120:53:171
9486992217,3cyclictest25-21ksoftirqd/121:34:401
9486992217,3cyclictest13785-21cron20:24:591
9486992216,4cyclictest25-21ksoftirqd/121:01:521
9486992115,4cyclictest25-21ksoftirqd/119:49:151
9486992014,4cyclictest25-21ksoftirqd/123:25:101
9486991611,3cyclictest12528-21fschecks_time19:15:181
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional