You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-27 - 14:23
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackdslot3.osadl.org (updated Sat Jul 27, 2024 00:46:29)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
8255912020,7ptp4l401ktimersoftd/319:06:443
109672156105,38sleep10-21swapper/119:05:381
50121330,2sleep30-21swapper/300:30:113
1116829171,10sleep00-21swapper/019:08:170
7782890,8sleep31159099cyclictest23:20:203
57698860,15rtkit-daemon0-21swapper/219:08:192
825791680,8getstats1159099cyclictest23:34:363
164562670,4sleep0101ktimersoftd/019:20:130
11590996455,5cyclictest41-21ksoftirqd/322:55:123
825591620,1ptp4l401ktimersoftd/323:06:503
825591550,1ptp4l401ktimersoftd/319:41:323
205182500,5sleep233-21ksoftirqd/221:45:082
234842484,5sleep2121rcu_preempt20:40:342
825591460,1ptp4l401ktimersoftd/321:22:513
11587994540,3cyclictest9-21ksoftirqd/021:59:590
1159099442,39cyclictest9140-21cron23:40:003
11588994437,5cyclictest25-21ksoftirqd/123:45:001
825791430,2getstats0-21swapper/323:19:373
124932430,4sleep01158799cyclictest20:20:110
11589994323,5cyclictest33-21ksoftirqd/200:14:122
825591420,1ptp4l401ktimersoftd/321:05:233
11590994236,3cyclictest41-21ksoftirqd/321:00:003
11590994227,8cyclictest41-21ksoftirqd/322:50:083
11588994235,4cyclictest25-21ksoftirqd/121:00:001
825591410,1ptp4l401ktimersoftd/321:26:373
11590994135,3cyclictest41-21ksoftirqd/321:20:003
11590994135,3cyclictest41-21ksoftirqd/319:40:003
11590994126,9cyclictest41-21ksoftirqd/321:50:123
11588994134,4cyclictest25-21ksoftirqd/122:45:091
11587994136,3cyclictest9-21ksoftirqd/021:20:000
825591400,1ptp4l401ktimersoftd/321:30:333
11590994025,8cyclictest41-21ksoftirqd/323:25:093
825591390,1ptp4l401ktimersoftd/323:40:163
825591390,1ptp4l401ktimersoftd/300:15:203
11590993933,4cyclictest41-21ksoftirqd/320:00:003
11590993933,3cyclictest41-21ksoftirqd/320:54:593
11590993932,5cyclictest41-21ksoftirqd/320:39:143
11590993921,10cyclictest41-21ksoftirqd/322:30:113
11588993933,3cyclictest25-21ksoftirqd/120:55:001
11588993932,4cyclictest25-21ksoftirqd/122:42:211
11587993934,3cyclictest9-21ksoftirqd/023:20:000
11590993831,4cyclictest41-21ksoftirqd/320:34:393
11590993831,4cyclictest41-21ksoftirqd/300:25:213
11590993830,5cyclictest41-21ksoftirqd/321:56:413
11590993830,5cyclictest41-21ksoftirqd/320:01:193
11589993831,4cyclictest33-21ksoftirqd/221:37:002
11589993831,4cyclictest33-21ksoftirqd/220:16:592
11588993832,3cyclictest25-21ksoftirqd/120:35:011
11588993831,4cyclictest25-21ksoftirqd/122:30:371
11588993831,4cyclictest25-21ksoftirqd/121:38:041
11588993831,4cyclictest25-21ksoftirqd/120:37:361
11588993830,5cyclictest25-21ksoftirqd/121:35:001
11587993831,4cyclictest9-21ksoftirqd/020:35:050
11587993830,5cyclictest9-21ksoftirqd/023:10:000
11590993731,4cyclictest41-21ksoftirqd/300:39:223
11590993731,3cyclictest41-21ksoftirqd/300:20:193
11590993729,5cyclictest41-21ksoftirqd/321:48:233
11590993729,5cyclictest41-21ksoftirqd/320:49:213
11589993731,4cyclictest33-21ksoftirqd/219:34:142
11589993731,4cyclictest33-21ksoftirqd/219:34:132
11589993730,4cyclictest33-21ksoftirqd/221:33:572
11588993732,3cyclictest25-21ksoftirqd/122:40:001
11588993731,4cyclictest25-21ksoftirqd/121:47:191
11588993731,3cyclictest25-21ksoftirqd/123:12:131
11588993731,3cyclictest25-21ksoftirqd/120:20:171
11588993730,4cyclictest25-21ksoftirqd/119:59:481
11588993730,4cyclictest25-21ksoftirqd/119:39:521
173952360,4sleep3401ktimersoftd/321:36:183
11590993631,3cyclictest41-21ksoftirqd/323:50:003
11590993630,4cyclictest41-21ksoftirqd/322:35:243
11590993630,4cyclictest14875-21kworker/3:122:45:323
11590993630,3cyclictest41-21ksoftirqd/320:11:463
11590993630,3cyclictest41-21ksoftirqd/319:50:133
11590993629,4cyclictest41-21ksoftirqd/323:03:313
11590993629,4cyclictest41-21ksoftirqd/321:15:013
11590993628,5cyclictest41-21ksoftirqd/319:24:413
11589993630,4cyclictest33-21ksoftirqd/222:50:092
11589993630,4cyclictest33-21ksoftirqd/221:25:492
11589993630,4cyclictest33-21ksoftirqd/220:45:112
11589993629,4cyclictest33-21ksoftirqd/223:47:542
11589993629,4cyclictest33-21ksoftirqd/223:09:262
11589993629,4cyclictest33-21ksoftirqd/222:44:582
11589993629,4cyclictest33-21ksoftirqd/222:07:492
11589993629,4cyclictest33-21ksoftirqd/220:09:472
11588993631,3cyclictest25-21ksoftirqd/100:00:481
11588993630,3cyclictest25-21ksoftirqd/123:30:221
11588993630,3cyclictest25-21ksoftirqd/119:54:351
11588993630,3cyclictest25-21ksoftirqd/119:49:531
11588993629,4cyclictest25-21ksoftirqd/122:59:431
11588993629,4cyclictest25-21ksoftirqd/122:22:251
11588993629,4cyclictest25-21ksoftirqd/122:22:251
11588993629,4cyclictest25-21ksoftirqd/120:49:421
11588993629,4cyclictest25-21ksoftirqd/120:01:091
11588993629,4cyclictest25-21ksoftirqd/119:31:331
11588993629,4cyclictest25-21ksoftirqd/119:31:321
11588993629,4cyclictest25-21ksoftirqd/100:29:131
11587993630,4cyclictest9-21ksoftirqd/023:25:200
11587993630,3cyclictest9-21ksoftirqd/022:03:150
1158799360,4cyclictest121rcu_preempt00:00:010
825591350,1ptp4l401ktimersoftd/323:10:183
825591350,1ptp4l401ktimersoftd/320:08:273
825591350,1ptp4l401ktimersoftd/319:47:573
11590993530,3cyclictest41-21ksoftirqd/320:29:593
11590993529,4cyclictest41-21ksoftirqd/319:14:293
11590993529,4cyclictest41-21ksoftirqd/300:09:323
11590993529,3cyclictest41-21ksoftirqd/320:20:033
11590993528,4cyclictest41-21ksoftirqd/322:04:203
11590993528,4cyclictest41-21ksoftirqd/321:45:003
11590993528,4cyclictest41-21ksoftirqd/320:16:253
11590993528,4cyclictest41-21ksoftirqd/300:05:013
11590993527,6cyclictest41-21ksoftirqd/323:50:243
11590993527,6cyclictest41-21ksoftirqd/323:50:233
11589993529,3cyclictest33-21ksoftirqd/222:36:592
11589993528,5cyclictest33-21ksoftirqd/219:22:112
11589993528,4cyclictest33-21ksoftirqd/223:59:122
11589993528,4cyclictest33-21ksoftirqd/222:58:202
11589993528,4cyclictest33-21ksoftirqd/220:12:262
11589993528,4cyclictest33-21ksoftirqd/220:00:342
11589993528,4cyclictest33-21ksoftirqd/219:45:522
11589993528,4cyclictest33-21ksoftirqd/200:04:372
11589993527,5cyclictest33-21ksoftirqd/220:37:112
11588993529,4cyclictest25-21ksoftirqd/123:38:301
11588993529,4cyclictest25-21ksoftirqd/122:15:161
11588993529,4cyclictest25-21ksoftirqd/120:10:031
11588993529,4cyclictest25-21ksoftirqd/100:20:531
11588993528,5cyclictest25-21ksoftirqd/100:05:311
11588993528,4cyclictest25-21ksoftirqd/122:12:201
11588993528,4cyclictest25-21ksoftirqd/121:58:321
11588993528,4cyclictest25-21ksoftirqd/119:16:561
11588993527,5cyclictest25-21ksoftirqd/121:43:351
11587993530,3cyclictest9-21ksoftirqd/022:45:240
11587993530,3cyclictest9-21ksoftirqd/022:15:210
11587993530,3cyclictest9-21ksoftirqd/021:35:290
11587993530,3cyclictest9-21ksoftirqd/021:10:300
11587993530,3cyclictest9-21ksoftirqd/020:17:380
11587993530,3cyclictest9-21ksoftirqd/019:49:140
11587993529,4cyclictest9-21ksoftirqd/022:30:300
11587993529,4cyclictest9-21ksoftirqd/019:50:090
11587993529,3cyclictest9-21ksoftirqd/000:00:300
11587993528,4cyclictest9-21ksoftirqd/023:00:060
11587993528,4cyclictest9-21ksoftirqd/022:40:580
11587993528,4cyclictest9-21ksoftirqd/019:59:350
11587993528,4cyclictest9-21ksoftirqd/000:17:330
825591340,1ptp4l401ktimersoftd/319:19:193
11590993428,4cyclictest41-21ksoftirqd/300:15:003
11590993428,3cyclictest41-21ksoftirqd/321:00:253
11590993428,3cyclictest41-21ksoftirqd/321:00:243
11589993428,4cyclictest33-21ksoftirqd/221:13:282
11589993428,3cyclictest33-21ksoftirqd/223:00:512
11589993427,4cyclictest33-21ksoftirqd/223:22:532
11589993427,4cyclictest33-21ksoftirqd/222:19:072
11589993427,4cyclictest33-21ksoftirqd/221:05:102
11589993427,4cyclictest33-21ksoftirqd/220:51:292
11589993427,4cyclictest33-21ksoftirqd/200:08:022
11588993428,3cyclictest25-21ksoftirqd/121:23:321
11588993427,4cyclictest25-21ksoftirqd/123:56:361
11588993427,4cyclictest25-21ksoftirqd/121:25:451
11588993427,4cyclictest25-21ksoftirqd/121:11:021
11588993427,4cyclictest25-21ksoftirqd/100:33:461
11588993427,4cyclictest206-21systemd-journal23:10:011
11587993429,3cyclictest9-21ksoftirqd/021:40:350
11587993429,3cyclictest9-21ksoftirqd/020:25:280
11587993429,3cyclictest9-21ksoftirqd/019:15:220
11587993428,4cyclictest9-21ksoftirqd/022:54:440
11587993428,3cyclictest9-21ksoftirqd/019:10:440
1158799341,11cyclictest30764-21grep20:55:320
825591330,7ptp4l0-21swapper/319:25:383
825591330,1ptp4l401ktimersoftd/322:17:553
825591330,1ptp4l401ktimersoftd/320:40:253
11590993327,4cyclictest41-21ksoftirqd/323:59:403
11590993327,4cyclictest41-21ksoftirqd/322:10:193
11589993328,3cyclictest33-21ksoftirqd/220:28:572
11589993327,4cyclictest33-21ksoftirqd/223:52:262
11589993327,4cyclictest33-21ksoftirqd/223:52:252
11589993327,4cyclictest33-21ksoftirqd/222:12:002
11589993327,4cyclictest33-21ksoftirqd/220:23:292
11589993327,4cyclictest33-21ksoftirqd/219:56:532
11589993327,3cyclictest4713-21runrttasks22:20:132
11589993327,3cyclictest4713-21runrttasks22:20:132
11589993327,3cyclictest33-21ksoftirqd/219:41:362
11589993327,3cyclictest33-21ksoftirqd/219:17:232
11589993327,3cyclictest33-21ksoftirqd/200:35:032
11589993326,4cyclictest33-21ksoftirqd/222:46:322
11589993326,4cyclictest33-21ksoftirqd/221:15:592
11589993326,4cyclictest33-21ksoftirqd/220:57:322
11589993326,4cyclictest33-21ksoftirqd/200:30:542
11589993326,4cyclictest33-21ksoftirqd/200:21:592
11589993325,5cyclictest33-21ksoftirqd/221:22:122
11589993317,13cyclictest17856-21sh20:30:212
11588993327,3cyclictest25-21ksoftirqd/123:28:331
11588993326,4cyclictest25-21ksoftirqd/123:00:521
11588993326,4cyclictest25-21ksoftirqd/121:01:401
11588993326,4cyclictest25-21ksoftirqd/121:01:391
11588993326,4cyclictest25-21ksoftirqd/120:26:221
11588993326,4cyclictest25-21ksoftirqd/100:12:191
11587993328,3cyclictest9-21ksoftirqd/020:45:300
11587993327,4cyclictest9-21ksoftirqd/023:30:310
11587993327,4cyclictest9-21ksoftirqd/023:14:160
11587993327,4cyclictest9-21ksoftirqd/022:35:270
11587993327,4cyclictest9-21ksoftirqd/019:40:210
11587993327,4cyclictest9-21ksoftirqd/000:38:590
11587993327,3cyclictest9-21ksoftirqd/021:22:060
11587993327,3cyclictest9-21ksoftirqd/020:09:090
11587993326,4cyclictest9-21ksoftirqd/023:49:330
11587993326,4cyclictest9-21ksoftirqd/021:02:110
11587993326,4cyclictest9-21ksoftirqd/021:02:100
11590993225,4cyclictest41-21ksoftirqd/322:44:163
11590993225,4cyclictest41-21ksoftirqd/322:21:113
11590993225,4cyclictest41-21ksoftirqd/322:21:103
11589993226,4cyclictest33-21ksoftirqd/221:53:292
11589993226,3cyclictest33-21ksoftirqd/223:33:512
11589993226,3cyclictest33-21ksoftirqd/221:56:592
11589993225,4cyclictest33-21ksoftirqd/223:39:192
11589993225,4cyclictest33-21ksoftirqd/223:10:232
11589993225,4cyclictest33-21ksoftirqd/222:33:002
11588993226,4cyclictest25-21ksoftirqd/122:03:311
11588993226,4cyclictest25-21ksoftirqd/120:07:511
11588993226,3cyclictest25-21ksoftirqd/122:25:421
11587993227,3cyclictest9-21ksoftirqd/022:05:290
11587993227,3cyclictest9-21ksoftirqd/019:38:190
11587993226,4cyclictest9-21ksoftirqd/021:09:490
11587993226,4cyclictest9-21ksoftirqd/000:05:220
11587993225,4cyclictest9-21ksoftirqd/023:35:510
11587993225,4cyclictest9-21ksoftirqd/020:03:130
825591310,1ptp4l401ktimersoftd/322:05:573
11590993126,3cyclictest41-21ksoftirqd/319:34:363
11590993126,3cyclictest41-21ksoftirqd/319:34:363
11590993124,4cyclictest41-21ksoftirqd/322:28:333
11589993125,4cyclictest33-21ksoftirqd/219:50:542
11589993125,4cyclictest33-21ksoftirqd/200:18:412
11589993125,3cyclictest33-21ksoftirqd/223:29:062
11589993125,3cyclictest33-21ksoftirqd/222:28:232
11589993124,4cyclictest33-21ksoftirqd/221:42:412
11589993124,4cyclictest33-21ksoftirqd/219:27:322
11589993124,4cyclictest33-21ksoftirqd/200:29:262
11588993125,4cyclictest25-21ksoftirqd/123:50:291
11588993125,4cyclictest25-21ksoftirqd/123:50:291
11588993125,4cyclictest25-21ksoftirqd/119:14:511
11588993124,4cyclictest25-21ksoftirqd/121:08:101
11588993124,4cyclictest25-21ksoftirqd/119:21:421
11587993125,4cyclictest9-21ksoftirqd/022:27:090
11587993125,4cyclictest9-21ksoftirqd/021:30:570
11587993124,5cyclictest9-21ksoftirqd/023:20:420
11587993124,4cyclictest9-21ksoftirqd/023:51:060
11587993124,4cyclictest9-21ksoftirqd/023:51:050
11587993124,4cyclictest9-21ksoftirqd/021:53:300
11589993023,4cyclictest33-21ksoftirqd/219:13:222
11589993022,5cyclictest33-21ksoftirqd/221:04:582
11589993022,5cyclictest33-21ksoftirqd/221:04:582
11588993024,4cyclictest25-21ksoftirqd/123:21:541
11588993024,4cyclictest25-21ksoftirqd/121:19:011
11588993024,4cyclictest25-21ksoftirqd/100:17:081
11588993023,4cyclictest25-21ksoftirqd/100:37:441
11587993025,3cyclictest9-21ksoftirqd/022:20:300
11587993025,3cyclictest9-21ksoftirqd/022:20:300
11587993025,3cyclictest9-21ksoftirqd/021:45:300
11587993024,3cyclictest9-21ksoftirqd/000:12:550
11587993023,4cyclictest9-21ksoftirqd/022:59:540
11587993023,4cyclictest9-21ksoftirqd/020:43:030
11587993023,4cyclictest9-21ksoftirqd/000:28:390
11589992924,3cyclictest33-21ksoftirqd/219:38:062
11589992922,4cyclictest33-21ksoftirqd/223:42:122
11588992923,3cyclictest25-21ksoftirqd/119:25:171
11588992922,5cyclictest25-21ksoftirqd/122:54:451
11587992923,4cyclictest9-21ksoftirqd/019:30:490
11587992923,4cyclictest9-21ksoftirqd/019:30:490
11587992923,3cyclictest9-21ksoftirqd/000:21:070
1158999280,26cyclictest0-21swapper/223:15:312
11588992822,3cyclictest25-21ksoftirqd/123:49:021
11587992822,4cyclictest9-21ksoftirqd/023:41:180
11588992720,4cyclictest25-21ksoftirqd/122:07:241
11587992722,3cyclictest9-21ksoftirqd/000:30:270
11587992721,4cyclictest9-21ksoftirqd/020:11:120
11587992721,3cyclictest9-21ksoftirqd/020:34:080
11587992721,3cyclictest9-21ksoftirqd/019:28:570
11587992720,4cyclictest9-21ksoftirqd/022:13:050
11587992720,4cyclictest9-21ksoftirqd/020:51:090
11589992619,4cyclictest33-21ksoftirqd/222:02:252
11588992620,4cyclictest25-21ksoftirqd/120:18:161
11587992619,4cyclictest9-21ksoftirqd/021:26:230
11588992519,3cyclictest25-21ksoftirqd/123:15:031
11588992518,4cyclictest25-21ksoftirqd/119:40:011
11588992418,4cyclictest25-21ksoftirqd/120:43:081
11588992318,3cyclictest25-21ksoftirqd/121:54:331
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional