You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-04-03 - 11:41
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4.osadl.org (updated Thu Apr 03, 2025 00:44:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
6171213977,7sleep10-21swapper/119:05:451
6344212464,6sleep00-21swapper/019:08:010
62502113104,6sleep30-21swapper/319:06:473
6326210898,7sleep20-21swapper/219:07:462
316812990,1sleep340-21ksoftirqd/323:50:203
140232640,0sleep20-21swapper/221:39:092
184592620,0sleep10-21swapper/119:15:221
71702610,0sleep00-21swapper/020:00:180
202462600,0sleep30-21swapper/322:00:003
179412600,1sleep117948-21kthreadcore21:05:191
213182580,0sleep30-21swapper/300:02:013
165672570,0sleep00-21swapper/021:20:510
202992530,0sleep30-21swapper/323:10:153
665899348,25cyclictest0-21swapper/022:40:430
665899300,2cyclictest12624-21kworker/0:021:19:010
666599291,22cyclictest0-21swapper/100:05:531
666599281,3cyclictest0-21swapper/120:04:441
666599280,27cyclictest0-21swapper/119:30:451
666599280,20cyclictest0-21swapper/119:40:101
665899280,17cyclictest0-21swapper/023:11:460
666999270,25cyclictest0-21swapper/223:55:242
6665992717,2cyclictest30782-21sadc19:55:011
666599271,19cyclictest0-21swapper/121:15:251
666599270,26cyclictest0-21swapper/122:08:121
666599270,19cyclictest0-21swapper/122:52:421
665899270,4cyclictest0-21swapper/022:19:390
665899270,16cyclictest0-21swapper/022:24:260
666999261,24cyclictest0-21swapper/222:52:212
666999260,25cyclictest0-21swapper/223:35:432
666599260,2cyclictest0-21swapper/123:35:461
666599260,21cyclictest0-21swapper/122:31:061
666599260,20cyclictest0-21swapper/123:20:101
666599260,20cyclictest0-21swapper/123:00:391
666599260,19cyclictest0-21swapper/121:45:181
666599260,19cyclictest0-21swapper/100:14:561
6658992617,5cyclictest10272-21snmpd22:07:570
6658992613,12cyclictest0-21swapper/022:14:560
665899260,25cyclictest0-21swapper/020:30:140
665899260,19cyclictest0-21swapper/023:54:130
666999250,24cyclictest0-21swapper/221:31:572
666999250,24cyclictest0-21swapper/220:29:252
6665992517,1cyclictest10272-21snmpd20:55:441
666599250,2cyclictest0-21swapper/120:54:561
6658992519,5cyclictest16140-21/usr/sbin/munin00:20:190
6658992517,8cyclictest0-21swapper/023:15:060
6658992514,6cyclictest10272-21snmpd00:05:520
665899250,22cyclictest0-21swapper/000:33:570
665899250,1cyclictest6051-21ssh23:36:070
665899250,1cyclictest18118-21ssh23:42:280
665899250,18cyclictest0-21swapper/019:25:190
666999242,21cyclictest0-21swapper/223:06:592
6669992416,6cyclictest0-21swapper/222:46:322
666999240,23cyclictest0-21swapper/222:41:402
666999240,23cyclictest0-21swapper/200:06:102
666999240,18cyclictest0-21swapper/221:49:272
666999240,18cyclictest0-21swapper/200:25:472
666999240,17cyclictest32285-21munin-run21:15:002
666599241,22cyclictest0-21swapper/120:12:161
666599240,1cyclictest0-21swapper/122:40:551
666599240,18cyclictest0-21swapper/122:56:131
665899243,17cyclictest0-21swapper/021:59:210
6658992416,7cyclictest0-21swapper/021:46:420
6658992416,7cyclictest0-21swapper/000:38:110
6658992416,5cyclictest10272-21snmpd23:00:120
6658992415,6cyclictest10272-21snmpd19:18:070
665899240,6cyclictest0-21swapper/021:34:300
665899240,4cyclictest0-21swapper/023:48:590
665899240,20cyclictest0-21swapper/000:00:480
665899240,1cyclictest53450irq/24-enp1s021:44:160
665899240,17cyclictest0-21swapper/022:45:480
665899240,13cyclictest0-21swapper/022:27:570
665899240,13cyclictest0-21swapper/022:27:560
666999237,14cyclictest0-21swapper/223:15:172
666999232,20cyclictest0-21swapper/223:28:242
666999232,20cyclictest0-21swapper/222:31:382
666999232,20cyclictest0-21swapper/222:14:312
666999232,20cyclictest0-21swapper/200:10:322
666999232,15cyclictest0-21swapper/221:25:192
666999230,22cyclictest0-21swapper/222:39:312
666999230,22cyclictest0-21swapper/200:00:232
666999230,17cyclictest0-21swapper/223:00:492
666999230,17cyclictest0-21swapper/222:20:352
666599231,3cyclictest0-21swapper/120:15:111
666599231,21cyclictest0-21swapper/119:45:331
666599231,21cyclictest0-21swapper/119:23:271
666599230,22cyclictest0-21swapper/119:27:431
665899238,11cyclictest0-21swapper/000:26:450
6658992317,5cyclictest10272-21snmpd20:38:040
6658992317,5cyclictest10272-21snmpd19:59:400
6658992312,1cyclictest10272-21snmpd19:35:190
665899230,22cyclictest0-21swapper/022:53:040
665899230,22cyclictest0-21swapper/022:39:220
665899230,22cyclictest0-21swapper/022:00:350
665899230,22cyclictest0-21swapper/021:52:200
665899230,22cyclictest0-21swapper/021:25:020
665899230,22cyclictest0-21swapper/000:15:570
665899230,21cyclictest0-21swapper/023:26:340
665899230,21cyclictest0-21swapper/023:05:390
665899230,17cyclictest0-21swapper/021:13:190
665899230,14cyclictest0-21swapper/023:55:130
665899230,11cyclictest0-21swapper/022:32:190
666999226,15cyclictest0-21swapper/221:53:052
6669992219,3cyclictest0-21swapper/223:30:362
6669992218,3cyclictest0-21swapper/223:49:522
6669992218,3cyclictest0-21swapper/221:20:142
666999221,3cyclictest0-21swapper/200:23:552
666999221,20cyclictest0-21swapper/223:50:042
666999220,21cyclictest0-21swapper/223:40:082
666999220,21cyclictest0-21swapper/222:04:452
666999220,21cyclictest0-21swapper/221:15:492
666999220,21cyclictest0-21swapper/220:16:112
666999220,21cyclictest0-21swapper/200:36:062
666999220,16cyclictest0-21swapper/223:20:332
666999220,16cyclictest0-21swapper/222:17:022
666999220,16cyclictest0-21swapper/221:44:322
666599221,20cyclictest0-21swapper/120:06:411
666599221,20cyclictest0-21swapper/119:55:371
666599220,21cyclictest0-21swapper/123:50:501
666599220,21cyclictest0-21swapper/122:14:001
666599220,21cyclictest0-21swapper/121:29:071
6658992217,5cyclictest0-21swapper/022:59:490
6658992215,6cyclictest10272-21snmpd19:30:450
6658992215,4cyclictest53450irq/24-enp1s000:10:390
6658992212,7cyclictest10272-21snmpd19:24:570
665899220,21cyclictest0-21swapper/023:20:490
665899220,21cyclictest0-21swapper/021:35:200
665899220,21cyclictest0-21swapper/020:29:290
665899220,21cyclictest0-21swapper/020:08:280
665899220,18cyclictest0-21swapper/023:30:170
66192220,0sleep20-21swapper/200:15:032
6669992117,3cyclictest0-21swapper/222:28:392
6669992117,3cyclictest0-21swapper/222:28:382
666999210,3cyclictest0-21swapper/219:45:482
666999210,21cyclictest0-21swapper/219:56:402
666999210,20cyclictest0-21swapper/223:13:192
666999210,20cyclictest0-21swapper/221:57:332
666999210,20cyclictest0-21swapper/219:52:172
666999210,20cyclictest0-21swapper/200:30:112
666999210,19cyclictest0-21swapper/222:55:072
666999210,15cyclictest0-21swapper/222:07:252
6665992117,3cyclictest0-21swapper/122:23:121
6665992116,3cyclictest0-21swapper/120:38:241
666599210,20cyclictest0-21swapper/123:07:491
666599210,20cyclictest0-21swapper/122:25:331
666599210,20cyclictest0-21swapper/122:25:321
666599210,20cyclictest0-21swapper/121:37:171
666599210,20cyclictest0-21swapper/121:30:231
666599210,20cyclictest0-21swapper/121:20:591
666599210,20cyclictest0-21swapper/120:46:041
666599210,20cyclictest0-21swapper/120:31:411
666599210,20cyclictest0-21swapper/120:23:161
666599210,20cyclictest0-21swapper/119:14:301
666599210,20cyclictest0-21swapper/100:22:101
6658992115,5cyclictest10272-21snmpd20:10:490
6658992114,5cyclictest10272-21snmpd19:51:200
665899210,20cyclictest0-21swapper/019:44:540
3064722117,3sleep30-21swapper/319:53:293
666999206,13cyclictest0-21swapper/220:35:242
6669992018,1cyclictest10272-21snmpd20:41:322
6669992018,1cyclictest10272-21snmpd20:33:442
6669992018,1cyclictest10272-21snmpd20:01:192
6669992017,3cyclictest0-21swapper/220:56:052
6669992017,3cyclictest0-21swapper/219:10:002
6669992016,3cyclictest0-21swapper/221:04:522
666999201,3cyclictest0-21swapper/220:50:152
666999200,20cyclictest0-21swapper/219:39:002
6665992017,3cyclictest0-21swapper/121:02:341
6665992017,2cyclictest4930-21gltestperf23:55:161
666599200,2cyclictest0-21swapper/122:18:411
666599200,20cyclictest0-21swapper/122:00:081
666599200,19cyclictest0-21swapper/123:43:161
666599200,19cyclictest0-21swapper/121:54:141
666599200,19cyclictest0-21swapper/120:42:561
666599200,19cyclictest0-21swapper/119:35:181
6658992018,1cyclictest10272-21snmpd20:59:250
6658992018,1cyclictest10272-21snmpd20:21:310
6658992018,1cyclictest10272-21snmpd19:45:180
6658992017,2cyclictest10272-21snmpd20:15:110
665899200,19cyclictest0-21swapper/019:10:170
666999194,14cyclictest0-21swapper/219:15:172
6669991917,1cyclictest10272-21snmpd19:26:242
6665991916,3cyclictest0-21swapper/122:46:011
6665991916,2cyclictest10272-21snmpd21:42:081
6665991915,3cyclictest0-21swapper/122:37:351
6665991915,2cyclictest10272-21snmpd23:12:521
666599190,1cyclictest0-21swapper/100:15:141
666599190,18cyclictest0-21swapper/121:55:481
6658991917,1cyclictest10272-21snmpd21:05:440
6658991917,1cyclictest10272-21snmpd21:00:070
6658991913,4cyclictest10272-21snmpd20:54:560
666999183,14cyclictest0-21swapper/221:07:382
666999183,14cyclictest0-21swapper/220:20:232
6669991816,2cyclictest0-21swapper/219:41:102
666999181,11cyclictest0-21swapper/220:06:432
6665991817,1cyclictest0-21swapper/121:11:341
666599180,4cyclictest0-21swapper/123:33:581
666599180,17cyclictest0-21swapper/123:25:351
666599180,17cyclictest0-21swapper/100:35:041
666599180,17cyclictest0-21swapper/100:27:461
6658991816,1cyclictest10272-21snmpd20:43:380
666999172,14cyclictest0-21swapper/219:20:252
6669991715,1cyclictest10272-21snmpd20:14:132
6669991714,2cyclictest10272-21snmpd19:31:212
666999170,16cyclictest0-21swapper/220:45:162
6665991715,2cyclictest0-21swapper/123:46:441
6665991714,2cyclictest0-21swapper/120:27:201
6665991714,2cyclictest0-21swapper/100:03:361
666599170,3cyclictest0-21swapper/100:30:521
666599170,16cyclictest0-21swapper/123:16:411
6658991715,1cyclictest10272-21snmpd20:49:460
97542166,3sleep30-21swapper/320:00:293
35362160,1sleep30-21swapper/319:30:223
2480121610,3sleep30-21swapper/321:28:493
18972159,3sleep30-21swapper/322:08:303
180192153,3sleep30-21swapper/323:42:243
115232159,3sleep30-21swapper/323:20:523
230042148,3sleep30-21swapper/322:54:173
1289721410,3sleep30-21swapper/319:37:113
122632148,3sleep30-21swapper/300:15:293
295492137,3sleep30-21swapper/323:32:463
292412137,3sleep30-21swapper/321:12:033
267072139,3sleep30-21swapper/319:20:423
255782131,3sleep30-21swapper/300:25:423
205602139,3sleep30-21swapper/319:17:443
9632128,3sleep30-21swapper/320:22:333
41092126,3sleep30-21swapper/300:32:513
310022120,2sleep331006-21apt-get19:55:103
258882127,2sleep30-21swapper/322:36:073
244152126,3sleep30-21swapper/320:41:343
16842120,3sleep30-21swapper/322:59:583
159842123,3sleep30-21swapper/321:05:093
135872120,3sleep30-21swapper/300:37:393
128282128,3sleep30-21swapper/320:34:143
12592126,3sleep30-21swapper/320:25:003
55182115,3sleep30-21swapper/322:42:313
53662110,3sleep35382-21ssh23:35:273
3212117,3sleep30-21swapper/319:27:573
275482117,3sleep30-21swapper/320:17:513
233572115,3sleep30-21swapper/323:47:243
217302117,3sleep30-21swapper/320:13:233
192612117,3sleep30-21swapper/319:45:033
136372115,3sleep30-21swapper/322:14:403
122282110,3sleep30-21swapper/321:37:273
107262110,2sleep30-21swapper/323:56:383
56292104,3sleep30-21swapper/322:27:303
56292104,3sleep30-21swapper/322:27:293
39692104,3sleep30-21swapper/320:55:013
34882100,5sleep30-21swapper/300:11:353
307712106,3sleep30-21swapper/320:50:073
307452104,3sleep30-21swapper/321:49:323
245962101,5sleep30-21swapper/300:05:193
190052106,3sleep30-21swapper/319:44:403
186002104,3sleep30-21swapper/323:27:263
158342100,1sleep30-21swapper/323:08:543
155492106,3sleep30-21swapper/321:02:293
122362106,3sleep30-21swapper/319:12:043
103392104,3sleep30-21swapper/323:03:193
9001292,4sleep30-21swapper/322:45:443
5303293,3sleep30-21swapper/321:51:013
30347290,3sleep30-21swapper/320:47:323
27509293,3sleep30-21swapper/323:15:043
24032294,3sleep30-21swapper/300:23:343
22633293,3sleep30-21swapper/321:41:463
18718294,3sleep30-21swapper/321:23:013
18666296,2sleep30-21swapper/320:38:223
14638293,3sleep30-21swapper/322:30:543
10333295,3sleep30-21swapper/320:05:033
6556282,3sleep30-21swapper/321:16:153
27809281,4sleep30-21swapper/322:02:143
26379281,4sleep30-21swapper/321:30:093
25182281,4sleep30-21swapper/322:20:163
20811281,4sleep30-21swapper/322:16:163
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional