You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-11-22 - 08:38
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot0.osadl.org (updated Fri Nov 22, 2024 00:45:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1372921650,0sleep00-21swapper/000:26:420
1372921650,0sleep00-21swapper/000:26:420
1069721520,3sleep51244299cyclictest23:18:445
191821410,1sleep61909-21sshd23:14:276
2478721280,0sleep60-21swapper/622:16:166
2191521280,0sleep521916-21sshd00:17:265
2191521280,0sleep521916-21sshd00:17:265
1501321210,1sleep215012-21sshd23:46:142
256021190,0sleep30-21swapper/322:23:583
2649421180,0sleep60-21swapper/600:11:026
2649421180,0sleep60-21swapper/600:11:016
2448821180,2sleep41243499cyclictest21:56:514
940721110,4sleep71245599cyclictest22:34:457
940721110,4sleep71245599cyclictest22:34:447
3146721110,1sleep30-21swapper/322:07:153
1112721110,0sleep50-21swapper/522:28:095
119132980,0sleep70-21swapper/722:18:177
214822950,0sleep30-21swapper/300:14:043
214822950,0sleep30-21swapper/300:14:033
214932890,0sleep40-21swapper/422:12:454
264712880,0sleep10-21swapper/100:21:151
139972870,5sleep21242199cyclictest00:09:532
216272850,1sleep70-21swapper/723:33:197
187052850,0sleep10-21swapper/123:19:361
62922840,0sleep3401rcuc/323:48:463
198432830,0sleep70-21swapper/722:55:527
126912830,0sleep40-21swapper/422:15:114
294902820,1sleep51049-21sshd23:51:065
257872820,0sleep60-21swapper/623:06:426
224822820,0sleep60-21swapper/623:26:376
67202810,1sleep61037-21runrttasks22:41:026
67202810,1sleep61037-21runrttasks22:41:026
33752810,0sleep10-21swapper/122:54:181
33752810,0sleep10-21swapper/122:54:181
301132790,0sleep20-21swapper/221:54:162
209042790,0sleep20-21swapper/222:42:342
209042790,0sleep20-21swapper/222:42:332
135942780,0sleep60-21swapper/622:02:146
122052780,0sleep70-21swapper/723:35:367
319092760,0sleep20-21swapper/222:17:002
301102750,0sleep40-21swapper/423:37:344
184582750,0sleep10-21swapper/121:20:421
184582750,0sleep10-21swapper/121:20:411
196302740,0sleep40-21swapper/422:35:394
92362730,0sleep00-21swapper/021:23:040
92362730,0sleep00-21swapper/021:23:040
30622720,0sleep60-21swapper/600:05:166
229522720,1sleep222951-21sshd21:34:122
6442710,0sleep10-21swapper/121:57:431
44392710,1sleep0121rcuc/021:58:080
262302710,0sleep10-21swapper/123:00:041
240882710,1sleep4501ktimersoftd/423:03:114
236882700,0sleep00-21swapper/021:43:560
143302680,0sleep30-21swapper/321:46:083
260072640,1sleep10-21swapper/122:33:021
260072640,1sleep10-21swapper/122:33:021
195832630,1sleep6681ktimersoftd/623:53:306
46952590,0sleep30-21swapper/321:29:093
142302590,3sleep11241499cyclictest23:25:441
1204225948,7sleep70-21swapper/719:08:137
114882580,0sleep00-21swapper/022:08:320
1209725746,7sleep60-21swapper/619:08:526
1014125737,6sleep00-21swapper/019:05:010
155242560,0sleep30-21swapper/300:03:143
1205825545,6sleep50-21swapper/519:08:275
1205425545,6sleep10-21swapper/119:08:231
88132510,1sleep01240999cyclictest23:15:100
1211225129,7sleep30-21swapper/319:09:053
63912500,0sleep70-21swapper/722:37:417
168522500,0sleep70-21swapper/723:49:557
203682490,4sleep21242199cyclictest23:29:542
308332480,0sleep00-21swapper/000:18:260
308332480,0sleep00-21swapper/000:18:260
175742460,0sleep30-21swapper/321:23:553
175742460,0sleep30-21swapper/321:23:553
143882450,0sleep40-21swapper/400:03:064
122522450,0sleep50-21swapper/500:06:115
1187824527,14sleep20-21swapper/219:06:072
1216924434,6sleep40-21swapper/419:09:464
289792410,0sleep70-21swapper/700:35:157
266892390,0sleep60-21swapper/622:23:066
125402390,0sleep70-21swapper/700:16:237
125402390,0sleep70-21swapper/700:16:237
92872350,0sleep60-21swapper/623:49:066
139632340,3sleep71245599cyclictest22:08:497
18682320,1sleep71037-21runrttasks22:54:087
18682320,1sleep71037-21runrttasks22:54:087
56752300,0sleep40-21swapper/423:18:104
201702300,1sleep60-21swapper/623:33:106
17012270,0sleep70-21swapper/721:35:137
105332270,1sleep210536-21bash22:08:272
114402260,1sleep611393-21sshd21:52:196
21032230,0sleep32104-21grep23:21:053
47172220,0sleep50-21swapper/523:01:035
242842210,1sleep30-21swapper/323:57:203
101342210,4sleep51244299cyclictest21:23:095
101342210,4sleep51244299cyclictest21:23:095
319872200,0sleep2311rcuc/200:11:382
319872200,0sleep2311rcuc/200:11:372
235222200,1sleep4491rcuc/400:31:124
176132200,0sleep40-21swapper/421:20:364
176132200,0sleep40-21swapper/421:20:364
1242199200,1cyclictest0-21swapper/200:25:162
1242199200,1cyclictest0-21swapper/200:25:152
1242199200,1cyclictest0-21swapper/200:24:192
120092200,1sleep081ktimersoftd/023:08:440
86192190,0sleep6681ktimersoftd/621:35:546
208992190,0sleep40-21swapper/421:46:484
83682180,0sleep6671rcuc/621:45:306
29102180,1sleep52904-21sshd21:32:085
1242199180,16cyclictest6871-21sshd23:11:292
1242799170,15cyclictest0-21swapper/322:33:363
1242799170,15cyclictest0-21swapper/322:33:363
1241499171,2cyclictest0-21swapper/123:23:021
110842170,0sleep20-21swapper/221:42:392
37422160,0sleep20-21swapper/223:04:302
31592160,0sleep10-21swapper/122:44:091
31592160,0sleep10-21swapper/122:44:081
1245599160,14cyclictest0-21swapper/723:19:327
1244899160,14cyclictest5207-21sshd23:55:196
1244899160,14cyclictest0-21swapper/600:20:426
1242799160,15cyclictest0-21swapper/323:19:283
1242799160,15cyclictest0-21swapper/322:18:133
1240999166,5cyclictest4764-21perf23:35:010
12409991612,2cyclictest17142-21munin-run19:20:000
282942150,0sleep00-21swapper/023:44:110
265722150,0sleep30-21swapper/321:50:333
1245599150,14cyclictest26836-21sshd00:04:287
1245599150,14cyclictest0-21swapper/723:25:327
1245599150,13cyclictest0-21swapper/722:48:007
1245599150,13cyclictest0-21swapper/700:07:177
1244899150,14cyclictest0-21swapper/623:40:346
1244899150,13cyclictest0-21swapper/600:36:166
1242799150,13cyclictest672-21systemd-logind00:28:543
1242799150,13cyclictest672-21systemd-logind00:28:543
1242199150,13cyclictest0-21swapper/221:28:222
1242199150,12cyclictest0-21swapper/220:21:482
1242199150,12cyclictest0-21swapper/220:10:532
12414991511,2cyclictest0-21swapper/122:10:461
1241499150,14cyclictest0-21swapper/122:15:511
1241499150,13cyclictest0-21swapper/121:44:101
12455991411,2cyclictest0-21swapper/722:21:067
12455991411,1cyclictest0-21swapper/721:50:207
1245599140,12cyclictest24813-21sshd23:10:047
12448991410,2cyclictest0-21swapper/621:15:596
1244899140,12cyclictest589-21gdbus22:38:066
1244899140,12cyclictest463-21systemd-journal23:35:306
1244899140,12cyclictest0-21swapper/623:24:056
12442991412,1cyclictest0-21swapper/522:04:015
1244299140,2cyclictest0-21swapper/521:14:355
1244299140,12cyclictest0-21swapper/523:11:535
1244299140,12cyclictest0-21swapper/522:11:405
1242799142,3cyclictest1088-21in:imjournal00:22:393
1242799141,1cyclictest42-21ksoftirqd/300:08:283
12427991411,2cyclictest0-21swapper/323:00:443
1242199140,2cyclictest20306-21sshd22:45:472
1242199140,13cyclictest0-21swapper/219:22:462
1242199140,12cyclictest1-21systemd23:20:292
12414991413,0cyclictest540-40kipmi023:05:151
12414991411,1cyclictest0-21swapper/122:39:081
1241499140,13cyclictest0-21swapper/122:48:001
1241499140,0cyclictest0-21swapper/100:10:211
1241499140,0cyclictest0-21swapper/100:10:201
1240999140,13cyclictest30523-21id00:08:110
1240999140,12cyclictest0-21swapper/021:52:090
309682130,0sleep10-21swapper/123:47:571
13632130,0sleep30-21swapper/300:15:153
13632130,0sleep30-21swapper/300:15:153
128062130,0sleep00-21swapper/021:36:190
12455991310,2cyclictest0-21swapper/700:34:027
1245599130,1cyclictest21439-21sshd23:09:467
1245599130,1cyclictest0-21swapper/722:10:457
1245599130,12cyclictest0-21swapper/721:30:337
1245599130,12cyclictest0-21swapper/721:26:487
1245599130,12cyclictest0-21swapper/721:15:207
1245599130,12cyclictest0-21swapper/700:25:117
1245599130,12cyclictest0-21swapper/700:25:117
1244899138,3cyclictest8989-21sshd21:58:356
1244899131,4cyclictest0-21swapper/623:17:436
12448991310,2cyclictest0-21swapper/621:12:136
1244899130,9cyclictest0-21swapper/622:10:446
12442991311,1cyclictest0-21swapper/523:37:345
12442991311,1cyclictest0-21swapper/522:36:095
1244299130,1cyclictest0-21swapper/523:45:135
1244299130,1cyclictest0-21swapper/522:55:065
1244299130,12cyclictest19720-21sshd21:56:215
1244299130,12cyclictest0-21swapper/522:18:085
1243499132,3cyclictest0-21swapper/421:25:224
12434991311,1cyclictest0-21swapper/423:20:264
12434991311,1cyclictest0-21swapper/423:10:064
1243499130,12cyclictest21116-21id22:29:144
1243499130,12cyclictest0-21swapper/423:47:114
1243499130,12cyclictest0-21swapper/423:34:264
1243499130,12cyclictest0-21swapper/422:04:544
1242799136,3cyclictest42-21ksoftirqd/322:45:583
1242799135,4cyclictest42-21ksoftirqd/322:29:193
1242799135,3cyclictest42-21ksoftirqd/300:36:313
1242799132,4cyclictest14788-21sshd22:35:133
1242799132,4cyclictest10186-21grepconf.sh23:11:513
12427991311,1cyclictest0-21swapper/321:56:513
1242799130,4cyclictest0-21swapper/300:33:513
1242799130,12cyclictest0-21swapper/321:10:293
1242199130,1cyclictest0-21swapper/222:55:522
1242199130,1cyclictest0-21swapper/222:33:022
1242199130,1cyclictest0-21swapper/222:33:012
1242199130,1cyclictest0-21swapper/221:14:232
1242199130,12cyclictest0-21swapper/222:03:062
1242199130,12cyclictest0-21swapper/221:35:532
1242199130,12cyclictest0-21swapper/221:22:042
1242199130,12cyclictest0-21swapper/221:22:032
1242199130,12cyclictest0-21swapper/221:19:292
12414991310,2cyclictest0-21swapper/123:33:021
1241499130,2cyclictest0-21swapper/100:26:401
1241499130,2cyclictest0-21swapper/100:26:401
1241499130,1cyclictest0-21swapper/122:00:351
1241499130,12cyclictest0-21swapper/100:07:271
12409991311,1cyclictest0-21swapper/022:41:520
12409991311,1cyclictest0-21swapper/022:41:520
12409991311,1cyclictest0-21swapper/021:12:220
12409991310,2cyclictest0-21swapper/023:50:340
1240999130,1cyclictest1-21systemd23:01:540
1240999130,1cyclictest0-21swapper/022:18:540
1240999130,1cyclictest0-21swapper/021:33:450
1240999130,12cyclictest0-21swapper/022:58:080
1240999130,12cyclictest0-21swapper/022:29:060
116532130,0sleep560-21ksoftirqd/522:21:295
70282121,8sleep0672-21systemd-logind22:34:300
70282121,8sleep0672-21systemd-logind22:34:300
12455991210,1cyclictest0-21swapper/722:26:127
12455991210,1cyclictest0-21swapper/721:49:077
1245599120,1cyclictest1839-21sshd23:58:257
1245599120,1cyclictest10057-21kernelversion21:10:167
1245599120,1cyclictest0-21swapper/721:40:307
1245599120,11cyclictest0-21swapper/723:04:317
1245599120,11cyclictest0-21swapper/700:20:047
1244899129,2cyclictest0-21swapper/600:18:396
1244899129,2cyclictest0-21swapper/600:18:396
1244899123,4cyclictest739-21avahi-daemon22:29:296
1244899122,4cyclictest69-21ksoftirqd/621:20:166
1244899122,4cyclictest69-21ksoftirqd/621:20:156
1244899122,3cyclictest69-21ksoftirqd/622:51:226
1244899122,3cyclictest69-21ksoftirqd/622:51:226
1244899122,3cyclictest0-21swapper/600:02:416
12448991210,1cyclictest0-21swapper/623:03:236
1244899120,4cyclictest0-21swapper/621:40:146
1244899120,1cyclictest0-21swapper/622:06:086
1244899120,1cyclictest0-21swapper/621:31:106
1244899120,1cyclictest0-21swapper/600:30:046
1244899120,11cyclictest0-21swapper/619:55:126
12442991210,1cyclictest0-21swapper/521:42:385
12442991210,1cyclictest0-21swapper/500:38:285
1244299120,1cyclictest24553-21sshd00:14:245
1244299120,1cyclictest24553-21sshd00:14:235
1244299120,1cyclictest22729-21bash00:34:425
1244299120,1cyclictest0-21swapper/523:27:215
1244299120,1cyclictest0-21swapper/521:17:315
1244299120,11cyclictest0-21swapper/523:40:085
1244299120,11cyclictest0-21swapper/522:51:205
1244299120,11cyclictest0-21swapper/522:51:195
1244299120,11cyclictest0-21swapper/521:36:275
1244299120,11cyclictest0-21swapper/521:25:105
1244299120,11cyclictest0-21swapper/500:01:455
1243499129,2cyclictest0-21swapper/423:28:064
1243499121,1cyclictest0-21swapper/422:40:184
1243499121,1cyclictest0-21swapper/422:40:184
12434991210,1cyclictest0-21swapper/423:54:524
1243499120,11cyclictest0-21swapper/423:42:054
1243499120,11cyclictest0-21swapper/422:58:244
1243499120,11cyclictest0-21swapper/422:50:534
1243499120,11cyclictest0-21swapper/422:50:534
1243499120,11cyclictest0-21swapper/421:32:234
1243499120,11cyclictest0-21swapper/421:13:254
1242799123,3cyclictest42-21ksoftirqd/323:05:023
1242799121,6cyclictest0-21swapper/323:30:323
1242799121,4cyclictest0-21swapper/322:43:123
1242799121,4cyclictest0-21swapper/322:43:123
12427991210,1cyclictest42-21ksoftirqd/321:35:453
12427991210,1cyclictest0-21swapper/321:19:213
1242799120,1cyclictest411ktimersoftd/322:51:513
1242799120,1cyclictest411ktimersoftd/322:51:503
1242799120,11cyclictest0-21swapper/323:53:163
1242799120,11cyclictest0-21swapper/322:12:123
1242799120,11cyclictest0-21swapper/319:50:223
1242799120,11cyclictest0-21swapper/319:50:223
1242799120,10cyclictest22676-21sshd23:36:443
12421991210,1cyclictest0-21swapper/223:57:272
12421991210,1cyclictest0-21swapper/223:30:412
12421991210,1cyclictest0-21swapper/222:36:552
12421991210,1cyclictest0-21swapper/222:26:352
12421991210,1cyclictest0-21swapper/200:03:462
1242199120,1cyclictest0-21swapper/223:52:192
1242199120,1cyclictest0-21swapper/221:55:472
1242199120,1cyclictest0-21swapper/221:48:292
1242199120,1cyclictest0-21swapper/200:35:282
1242199120,11cyclictest32566-21bash23:07:262
1242199120,11cyclictest0-21swapper/222:21:072
1242199120,11cyclictest0-21swapper/222:12:272
1242199120,11cyclictest0-21swapper/200:30:302
1241499129,2cyclictest0-21swapper/122:26:141
12414991210,1cyclictest28836-21grep00:31:461
12414991210,1cyclictest0-21swapper/123:58:351
12414991210,1cyclictest0-21swapper/123:40:431
12414991210,1cyclictest0-21swapper/123:35:361
12414991210,1cyclictest0-21swapper/121:35:341
12414991210,1cyclictest0-21swapper/100:15:071
12414991210,1cyclictest0-21swapper/100:15:061
12409991210,1cyclictest15306-21bash23:12:230
12409991210,1cyclictest1-21systemd23:56:540
12409991210,1cyclictest0-21swapper/023:21:240
12409991210,1cyclictest0-21swapper/022:11:140
12409991210,1cyclictest0-21swapper/000:00:380
1240999120,1cyclictest0-21swapper/000:32:150
1240999120,11cyclictest0-21swapper/023:48:000
1240999120,11cyclictest0-21swapper/022:53:110
1240999120,11cyclictest0-21swapper/022:53:110
1240999120,11cyclictest0-21swapper/021:28:450
1240999120,11cyclictest0-21swapper/000:22:090
1245599119,1cyclictest0-21swapper/723:44:267
1245599110,10cyclictest0-21swapper/722:42:267
1245599110,10cyclictest0-21swapper/722:42:257
1244899112,5cyclictest672-21systemd-logind21:25:116
1244899111,4cyclictest0-21swapper/622:58:106
1244899111,3cyclictest0-21swapper/622:32:556
1244899111,3cyclictest0-21swapper/622:32:556
1244899111,1cyclictest69-21ksoftirqd/600:25:236
1244899111,1cyclictest69-21ksoftirqd/600:25:226
1244899110,5cyclictest0-21swapper/622:49:116
1244299119,1cyclictest8848-21sshd22:41:155
1244299119,1cyclictest8848-21sshd22:41:145
1244299119,1cyclictest0-21swapper/523:32:275
1244299119,1cyclictest0-21swapper/521:53:475
1244299110,10cyclictest0-21swapper/522:47:335
1244299110,10cyclictest0-21swapper/519:20:015
1243499119,1cyclictest0-21swapper/422:47:064
1243499119,1cyclictest0-21swapper/422:21:344
1243499119,1cyclictest0-21swapper/421:44:444
1243499119,1cyclictest0-21swapper/400:25:234
1243499119,1cyclictest0-21swapper/400:25:224
1243499119,1cyclictest0-21swapper/400:07:304
1243499114,1cyclictest51-21ksoftirqd/422:31:264
1243499114,1cyclictest51-21ksoftirqd/422:31:254
1243499110,1cyclictest0-21swapper/420:10:154
1243499110,10cyclictest0-21swapper/420:46:404
1243499110,10cyclictest0-21swapper/420:00:264
1242799119,1cyclictest0-21swapper/320:35:163
1242799115,3cyclictest42-21ksoftirqd/321:30:163
1242799111,4cyclictest23238-21sshd23:26:433
1242799111,4cyclictest0-21swapper/323:40:383
1242799111,3cyclictest42-21ksoftirqd/322:55:293
1242799111,2cyclictest42-21ksoftirqd/322:02:043
1242799110,2cyclictest42-21ksoftirqd/321:40:143
1242199119,1cyclictest0-21swapper/223:17:552
1242199119,1cyclictest0-21swapper/200:15:102
1242199119,1cyclictest0-21swapper/200:15:102
1242199110,1cyclictest0-21swapper/223:44:182
1241499119,1cyclictest463-21systemd-journal00:35:331
1241499119,1cyclictest0-21swapper/122:05:401
1241499119,1cyclictest0-21swapper/121:52:541
1241499119,1cyclictest0-21swapper/121:17:501
1241499111,9cyclictest739-21avahi-daemon21:25:161
12414991110,0cyclictest540-40kipmi000:00:131
1241499110,1cyclictest0-21swapper/121:12:421
1240999119,1cyclictest0-21swapper/022:48:120
1240999119,1cyclictest0-21swapper/021:16:070
1240999110,0cyclictest0-21swapper/022:21:270
290542100,2sleep41-21systemd22:07:014
1245599108,1cyclictest0-21swapper/720:18:407
1245599107,2cyclictest31665-21cut20:55:097
1245599107,2cyclictest0-21swapper/723:52:067
1245599107,2cyclictest0-21swapper/700:14:587
1245599107,2cyclictest0-21swapper/700:14:577
1245599103,5cyclictest0-21swapper/719:47:597
1245599103,1cyclictest26356-21sshd22:00:157
1244299108,1cyclictest0-21swapper/523:55:275
1244299108,1cyclictest0-21swapper/522:06:345
1244299108,1cyclictest0-21swapper/500:28:305
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional