You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-02-05 - 19:01
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack5slot0.osadl.org (updated Wed Feb 05, 2025 12:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3176021470,2sleep331757-21sshd11:27:353
3176021470,2sleep331757-21sshd11:27:353
781421410,0sleep02951499cyclictest11:39:430
1238021330,3sleep11847-21nfsd11:22:401
3111821240,4sleep12951999cyclictest11:53:071
2926129933,54sleep10-21swapper/107:09:491
172032950,1sleep30-21swapper/311:51:523
201632920,2sleep10-21swapper/111:32:151
201632920,2sleep10-21swapper/111:32:141
153432910,2sleep20-21swapper/210:14:212
2917329029,49sleep30-21swapper/307:08:553
227602900,3sleep30-21swapper/311:32:293
227602900,3sleep30-21swapper/311:32:293
130802900,1sleep313079-21sshd10:47:003
235142890,2sleep323515-21sshd10:41:143
201842890,4sleep20-21swapper/212:12:032
45862870,0sleep00-21swapper/009:39:330
22262860,2sleep12223-21bash10:35:471
81432850,2sleep30-21swapper/312:25:153
284752850,1sleep10-21swapper/110:15:331
205032850,2sleep21959-21sshd10:37:462
163902840,2sleep216385-21sshd12:06:032
90632830,2sleep00-21swapper/011:25:320
90632830,2sleep00-21swapper/011:25:320
28852830,2sleep32883-21sshd12:07:433
24792820,1sleep12477-21sshd12:07:421
173622820,2sleep20-21swapper/211:49:072
82282810,2sleep00-21swapper/012:08:120
15302810,1sleep30-21swapper/312:33:163
133832800,2sleep213368-21sshd11:34:322
133832800,2sleep213368-21sshd11:34:322
106102800,1sleep30-21swapper/311:10:043
309022790,1sleep30-21swapper/311:24:323
277862790,2sleep227784-21sshd11:27:152
277862790,2sleep227784-21sshd11:27:142
62022770,2sleep36200-21sshd09:56:343
233292750,2sleep323328-21sshd12:35:133
83062730,1sleep30-21swapper/309:22:193
2916027232,10sleep20-21swapper/207:08:472
320602690,4sleep12951999cyclictest09:39:011
31152690,1sleep30-21swapper/311:18:433
277552680,2sleep127754-21sshd10:31:551
164982680,2sleep20-21swapper/211:57:282
181792620,0sleep218181-21id09:30:282
2918526035,13sleep00-21swapper/007:09:040
275622420,39sleep3135650irq/27-eth012:15:313
251622370,4sleep20-21swapper/211:17:402
67822320,3sleep20-21swapper/209:53:212
237032320,30sleep1135650irq/27-eth010:28:191
33142310,2sleep21847-21nfsd09:49:412
273522290,2sleep10-21swapper/109:20:531
159992290,0sleep00-21swapper/009:44:180
214412270,2sleep221437-21bash12:23:342
155352270,4sleep32952899cyclictest10:14:213
11822270,2sleep30-21swapper/309:25:123
49452260,1sleep30-21swapper/311:09:323
29519992624,1cyclictest0-21swapper/109:47:161
280092260,2sleep20-21swapper/209:28:162
252102260,3sleep20-21swapper/212:35:202
23282260,1sleep32326-21sshd10:06:213
114502260,3sleep12951999cyclictest11:45:421
311642250,4sleep20-21swapper/210:15:492
261122250,2sleep10-21swapper/111:27:061
261122250,2sleep10-21swapper/111:27:051
228832252,21sleep2135650irq/27-eth010:51:162
215992250,23sleep1135650irq/27-eth010:01:301
169792250,1sleep01893-21nscd10:04:290
73032243,18sleep1135650irq/27-eth010:23:151
296312230,2sleep10-21swapper/110:58:481
29528992314,7cyclictest0-21swapper/311:58:233
284022230,1sleep00-21swapper/011:05:200
86542220,2sleep18653-21sshd12:22:241
84622220,1sleep00-21swapper/011:03:240
208582220,0sleep320857-21id12:20:353
52482210,3sleep10-21swapper/110:52:511
295772210,3sleep229576-21sshd11:44:272
2952899210,16cyclictest27332-21idleruntime-cro11:50:003
2951999201,17cyclictest22-21ksoftirqd/111:05:111
195232200,18sleep3135650irq/27-eth009:30:383
182392200,18sleep1135650irq/27-eth012:34:481
168202200,17sleep2135650irq/27-eth011:07:322
116232200,2sleep211622-21idleruntime11:00:142
70662190,17sleep3135650irq/27-eth009:18:573
298492190,1sleep10-21swapper/109:17:531
295712190,1sleep10-21swapper/109:31:441
23892192,15sleep3135650irq/27-eth010:52:353
325792180,16sleep1135650irq/27-eth012:18:521
29528991811,5cyclictest18297-21sshd10:04:383
2952399180,6cyclictest9259-21sshd10:43:082
2951999188,4cyclictest460-21bash09:11:221
29519991814,3cyclictest12520-21sshd11:40:081
99372170,0sleep00-21swapper/011:19:240
84022170,1sleep10-21swapper/112:13:551
82342170,15sleep3135650irq/27-eth009:36:313
7342170,4sleep32952899cyclictest10:19:223
2952899178,5cyclictest0-21swapper/312:11:003
2952899170,12cyclictest14008-21sshd09:44:053
2952399173,9cyclictest11579-21bash10:00:262
2951999178,4cyclictest3579-21sshd12:04:541
2951999178,4cyclictest135650irq/27-eth012:27:561
2951999176,10cyclictest0-21swapper/109:50:081
2951999173,2cyclictest13111-21sshd11:00:201
2951999171,8cyclictest22-21ksoftirqd/112:35:331
29519991711,5cyclictest135650irq/27-eth011:39:111
2951499170,16cyclictest0-21swapper/009:50:370
2951499170,13cyclictest0-21swapper/011:42:270
165222170,15sleep1135650irq/27-eth011:10:321
2952899162,13cyclictest0-21swapper/311:03:133
2952899160,3cyclictest0-21swapper/310:30:133
2952899160,15cyclictest0-21swapper/311:36:453
2952899160,14cyclictest22623-21rm09:13:463
2952899160,14cyclictest17638-21sshd12:00:233
2952899160,14cyclictest0-21swapper/310:20:123
2952899160,14cyclictest0-21swapper/307:35:133
2952899160,11cyclictest32147-21sshd10:29:123
2952399167,8cyclictest0-21swapper/207:30:592
2952399167,8cyclictest0-21swapper/207:30:582
2952399163,1cyclictest8718-21sshd11:36:542
2952399163,12cyclictest1847-21nfsd12:19:062
29523991611,4cyclictest26814-21sshd10:28:392
2952399160,3cyclictest18385-21sshd11:13:552
2952399160,12cyclictest20432-21sshd12:03:322
2951999167,4cyclictest3518-21bash11:15:301
2951999164,8cyclictest22-21ksoftirqd/110:48:351
2951999162,13cyclictest12785-21sshd10:07:241
2951999160,4cyclictest13312-21sshd10:40:161
2951999160,15cyclictest10435-21sshd09:29:511
2951999160,14cyclictest4375-21cp11:56:221
2951999160,12cyclictest23641-21sshd10:11:471
2951499160,1cyclictest0-21swapper/011:21:070
24812160,1sleep00-21swapper/012:33:210
32962150,13sleep3135650irq/27-eth009:46:213
2952899152,12cyclictest31212-21sshd10:38:513
2952899151,12cyclictest13881-21sshd11:40:123
29528991510,4cyclictest135650irq/27-eth009:53:113
2952899150,6cyclictest17178-21munin-node09:05:213
2952899150,13cyclictest3415-21bash10:55:533
2952399159,5cyclictest135650irq/27-eth007:20:122
2952399158,6cyclictest2405-21runrttasks10:05:102
2952399157,3cyclictest1846-21nfsd09:12:362
2952399154,1cyclictest27555-21sshd11:24:112
2952399153,10cyclictest18997-21chrt09:07:282
2952399152,12cyclictest135650irq/27-eth007:10:142
29523991511,3cyclictest8431-21bash12:25:172
2952399150,6cyclictest7017-21sshd11:50:562
2952399150,6cyclictest0-21swapper/208:45:162
2952399150,3cyclictest0-21swapper/210:55:462
2951999150,6cyclictest135650irq/27-eth009:05:121
2951999150,3cyclictest22862-21sshd09:55:021
2951999150,3cyclictest18552-21bash09:40:491
2951499158,3cyclictest0-21swapper/009:17:090
2951499157,7cyclictest1847-21nfsd11:57:000
2951499157,4cyclictest19537-21sshd10:14:470
29514991513,1cyclictest0-21swapper/012:29:400
29514991511,3cyclictest16941-21sshd10:34:070
2951499150,1cyclictest0-21swapper/011:33:080
2951499150,1cyclictest0-21swapper/011:33:080
2951499150,13cyclictest0-21swapper/010:41:020
2952899141,11cyclictest22484-21munin-node08:05:113
2952899140,12cyclictest31284-21chrt07:11:223
2952899140,12cyclictest2405-21runrttasks08:26:253
2952899140,12cyclictest0-21swapper/307:55:123
2952399149,1cyclictest29755-21bash09:59:002
2952399148,5cyclictest1847-21nfsd08:56:492
2952399144,9cyclictest12454-21sshd09:40:162
2952399141,12cyclictest0-21swapper/208:10:582
2952399141,11cyclictest12974-21sshd10:20:262
2952399140,5cyclictest28903-21rm12:30:012
2952399140,5cyclictest0-21swapper/209:37:562
2952399140,13cyclictest0-21swapper/209:01:592
2952399140,12cyclictest8697-21sshd10:46:322
2952399140,12cyclictest27349-21sshd09:20:542
2951999140,5cyclictest0-21swapper/107:35:391
2951499148,4cyclictest15940-21sshd11:46:050
2951499148,3cyclictest0-21swapper/010:49:510
2951499147,4cyclictest0-21swapper/010:28:300
2951499147,4cyclictest0-21swapper/007:21:070
2951499147,2cyclictest15535-21sshd12:23:020
2951499146,3cyclictest17841-21sshd12:17:330
29514991412,1cyclictest13795-21id11:10:160
29514991412,1cyclictest0-21swapper/012:39:580
29514991412,1cyclictest0-21swapper/010:16:390
29514991411,1cyclictest7273-21taskset10:39:430
29514991410,3cyclictest5859-21sshd12:02:130
2951499140,7cyclictest0-21swapper/010:20:200
2951499140,3cyclictest31177-21sshd09:28:350
2951499140,3cyclictest0-21swapper/010:50:550
2951499140,1cyclictest31547-21open_files11:50:170
2951499140,1cyclictest0-21swapper/012:14:140
2951499140,13cyclictest9630-21bash09:46:590
2951499140,13cyclictest0-21swapper/009:30:280
2951499140,11cyclictest0-21swapper/008:05:030
2951499140,10cyclictest0-21swapper/010:07:560
2952899137,5cyclictest0-21swapper/308:52:313
2952899131,11cyclictest135650irq/27-eth008:30:143
2952899130,5cyclictest0-21swapper/308:55:343
2952899130,4cyclictest5374-21munin-node07:25:213
2952899130,12cyclictest1848-21nfsd09:01:433
2952899130,12cyclictest0-21swapper/308:48:473
2952899130,12cyclictest0-21swapper/308:35:133
2952899130,12cyclictest0-21swapper/308:20:213
2952899130,12cyclictest0-21swapper/308:16:033
2952899130,12cyclictest0-21swapper/307:53:063
2952899130,12cyclictest0-21swapper/307:33:483
2952899130,12cyclictest0-21swapper/307:33:483
2952899130,11cyclictest2405-21runrttasks08:00:343
2952899130,11cyclictest1848-21nfsd07:20:143
2952899130,11cyclictest11590-21iostat07:40:163
2952899130,10cyclictest135650irq/27-eth007:45:473
2952399138,4cyclictest8269-21sshd10:30:022
2952399138,3cyclictest1439-21df08:30:152
2952399137,5cyclictest0-21swapper/207:45:542
2952399131,11cyclictest0-21swapper/207:15:122
2952399130,5cyclictest0-21swapper/208:04:342
2952399130,5cyclictest0-21swapper/207:55:162
2952399130,5cyclictest0-21swapper/207:50:202
2952399130,4cyclictest6037-21sshd09:15:192
2952399130,4cyclictest32332-21munin-node08:25:172
2952399130,12cyclictest1846-21nfsd08:15:122
2952399130,12cyclictest0-21swapper/208:51:182
2952399130,12cyclictest0-21swapper/208:40:182
2952399130,12cyclictest0-21swapper/208:35:312
2952399130,12cyclictest0-21swapper/208:20:162
2952399130,12cyclictest0-21swapper/208:05:202
2952399130,11cyclictest11098-21munin-node07:40:122
2951999137,5cyclictest1848-21nfsd07:11:081
2951999137,5cyclictest0-21swapper/108:32:351
2951999132,1cyclictest0-21swapper/107:16:141
2951999131,11cyclictest1848-21nfsd08:25:121
2951999131,11cyclictest135650irq/27-eth008:41:431
2951999130,5cyclictest0-21swapper/107:27:201
2951999130,4cyclictest28376-21grep08:15:231
2951999130,4cyclictest16569-21taskset09:00:371
2951999130,12cyclictest0-21swapper/108:54:041
2951999130,12cyclictest0-21swapper/108:38:151
2951999130,12cyclictest0-21swapper/108:14:011
2951999130,12cyclictest0-21swapper/108:05:261
2951999130,12cyclictest0-21swapper/107:50:061
2951999130,12cyclictest0-21swapper/107:45:171
2951999130,12cyclictest0-21swapper/107:40:281
2951999130,12cyclictest0-21swapper/107:33:211
2951999130,12cyclictest0-21swapper/107:33:211
2951999130,12cyclictest0-21swapper/107:22:521
2951999130,11cyclictest30216-21ntp_states08:20:221
2951499139,1cyclictest135650irq/27-eth010:55:160
2951499139,1cyclictest135650irq/27-eth007:15:120
2951499137,5cyclictest59122chrt07:28:380
29514991311,1cyclictest0-21swapper/009:02:470
2951499130,1cyclictest0-21swapper/009:21:300
2951499130,12cyclictest0-21swapper/009:56:350
2951499130,12cyclictest0-21swapper/008:50:150
2951499130,12cyclictest0-21swapper/008:39:550
2951499130,10cyclictest0-21swapper/009:14:190
2952899120,3cyclictest6470-21hddtemp_smartct08:40:183
2952899120,11cyclictest0-21swapper/308:10:193
2952899120,10cyclictest32140-21df_inode07:15:123
2952399121,8cyclictest0-21swapper/207:25:142
2952399120,10cyclictest0-21swapper/207:35:122
29519991210,1cyclictest0-21swapper/107:56:101
2951999120,10cyclictest0-21swapper/108:55:151
2951999120,10cyclictest0-21swapper/108:45:121
2951499128,3cyclictest0-21swapper/008:30:230
2951499124,4cyclictest0-21swapper/007:40:150
29514991210,1cyclictest0-21swapper/007:45:130
29514991210,1cyclictest0-21swapper/007:35:270
2951499120,4cyclictest0-21swapper/008:01:050
2951499120,1cyclictest1848-21nfsd07:30:150
2951499120,1cyclictest1848-21nfsd07:30:150
2951499120,11cyclictest8384-21df_inode08:45:120
2951499120,11cyclictest0-21swapper/009:06:480
2951499120,11cyclictest0-21swapper/008:57:180
2951499120,11cyclictest0-21swapper/008:27:150
2951499120,11cyclictest0-21swapper/008:21:090
2951499120,11cyclictest0-21swapper/007:59:350
2951499120,11cyclictest0-21swapper/007:52:280
2951499120,11cyclictest0-21swapper/007:11:090
2951499120,10cyclictest0-21swapper/008:11:230
2951999110,10cyclictest0-21swapper/108:00:111
2951499117,3cyclictest0-21swapper/008:40:090
2951499114,3cyclictest0-21swapper/008:15:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional