You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-27 - 14:23
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot0.osadl.org (updated Sat Jul 27, 2024 12:44:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
908821500,1sleep09029-21latency_hist10:45:010
2355421440,0sleep023553-21sshd10:55:430
1612521300,4sleep1557199cyclictest09:36:531
1454621280,3sleep10-21swapper/112:01:201
3059521240,4sleep1557199cyclictest10:53:181
5307210533,55sleep30-21swapper/307:09:553
64032900,2sleep30-21swapper/310:16:223
237632880,2sleep123762-21bash11:35:191
99972860,2sleep30-21swapper/309:11:213
523628633,49sleep10-21swapper/107:09:021
327502860,3sleep20-21swapper/210:12:452
64142850,1sleep00-21swapper/011:45:360
165052850,4sleep1557199cyclictest12:25:291
230972840,1sleep30-21swapper/311:17:223
114882840,2sleep20-21swapper/211:49:112
80632830,2sleep28057-21sshd12:21:452
53362830,2sleep15317-21sshd09:48:191
225702830,2sleep222566-21sshd10:21:022
195862830,3sleep2557299cyclictest09:43:272
79972820,3sleep00-21swapper/012:15:420
37492820,3sleep30-21swapper/311:42:273
92042810,1sleep09199-21rm11:51:530
71662810,0sleep00-21swapper/011:33:500
188412810,1sleep318830-21sshd11:52:483
197772800,2sleep20-21swapper/211:01:422
136982800,2sleep113699-21id11:58:191
277622790,3sleep0557099cyclictest12:05:320
277622790,3sleep0557099cyclictest12:05:320
272412790,0sleep00-21swapper/011:26:400
192552790,0sleep00-21swapper/012:01:470
17202790,0sleep00-21swapper/009:23:050
101242790,2sleep10-21swapper/110:45:061
315482780,2sleep30-21swapper/310:59:463
197312780,2sleep32405-21runrttasks12:37:533
304992760,3sleep2557299cyclictest12:26:502
286872760,2sleep328676-21sshd09:53:423
158062760,2sleep315805-21bash10:08:003
262192750,1sleep126220-21sshd09:44:051
46142740,1sleep21848-21nfsd09:51:172
41172710,2sleep30-21swapper/309:29:333
214012690,1sleep021395-21sshd09:49:530
288742640,3sleep1557199cyclictest11:08:581
526724934,10sleep20-21swapper/207:09:262
515124733,11sleep00-21swapper/007:07:570
3042380,36sleep1135650irq/27-eth012:06:021
3042380,36sleep1135650irq/27-eth012:06:021
173122351,31sleep226950irq/26-ahci[00012:13:402
5570993124,6cyclictest17576-21bash11:40:400
151142310,0sleep10-21swapper/109:15:051
286362300,2sleep10-21swapper/110:24:541
266262300,0sleep226611-21sshd11:50:272
46682290,3sleep10-21swapper/110:00:361
247982290,2sleep20-21swapper/210:27:352
247982290,2sleep20-21swapper/210:27:342
95522270,2sleep19554-21sshd11:22:051
228072270,2sleep20-21swapper/212:17:082
147372270,2sleep114727-21sshd10:17:121
100292271,24sleep1135650irq/27-eth011:51:591
44822250,2sleep20-21swapper/210:38:132
128192252,21sleep3135650irq/27-eth012:34:173
300192243,19sleep1135650irq/27-eth009:25:441
87752230,0sleep08759-21sshd09:11:140
557099239,6cyclictest11214-21bash10:23:090
32652230,4sleep30-21swapper/310:38:063
264182230,3sleep20-21swapper/209:19:172
77762220,1sleep00-21swapper/010:04:090
557299222,14cyclictest12682-21sshd10:48:262
36132220,2sleep21847-21nfsd09:38:492
217392220,2sleep321678-21sshd11:20:143
186832220,3sleep318679-21sshd12:22:463
141842220,3sleep014185-21sshd10:39:110
78102210,3sleep3557399cyclictest08:25:193
307452210,2sleep230744-21sshd09:56:572
284922211,18sleep1135650irq/27-eth011:32:481
278292210,19sleep3135650irq/27-eth011:11:503
194312210,2sleep2321ktimersoftd/210:52:122
557299203,5cyclictest0-21swapper/212:07:372
557299203,5cyclictest0-21swapper/212:07:372
31222200,3sleep2557299cyclictest09:20:112
261272200,4sleep3557399cyclictest09:59:433
215092200,18sleep3135650irq/27-eth012:29:043
117822200,17sleep1135650irq/27-eth010:13:531
60212190,0sleep31846-21nfsd10:13:183
5571991914,4cyclictest6831-21sshd11:03:381
272412190,17sleep3135650irq/27-eth010:43:353
221662190,16sleep3135650irq/27-eth010:30:263
195512190,3sleep10-21swapper/108:50:211
557399183,3cyclictest9179-21sshd12:03:553
5572991813,4cyclictest11626-21sshd10:42:022
557099184,11cyclictest0-21swapper/010:50:010
149062180,2sleep10-21swapper/109:58:371
557399172,9cyclictest14822-21sshd11:46:253
557399171,12cyclictest22226-21sshd09:50:003
557399170,14cyclictest0-21swapper/307:38:323
557399170,12cyclictest19624-21sshd10:45:543
557399170,12cyclictest0-21swapper/311:06:273
557299173,9cyclictest6741-21sshd09:45:172
557299173,11cyclictest7899-21sshd09:14:232
557299173,11cyclictest2036-21sshd10:34:532
557299173,11cyclictest18122-21sshd11:55:392
5572991715,1cyclictest0-21swapper/207:24:332
5572991712,3cyclictest1848-21nfsd11:18:012
5571991713,3cyclictest20999-21sshd09:24:581
5571991712,3cyclictest12820-21bash11:16:231
5571991711,1cyclictest1700-21sshd12:18:131
557199170,4cyclictest31155-21id10:28:131
557199170,4cyclictest31155-21id10:28:131
557199170,4cyclictest30367-21sshd12:32:511
557199170,15cyclictest27521-21sshd12:35:311
557199170,15cyclictest1986-21sshd12:24:151
557199170,15cyclictest0-21swapper/111:46:141
557099171,12cyclictest0-21swapper/009:55:470
267612170,15sleep1135650irq/27-eth011:11:431
225602170,15sleep1135650irq/27-eth009:34:291
18612170,4sleep00-21swapper/009:54:150
164092170,3sleep3557399cyclictest10:05:003
63272161,13sleep1135650irq/27-eth011:27:471
557399167,8cyclictest0-21swapper/312:16:173
557399167,4cyclictest417-21jbd2/dm-0-810:50:323
557399162,13cyclictest2858-21sshd11:36:213
5573991612,3cyclictest18354-21sshd11:34:543
5573991611,4cyclictest135650irq/27-eth009:41:093
557399160,4cyclictest135650irq/27-eth011:59:193
557399160,14cyclictest25579-21sshd10:27:403
557399160,14cyclictest25579-21sshd10:27:393
557399160,14cyclictest16473-21sshd09:36:553
557399160,14cyclictest15671-21sshd09:33:463
557399160,11cyclictest0-21swapper/310:20:193
557399160,10cyclictest0-21swapper/309:21:113
557299162,6cyclictest29407-21sshd11:35:472
557299162,13cyclictest5896-21sshd10:16:192
557299162,13cyclictest31901-21sshd11:05:592
5572991612,3cyclictest404-21sshd11:27:132
557299160,15cyclictest135650irq/27-eth009:25:072
557299160,14cyclictest16001-21sshd12:01:292
557299160,11cyclictest18691-21sshd10:55:182
557199161,11cyclictest31486-21sshd09:50:441
557199160,4cyclictest135650irq/27-eth010:36:051
557199160,4cyclictest11373-21bash10:07:341
557199160,3cyclictest0-21swapper/109:10:491
557199160,14cyclictest11833-21sshd10:57:481
557199160,14cyclictest0-21swapper/110:43:081
557199160,11cyclictest17967-21sshd11:43:471
557199160,11cyclictest0-21swapper/112:14:011
557099168,4cyclictest0-21swapper/010:09:220
557099160,12cyclictest0-21swapper/012:20:360
557099160,12cyclictest0-21swapper/010:34:110
139012160,3sleep00-21swapper/009:18:040
129542160,14sleep226950irq/26-ahci[00012:31:122
557399159,2cyclictest1959-21sshd11:26:153
557399158,3cyclictest26095-21munin-node09:05:243
557399152,12cyclictest135650irq/27-eth012:14:583
557399150,3cyclictest16625-21id09:15:133
557399150,14cyclictest135650irq/27-eth011:02:423
557399150,13cyclictest0-21swapper/307:50:133
557299156,1cyclictest0-21swapper/207:52:392
557299153,7cyclictest13721-21sshd11:43:222
557299152,8cyclictest11498-21sshd09:30:132
557299152,11cyclictest15247-21sshd12:37:272
557299152,10cyclictest7383-21sshd11:33:512
557299152,10cyclictest21425-21sshd11:20:122
557299152,10cyclictest21255-21sshd10:05:212
557299151,13cyclictest0-21swapper/208:06:352
557299150,13cyclictest0-21swapper/210:01:282
557199150,14cyclictest0-21swapper/108:05:091
557199150,13cyclictest0-21swapper/110:30:491
557099156,4cyclictest2008-21bash11:18:250
557099153,10cyclictest8654-21sshd11:06:550
557099151,2cyclictest0-21swapper/011:55:130
557099151,11cyclictest7051-21sshd11:12:550
5570991510,1cyclictest0-21swapper/009:25:030
557099150,9cyclictest13230-21munin-node07:25:180
557099150,2cyclictest30710-21bash12:11:500
557099150,14cyclictest6138-21sshd11:00:220
557099150,14cyclictest0-21swapper/010:29:020
557099150,14cyclictest0-21swapper/010:29:020
557099150,11cyclictest0-21swapper/009:40:150
557399149,4cyclictest29144-21sshd12:05:403
557399149,4cyclictest29144-21sshd12:05:403
557399147,5cyclictest0-21swapper/308:20:173
557399143,1cyclictest0-21swapper/308:11:533
5573991410,3cyclictest0-21swapper/308:19:483
557399140,3cyclictest135650irq/27-eth008:30:423
557299148,5cyclictest0-21swapper/208:10:212
557299143,7cyclictest9136-21sshd11:10:102
557299143,4cyclictest1848-21nfsd08:16:332
557299143,10cyclictest47-21rcuop/309:00:132
557299142,10cyclictest1848-21nfsd07:12:232
557099147,6cyclictest9498-21yum07:15:280
557099147,6cyclictest1848-21nfsd09:31:050
557099142,1cyclictest0-21swapper/011:37:240
557099142,1cyclictest0-21swapper/009:35:410
557099140,5cyclictest0-21swapper/012:37:040
557099140,1cyclictest20825-21sshd10:11:340
557099140,13cyclictest7295-21sshd10:16:270
557099140,13cyclictest10201-21sshd11:22:080
557399139,3cyclictest135650irq/27-eth007:11:013
557399138,4cyclictest1848-21nfsd07:40:413
557399137,5cyclictest0-21swapper/308:55:333
557399130,12cyclictest144550irq/28-eth1-rx-07:31:323
557399130,12cyclictest0-21swapper/308:05:093
557399130,12cyclictest0-21swapper/308:04:563
557399130,12cyclictest0-21swapper/307:55:483
557399130,12cyclictest0-21swapper/307:45:313
557399130,12cyclictest0-21swapper/307:25:033
557399130,12cyclictest0-21swapper/307:21:283
557399130,11cyclictest0-21swapper/307:17:033
557299139,3cyclictest1848-21nfsd08:30:452
557299137,5cyclictest0-21swapper/207:55:592
557299133,8cyclictest135650irq/27-eth007:30:472
557299133,4cyclictest0-21swapper/209:07:512
557299133,4cyclictest0-21swapper/208:46:192
557299132,7cyclictest1848-21nfsd08:25:042
557299131,4cyclictest0-21swapper/207:17:122
557299130,12cyclictest1848-21nfsd08:21:272
557299130,12cyclictest0-21swapper/208:37:562
557299130,12cyclictest0-21swapper/207:45:022
557299130,12cyclictest0-21swapper/207:40:572
557299130,11cyclictest18337-21timerwakeupswit07:35:222
557299130,10cyclictest135650irq/27-eth008:04:242
557199131,11cyclictest135650irq/27-eth008:43:271
557199131,11cyclictest135650irq/27-eth008:30:381
5571991311,1cyclictest0-21swapper/109:05:491
557199130,4cyclictest8795-21sshd08:26:321
557199130,4cyclictest6739-21ntpq07:10:221
557199130,4cyclictest17519-21munin-node07:35:121
557199130,1cyclictest1846-21nfsd07:15:131
557199130,12cyclictest0-21swapper/108:55:321
557199130,12cyclictest0-21swapper/108:38:061
557199130,12cyclictest0-21swapper/108:10:421
557199130,12cyclictest0-21swapper/108:04:241
557199130,12cyclictest0-21swapper/107:55:161
557199130,12cyclictest0-21swapper/107:53:431
557199130,12cyclictest0-21swapper/107:45:401
557199130,12cyclictest0-21swapper/107:44:241
557199130,12cyclictest0-21swapper/107:30:071
557199130,12cyclictest0-21swapper/107:29:261
557199130,12cyclictest0-21swapper/107:20:521
557199130,11cyclictest5110-21df_inode08:20:111
557199130,11cyclictest3286-21munin-node08:15:171
557199130,11cyclictest16739-21hddtemp_smartct08:45:141
557099138,1cyclictest0-21swapper/012:26:000
557099137,5cyclictest13813-21seq08:40:100
557099137,5cyclictest0-21swapper/012:30:190
557099137,5cyclictest0-21swapper/007:48:040
5570991311,1cyclictest0-21swapper/008:46:280
557099130,12cyclictest0-21swapper/010:50:300
557099130,12cyclictest0-21swapper/008:03:550
557099130,10cyclictest0-21swapper/008:39:310
557099130,10cyclictest0-21swapper/008:05:310
557399128,3cyclictest135650irq/27-eth008:35:233
557399120,11cyclictest1848-21nfsd08:41:573
557399120,11cyclictest135650irq/27-eth008:45:313
557399120,11cyclictest0-21swapper/309:00:313
557399120,11cyclictest0-21swapper/308:50:283
557299122,9cyclictest0-21swapper/208:55:112
557299121,11cyclictest135650irq/27-eth008:41:372
557299121,10cyclictest0-21swapper/207:25:052
557299120,11cyclictest144550irq/28-eth1-rx-08:52:122
557199128,3cyclictest135650irq/27-eth009:00:131
557099129,1cyclictest0-21swapper/009:07:460
557099128,3cyclictest0-21swapper/007:30:490
557099128,1cyclictest0-21swapper/008:50:290
557099127,4cyclictest0-21swapper/007:14:510
557099127,3cyclictest0-21swapper/007:35:000
557099126,5cyclictest20363-21processes07:40:190
5570991210,1cyclictest0-21swapper/007:55:170
557099120,9cyclictest20573-21munin-node08:55:200
557099120,7cyclictest0-21swapper/008:30:130
557099120,1cyclictest0-21swapper/008:29:450
557099120,1cyclictest0-21swapper/007:51:430
557099120,11cyclictest0-21swapper/009:00:170
557099120,11cyclictest0-21swapper/008:20:460
557099120,11cyclictest0-21swapper/008:15:430
557099120,11cyclictest0-21swapper/008:11:090
557099120,11cyclictest0-21swapper/007:21:570
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional