You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-11-23 - 17:31
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rack5slot0.osadl.org (updated Sat Nov 23, 2024 12:44:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2489021320,4sleep13055899cyclictest10:51:251
1007321310,1sleep30-21swapper/311:02:413
2918721270,4sleep13055899cyclictest11:46:281
43921140,2sleep10-21swapper/112:18:221
30056210432,43sleep30-21swapper/307:06:543
101721010,0sleep00-21swapper/011:58:210
30089210032,38sleep10-21swapper/107:07:191
258262980,2sleep10-21swapper/109:23:561
7532910,2sleep3750-21sshd12:24:093
216422910,1sleep10-21swapper/111:00:351
218872890,1sleep30-21swapper/309:30:273
29902880,1sleep10-21swapper/109:41:471
287882880,1sleep028738-21sshd11:20:130
287882880,1sleep028738-21sshd11:20:130
140672880,2sleep114066-21sshd10:36:541
4602860,2sleep2462-21id12:06:522
285352840,2sleep10-21swapper/110:25:001
281192830,3sleep03055799cyclictest10:01:180
221502830,1sleep30-21swapper/309:10:123
142842830,3sleep20-21swapper/209:43:012
123802830,2sleep30-21swapper/312:36:353
247162810,2sleep20-21swapper/210:00:562
247082800,2sleep324711-21unixbench-2d08:05:213
45692790,0sleep00-21swapper/009:11:370
41142780,0sleep00-21swapper/009:41:550
307992780,3sleep03055799cyclictest10:18:340
307492770,3sleep03055799cyclictest09:34:440
144642770,1sleep20-21swapper/211:42:202
112502770,2sleep211247-21sshd09:12:182
51892760,1sleep30-21swapper/312:07:183
119652740,1sleep011957-21sshd09:46:070
80882730,2sleep20-21swapper/212:01:472
3022827332,9sleep20-21swapper/207:09:052
170692730,0sleep31848-21nfsd11:48:183
117902720,2sleep00-21swapper/012:33:440
40952710,5sleep23055999cyclictest10:49:302
294842710,2sleep03055799cyclictest10:38:340
36652700,0sleep00-21swapper/011:11:240
203782690,3sleep21847-21nfsd09:36:552
104562690,2sleep310454-21bash11:27:423
316272670,2sleep30-21swapper/311:35:153
35682660,3sleep23055999cyclictest09:55:192
50642640,2sleep25046-21sshd11:47:132
36472610,4sleep23055999cyclictest10:25:372
131322590,1sleep32405-21runrttasks10:06:343
26852580,1sleep20-21swapper/211:11:182
3009325734,11sleep00-21swapper/007:07:230
321092530,4sleep33056099cyclictest10:25:183
30557993425,6cyclictest32427-21bash12:04:010
20662330,1sleep02061-21sshd11:08:110
61012290,1sleep06102-21sshd12:07:230
279852270,25sleep3135650irq/27-eth010:01:183
231932270,2sleep323179-21sshd10:34:323
6792260,2sleep20-21swapper/212:12:382
324002260,2sleep20-21swapper/212:21:072
3055999262,19cyclictest135650irq/27-eth010:33:212
3055799262,8cyclictest10-21rcuc/010:26:000
116352260,2sleep22405-21runrttasks07:40:012
72202250,1sleep17203-21sshd09:49:091
30557992517,6cyclictest11046-21bash11:36:160
321712240,21sleep3135650irq/27-eth011:17:253
30560992421,2cyclictest0-21swapper/310:57:303
285662240,4sleep10-21swapper/111:57:541
74912230,4sleep33056099cyclictest08:40:153
44042230,2sleep20-21swapper/211:17:512
186902230,2sleep218689-21sshd12:34:222
133342230,2sleep10-21swapper/109:32:541
105792230,2sleep31847-21nfsd12:10:353
55902220,2sleep10-21swapper/111:27:161
3056099227,0cyclictest0-21swapper/309:26:383
3056099221,8cyclictest0-21swapper/309:35:283
3055999223,13cyclictest0-21swapper/207:23:552
30557992215,5cyclictest7466-21bash10:46:300
286132220,19sleep2135650irq/27-eth009:27:392
106612221,19sleep2135650irq/27-eth011:24:492
106612221,19sleep2135650irq/27-eth011:24:492
3056099214,2cyclictest0-21swapper/311:58:003
3056099211,8cyclictest0-21swapper/312:02:593
3056099211,8cyclictest0-21swapper/311:09:353
3056099210,7cyclictest0-21swapper/311:31:553
186972210,2sleep118682-21sshd10:30:371
3056099204,1cyclictest6507-21sshd10:52:513
3056099203,2cyclictest0-21swapper/312:33:533
3056099203,1cyclictest14349-21bash12:25:173
3056099203,1cyclictest10810-21sshd12:16:213
3056099201,8cyclictest0-21swapper/309:15:083
30560992018,1cyclictest0-21swapper/309:52:443
3056099200,15cyclictest44-21ksoftirqd/311:40:333
3055799203,13cyclictest0-21swapper/010:30:400
3055799200,14cyclictest0-21swapper/012:15:310
241212200,0sleep124119-21sshd11:51:451
17802200,2sleep30-21swapper/309:45:093
172382200,18sleep2135650irq/27-eth007:50:152
121752200,2sleep30-21swapper/310:16:363
3056099198,3cyclictest135650irq/27-eth011:20:393
3056099198,3cyclictest135650irq/27-eth011:20:393
3056099197,7cyclictest44-21ksoftirqd/310:12:273
30560991915,3cyclictest20467-21sshd10:37:353
3056099190,8cyclictest0-21swapper/311:51:493
3056099190,6cyclictest0-21swapper/309:55:073
3056099190,6cyclictest0-21swapper/309:24:273
3055999193,5cyclictest135650irq/27-eth010:10:252
3055999193,11cyclictest1848-21nfsd09:33:532
3055999193,10cyclictest5512-21sshd11:05:192
3055799190,13cyclictest0-21swapper/012:14:210
234692190,1sleep023468-21sshd12:20:210
150982190,1sleep30-21swapper/310:23:383
3056099188,8cyclictest44-21ksoftirqd/311:11:373
3056099181,3cyclictest0-21swapper/310:50:003
3056099180,6cyclictest0-21swapper/309:43:513
3055999187,9cyclictest0-21swapper/211:57:472
3055999183,10cyclictest6640-21sshd12:18:562
3055999183,10cyclictest29785-21sshd11:35:092
3055999182,10cyclictest26568-21sshd11:54:552
3055999182,10cyclictest0-21swapper/210:51:092
3055799188,3cyclictest0-21swapper/009:26:210
3055799187,4cyclictest10097-21sshd12:36:230
3055799186,6cyclictest0-21swapper/009:56:590
30557991814,3cyclictest3-21ksoftirqd/011:26:580
30557991811,6cyclictest0-21swapper/011:44:370
294902180,4sleep23055999cyclictest10:55:112
143742180,2sleep20-21swapper/211:33:462
3056099172,2cyclictest135650irq/27-eth010:40:053
3056099170,9cyclictest44-21ksoftirqd/307:45:213
3055999178,4cyclictest11286-21sshd10:06:192
3055999172,10cyclictest25-21rcuop/110:42:332
3055999172,10cyclictest25107-21sshd11:29:012
3055999172,10cyclictest10220-21sshd09:18:592
3055999170,15cyclictest25-21rcuop/110:15:442
3055999170,14cyclictest15907-21sshd11:00:092
3055899171,15cyclictest32757-21sshd12:06:511
3055899171,11cyclictest31528-21bash09:27:551
3055899170,16cyclictest2930-21sshd12:27:091
3055899170,15cyclictest1848-21nfsd10:16:591
3055899170,15cyclictest12612-21sshd11:18:401
3055899170,15cyclictest0-21swapper/111:42:081
3055899170,14cyclictest0-21swapper/111:32:001
3055799178,3cyclictest0-21swapper/011:31:480
3055799171,3cyclictest7062-21munin-run07:30:010
30557991711,5cyclictest0-21swapper/010:56:560
3055799170,16cyclictest0-21swapper/011:47:520
3055799170,16cyclictest0-21swapper/009:22:030
3055799170,12cyclictest0-21swapper/012:25:530
3055799170,12cyclictest0-21swapper/010:53:520
3055799170,11cyclictest0-21swapper/011:03:410
3055799170,11cyclictest0-21swapper/009:53:290
192822170,15sleep2135650irq/27-eth012:25:412
78642160,14sleep1135650irq/27-eth010:02:411
3056099163,11cyclictest0-21swapper/307:41:283
30560991611,3cyclictest25779-21df_inode08:10:133
3055999163,1cyclictest10273-21sshd10:36:302
3055999163,10cyclictest135650irq/27-eth012:35:372
3055999163,10cyclictest135650irq/27-eth010:21:212
3055999161,10cyclictest18043-21sshd09:53:342
3055999160,11cyclictest16154-21basename07:50:012
3055899160,15cyclictest0-21swapper/110:21:401
3055899160,14cyclictest5860-21sshd12:35:591
3055899160,14cyclictest17086-21sshd10:13:471
3055899160,14cyclictest0-21swapper/112:00:011
3055899160,14cyclictest0-21swapper/109:51:381
3055799167,3cyclictest7042-21df_inode08:40:120
3055799167,3cyclictest0-21swapper/008:22:220
30557991611,4cyclictest0-21swapper/011:51:360
3055799161,10cyclictest0-21swapper/010:20:190
3055799160,7cyclictest0-21swapper/010:05:180
3055799160,3cyclictest0-21swapper/011:15:440
3055799160,2cyclictest4236-21cp09:35:160
3055799160,1cyclictest0-21swapper/009:15:250
3055799160,12cyclictest0-21swapper/010:12:090
3055799160,10cyclictest0-21swapper/010:40:060
3056099150,2cyclictest135650irq/27-eth007:30:133
3055999152,5cyclictest135650irq/27-eth009:45:452
3055999152,10cyclictest9770-21irqstats08:45:152
3055999150,13cyclictest0-21swapper/209:21:332
3055899158,2cyclictest6130-21sshd09:11:471
3055899157,6cyclictest1848-21nfsd09:18:411
3055899157,3cyclictest3715-21sshd09:58:481
3055899152,12cyclictest8454-21sshd11:36:021
3055899151,1cyclictest28686-21sshd12:20:471
30558991510,4cyclictest135650irq/27-eth011:20:501
30558991510,4cyclictest135650irq/27-eth011:20:501
30558991510,4cyclictest0-21swapper/110:57:431
3055899150,14cyclictest29861-21sshd10:05:011
3055899150,14cyclictest0-21swapper/112:12:091
3055899150,13cyclictest11484-21sshd09:35:571
3055899150,13cyclictest0-21swapper/108:27:001
3055899150,10cyclictest135650irq/27-eth011:13:041
3055799157,5cyclictest0-21swapper/009:08:230
3055799150,12cyclictest0-21swapper/008:29:310
3055799150,10cyclictest0-21swapper/007:16:460
3055799150,10cyclictest0-21swapper/007:10:150
44252140,12sleep1135650irq/27-eth007:20:371
3056099141,3cyclictest20201-21cat09:09:593
3056099141,3cyclictest0-21swapper/308:15:173
30560991410,3cyclictest12412-21ntp_states08:50:193
3056099140,13cyclictest36-21rcuop/208:35:173
3056099140,13cyclictest0-21swapper/307:25:593
3056099140,12cyclictest1915-21snmpd07:12:243
3055999148,4cyclictest0-21swapper/207:30:022
3055999143,10cyclictest0-21swapper/208:23:292
3055999141,7cyclictest1848-21nfsd07:42:402
3055999140,1cyclictest0-21swapper/209:04:412
3055999140,11cyclictest0-21swapper/208:27:002
3055899148,5cyclictest135650irq/27-eth010:40:261
3055899141,4cyclictest14955-21sshd11:06:141
30558991412,1cyclictest0-21swapper/112:30:461
30558991411,2cyclictest0-21swapper/110:45:041
3055899140,10cyclictest135650irq/27-eth007:35:531
3055799148,2cyclictest0-21swapper/008:15:500
3055799141,8cyclictest0-21swapper/007:46:370
3055799141,1cyclictest0-21swapper/008:05:190
30557991411,1cyclictest0-21swapper/007:36:470
3055799140,8cyclictest0-21swapper/008:35:380
3055799140,7cyclictest0-21swapper/008:30:170
3055799140,2cyclictest0-21swapper/007:58:000
3055799140,10cyclictest0-21swapper/007:22:160
3056099138,3cyclictest17067-21munin-node07:50:113
3056099138,3cyclictest10436-21memory07:35:163
3056099131,10cyclictest3471-21munin-node08:30:223
3056099131,10cyclictest0-21swapper/308:55:183
30560991310,2cyclictest0-21swapper/308:25:333
30560991310,2cyclictest0-21swapper/307:15:163
3056099130,12cyclictest0-21swapper/308:20:323
3056099130,12cyclictest0-21swapper/307:24:463
3056099130,11cyclictest21232-21diskstats08:00:133
3055999138,3cyclictest30841-21df07:10:112
3055999137,3cyclictest135650irq/27-eth008:12:252
3055999133,7cyclictest7003-21df_abs08:40:102
3055999133,7cyclictest2405-21runrttasks08:35:292
3055999133,7cyclictest1848-21nfsd07:25:412
3055999133,5cyclictest0-21swapper/208:01:132
3055999132,10cyclictest1848-21nfsd08:16:572
3055999132,10cyclictest17621-21kworker/u8:209:07:232
3055999131,11cyclictest0-21swapper/208:51:292
30559991311,1cyclictest0-21swapper/207:58:502
3055999130,8cyclictest15247-21kworker/u8:108:56:222
3055999130,12cyclictest0-21swapper/208:31:202
3055999130,11cyclictest23504-21df_inode08:05:122
3055899138,4cyclictest1848-21nfsd08:00:441
3055899137,5cyclictest0-21swapper/108:55:381
30558991311,1cyclictest0-21swapper/109:02:311
30558991311,1cyclictest0-21swapper/107:10:241
3055899130,5cyclictest0-21swapper/107:46:551
3055899130,4cyclictest0-21swapper/108:40:021
3055899130,12cyclictest17551-21pmu-power07:50:171
3055899130,12cyclictest0-21swapper/109:05:521
3055899130,12cyclictest0-21swapper/108:12:441
3055899130,12cyclictest0-21swapper/107:42:241
3055899130,12cyclictest0-21swapper/107:30:071
3055899130,12cyclictest0-21swapper/107:25:241
3055899130,12cyclictest0-21swapper/107:16:591
3055799137,2cyclictest0-21swapper/007:50:010
3056099120,3cyclictest16952-21ntp_states09:00:193
3056099120,10cyclictest9152-21ls08:45:113
3056099120,10cyclictest0-21swapper/307:55:133
3055999120,11cyclictest2121-21munin-node07:15:242
3055899121,10cyclictest0-21swapper/108:15:131
3055899120,3cyclictest12403-21ntp_offset08:50:201
3055899120,11cyclictest0-21swapper/108:45:371
3055899120,11cyclictest0-21swapper/108:35:361
3055899120,11cyclictest0-21swapper/108:20:381
3055899120,11cyclictest0-21swapper/108:07:001
3055899120,11cyclictest0-21swapper/107:55:081
3055899120,10cyclictest2506-21diskstats08:30:131
30557991210,1cyclictest0-21swapper/008:56:040
3055799118,1cyclictest0-21swapper/007:30:250
3055799110,8cyclictest0-21swapper/008:45:010
3055799110,7cyclictest0-21swapper/008:10:130
3055799110,3cyclictest0-21swapper/008:01:500
3055799110,1cyclictest0-21swapper/009:00:580
3055799110,1cyclictest0-21swapper/007:40:140
3055799100,9cyclictest0-21swapper/008:50:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional