You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-11-22 - 14:31
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack5slot0.osadl.org (updated Fri Nov 22, 2024 12:44:54)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
983121520,3sleep01584199cyclictest12:09:570
1267021430,1sleep012667-21sshd12:27:010
3142121350,4sleep21584399cyclictest12:20:132
1226921180,3sleep10-21swapper/109:17:091
15475210332,44sleep30-21swapper/307:08:433
1533429733,43sleep10-21swapper/107:07:011
140822890,1sleep00-21swapper/011:33:500
220022880,1sleep10-21swapper/110:58:121
189192880,2sleep318912-21bash12:33:133
297792860,1sleep10-21swapper/112:03:131
297792860,1sleep10-21swapper/112:03:131
80652850,1sleep30-21swapper/311:55:383
252862850,5sleep31584499cyclictest09:54:263
235442850,4sleep21584399cyclictest09:31:202
176992850,0sleep00-21swapper/010:39:320
160292850,1sleep216031-21sshd10:26:152
88992840,2sleep10-21swapper/109:20:091
29512840,2sleep12949-21sshd11:52:271
233282840,2sleep31847-21nfsd10:46:043
22822820,2sleep31848-21nfsd11:15:583
255272780,2sleep225526-21sshd11:29:152
14102780,2sleep31406-21sshd10:31:293
137432780,2sleep10-21swapper/112:38:241
84582770,0sleep08455-21sshd10:59:520
30572770,2sleep23058-21sshd11:32:522
102902750,3sleep01584199cyclictest10:44:570
293452740,3sleep11584299cyclictest11:04:261
288252740,2sleep128827-21latency_hist08:50:001
130082740,3sleep01584199cyclictest09:53:110
234912730,1sleep00-21swapper/011:17:510
130002730,2sleep213001-21sshd11:47:432
95132720,2sleep10-21swapper/112:18:201
255862700,3sleep01584199cyclictest10:07:340
298662690,3sleep21584399cyclictest10:43:432
203812690,1sleep30-21swapper/310:20:113
221552660,4sleep21584399cyclictest12:39:092
1527126633,12sleep20-21swapper/207:06:132
13642540,3sleep10-21swapper/111:57:561
263212460,2sleep11847-21nfsd12:28:141
52852420,2sleep30-21swapper/309:45:523
1555724134,4sleep00-21swapper/007:09:410
314552390,1sleep231452-21sshd09:15:492
52022370,2sleep30-21swapper/309:19:483
126132350,1sleep01847-21nfsd09:43:210
224282330,2sleep122418-21sshd10:23:421
131812290,26sleep2135650irq/27-eth011:50:292
79922281,25sleep2135650irq/27-eth011:22:072
288942280,2sleep128890-21sshd11:23:571
12292280,1sleep01222-21sshd11:52:180
70242271,24sleep2135650irq/27-eth010:15:262
70242271,24sleep2135650irq/27-eth010:15:262
67142261,23sleep2135650irq/27-eth010:50:412
43332260,2sleep30-21swapper/311:35:423
1584199262,11cyclictest4728-21bash12:03:530
1584199262,11cyclictest4728-21bash12:03:530
81572250,1sleep30-21swapper/311:50:093
77892250,2sleep30-21swapper/310:38:353
327572240,22sleep2135650irq/27-eth009:48:412
100652240,2sleep10-21swapper/111:13:551
279782230,2sleep20-21swapper/211:04:192
232062230,21sleep2135650irq/27-eth012:02:392
232062230,21sleep2135650irq/27-eth012:02:392
205572231,19sleep2135650irq/27-eth011:37:102
200732230,2sleep10-21swapper/111:28:461
1584399234,10cyclictest135650irq/27-eth010:14:032
1584399232,7cyclictest2485-21bash12:12:032
267822220,2sleep226783-21sshd10:01:072
249292220,2sleep30-21swapper/311:29:123
224022220,2sleep30-21swapper/312:08:123
1584399221,5cyclictest135650irq/27-eth008:07:382
1584199220,21cyclictest10212-21sshd11:39:060
106402220,1sleep310641-21sshd12:01:313
106402220,1sleep310641-21sshd12:01:313
50792210,2sleep25077-21sshd11:10:362
218982210,1sleep30-21swapper/310:52:093
210532210,4sleep10-21swapper/111:06:261
181632210,18sleep3135650irq/27-eth012:35:543
1584399218,7cyclictest0-21swapper/208:26:472
1584399218,7cyclictest0-21swapper/208:26:462
1584399213,9cyclictest24519-21sshd09:57:432
1584399212,10cyclictest135650irq/27-eth008:10:562
1584399211,17cyclictest135650irq/27-eth010:31:162
1584399202,3cyclictest4393-21bash11:41:192
1584399202,10cyclictest14520-21bash10:06:232
1584399201,16cyclictest135650irq/27-eth011:09:452
156552200,1sleep015651-21sshd11:08:500
83732190,4sleep20-21swapper/209:20:072
42082191,16sleep2135650irq/27-eth009:52:172
1584399193,7cyclictest135650irq/27-eth008:38:192
1584399193,5cyclictest135650irq/27-eth011:15:032
1584399193,3cyclictest23098-21bash12:16:392
1584399192,8cyclictest135650irq/27-eth012:05:272
1584399192,8cyclictest135650irq/27-eth007:20:152
1584399192,10cyclictest135650irq/27-eth007:12:402
1584399190,10cyclictest135650irq/27-eth009:42:532
1584399190,10cyclictest135650irq/27-eth009:01:542
1584299190,10cyclictest0-21swapper/110:09:461
1584199190,4cyclictest0-21swapper/009:37:180
118432190,2sleep10-21swapper/109:14:011
205542180,0sleep00-21swapper/012:36:060
1584499186,11cyclictest24701-21sshd11:31:553
1584399183,3cyclictest29558-21cp12:28:312
1584399183,3cyclictest15698-21sshd11:56:192
1584399182,7cyclictest26950irq/26-ahci[00010:39:452
1584399182,5cyclictest135650irq/27-eth007:53:432
1584399182,5cyclictest135650irq/27-eth007:46:162
1584399182,13cyclictest135650irq/27-eth009:35:032
1584399181,8cyclictest135650irq/27-eth010:46:292
1584399181,8cyclictest135650irq/27-eth008:48:392
1584399181,8cyclictest135650irq/27-eth008:30:142
1584399181,5cyclictest1848-21nfsd07:35:312
1584399180,17cyclictest1959-21sshd10:20:432
1584299180,2cyclictest0-21swapper/111:36:471
1584199188,6cyclictest0-21swapper/009:23:050
1584199187,6cyclictest4841-21bash11:44:150
113862180,2sleep111383-21sshd10:45:021
1584499173,5cyclictest1660-21sshd11:43:593
1584499173,12cyclictest27331-21sshd11:04:153
1584499172,13cyclictest22097-21sshd12:22:123
1584499170,8cyclictest0-21swapper/309:30:313
1584399173,12cyclictest0-21swapper/207:19:422
1584399171,11cyclictest2729-21sshd09:29:172
1584399170,8cyclictest685-21sshd10:56:182
1584399170,8cyclictest135650irq/27-eth007:33:122
1584299172,0cyclictest0-21swapper/107:19:561
15842991711,5cyclictest26950irq/26-ahci[00010:25:271
1584299171,15cyclictest25656-21bash10:00:591
15842991711,1cyclictest31849-21sshd12:06:091
1584299170,3cyclictest15445-21bash09:40:201
1584299170,2cyclictest16587-21bash09:37:091
1584299170,15cyclictest0-21swapper/110:15:111
1584299170,15cyclictest0-21swapper/110:15:111
15841991714,2cyclictest0-21swapper/011:56:210
1584199170,8cyclictest25172-21sshd10:46:150
1584199170,12cyclictest0-21swapper/010:11:460
1584199170,11cyclictest0-21swapper/011:12:500
15844991612,2cyclictest20260-21sshd10:13:363
15844991611,4cyclictest4279-21sshd11:05:043
15844991611,3cyclictest1114-21rm09:22:333
15844991610,5cyclictest18899-21bash10:42:393
1584499160,7cyclictest20514-21sshd12:10:463
1584499160,14cyclictest3799-21bash12:15:023
1584499160,14cyclictest11549-21sshd12:26:553
1584499160,14cyclictest0-21swapper/311:11:193
1584499160,14cyclictest0-21swapper/310:59:113
1584399163,7cyclictest135650irq/27-eth008:15:392
1584399163,11cyclictest135650irq/27-eth009:12:152
1584399160,13cyclictest135650irq/27-eth008:21:572
1584399160,11cyclictest26769-21id12:31:002
1584299166,3cyclictest31966-21sshd10:43:551
1584299161,3cyclictest144550irq/28-eth1-rx-08:25:481
1584299161,3cyclictest144550irq/28-eth1-rx-08:25:471
15842991612,3cyclictest22309-21sshd10:30:211
15842991612,3cyclictest11077-21sshd10:51:061
15842991612,3cyclictest1081-21bash12:23:141
1584299161,1cyclictest16670-21sshd11:45:141
15842991611,4cyclictest0-21swapper/109:32:101
1584299160,15cyclictest0-21swapper/109:56:331
1584199161,11cyclictest0-21swapper/012:22:250
15841991610,2cyclictest1959-21sshd12:34:250
1584199160,1cyclictest0-21swapper/012:11:010
1584199160,14cyclictest4372-21wc10:50:280
1584199160,11cyclictest1673-21sshd11:30:000
1584199160,11cyclictest0-21swapper/011:00:580
1584499152,12cyclictest1848-21nfsd09:43:583
1584499151,5cyclictest19722-21sshd09:37:313
1584499151,12cyclictest6065-21latency10:25:173
15844991510,3cyclictest23569-21sshd10:04:113
1584499150,6cyclictest8797-21sshd11:22:103
1584499150,13cyclictest31079-21bash09:58:223
1584499150,13cyclictest0-21swapper/311:45:013
1584499150,12cyclictest0-21swapper/307:15:103
1584399159,4cyclictest23421-21iostat07:25:152
1584399157,3cyclictest1847-21nfsd08:50:332
1584399152,8cyclictest135650irq/27-eth008:41:472
1584399152,7cyclictest135650irq/27-eth007:55:362
1584399152,5cyclictest135650irq/27-eth009:05:352
1584399152,4cyclictest0-21swapper/208:56:332
1584299159,5cyclictest0-21swapper/110:14:381
1584299153,11cyclictest24944-21munin-node07:30:211
1584299152,2cyclictest32735-21sshd09:48:401
15842991512,2cyclictest4094-21sshd09:29:261
1584299150,7cyclictest0-21swapper/111:30:401
1584299150,6cyclictest1989-21lldpd09:06:141
1584299150,14cyclictest4286-21sshd12:12:131
1584299150,0cyclictest0-21swapper/107:35:561
1584199159,2cyclictest14676-21sshd09:17:240
1584199159,1cyclictest27397-21sshd09:25:120
1584199158,3cyclictest7569-21memory12:15:190
1584199157,4cyclictest0-21swapper/010:29:540
1584199152,9cyclictest0-21swapper/010:32:280
1584199152,9cyclictest0-21swapper/010:17:460
1584199152,9cyclictest0-21swapper/010:17:460
1584199152,9cyclictest0-21swapper/009:11:230
1584199150,4cyclictest31980-21cat10:04:590
1584199150,2cyclictest20390-21sshd09:34:210
1584199150,13cyclictest0-21swapper/008:42:020
1584199150,11cyclictest30566-21sshd11:46:240
1584199150,11cyclictest28213-21bash09:58:050
1584199150,11cyclictest1959-21sshd09:49:580
180792140,2sleep10-21swapper/111:42:331
1584499148,5cyclictest1848-21nfsd09:10:013
1584499147,6cyclictest0-21swapper/308:34:493
15844991410,3cyclictest5204-21mailstats07:55:213
1584499140,13cyclictest20409-21aten_r5power_fr07:20:103
1584499140,13cyclictest14316-21sshd10:16:133
1584499140,13cyclictest14316-21sshd10:16:133
1584499140,13cyclictest0-21swapper/308:57:493
1584499140,12cyclictest29305-21sshd09:25:183
1584499140,12cyclictest2256-21sshd10:05:123
1584399141,8cyclictest135650irq/27-eth007:40:562
1584299149,4cyclictest1100-21sshd11:15:521
1584299148,5cyclictest16834-21sshd12:30:151
1584299148,5cyclictest0-21swapper/108:44:561
1584299142,11cyclictest135650irq/27-eth008:52:191
1584299141,11cyclictest3866-21sshd10:35:021
1584299140,3cyclictest135650irq/27-eth007:46:091
1584299140,13cyclictest5961-21crond07:59:591
1584299140,13cyclictest0-21swapper/109:50:501
1584299140,0cyclictest0-21swapper/108:56:331
1584199149,4cyclictest0-21swapper/008:35:030
1584199144,8cyclictest0-21swapper/009:00:150
1584199140,8cyclictest0-21swapper/008:25:240
1584199140,8cyclictest0-21swapper/008:25:230
1584199140,4cyclictest0-21swapper/007:14:130
1584199140,2cyclictest24190-21sshd10:20:260
1584199140,1cyclictest0-21swapper/007:40:200
1584199140,11cyclictest30389-21kworker/0:011:22:590
1584499139,3cyclictest32086-21diskstats07:45:113
1584499138,4cyclictest1848-21nfsd09:00:133
1584499137,5cyclictest0-21swapper/309:06:193
1584499137,5cyclictest0-21swapper/308:11:573
1584499137,4cyclictest1764-21munin-node07:50:113
1584499131,3cyclictest0-21swapper/308:50:233
1584499131,3cyclictest0-21swapper/307:10:123
1584499130,4cyclictest7881-21taskset08:00:473
1584499130,12cyclictest0-21swapper/308:45:373
1584499130,12cyclictest0-21swapper/308:40:353
1584499130,12cyclictest0-21swapper/308:35:343
1584499130,12cyclictest0-21swapper/307:41:553
1584499130,11cyclictest27976-21iostat_ios07:35:153
1584499130,11cyclictest17891-21df_inode08:25:133
1584499130,11cyclictest17891-21df_inode08:25:133
1584499130,11cyclictest16750-21timerwakeupswit08:20:233
1584499130,11cyclictest13731-21munin-node08:15:143
1584299131,11cyclictest144550irq/28-eth1-rx-08:08:251
15842991311,1cyclictest0-21swapper/107:54:491
1584299130,12cyclictest2904-21taskset09:02:151
1584299130,12cyclictest10754-21munin-node08:10:211
1584299130,12cyclictest0-21swapper/108:38:281
1584299130,12cyclictest0-21swapper/108:31:251
1584299130,12cyclictest0-21swapper/108:02:421
1584299130,12cyclictest0-21swapper/107:23:001
1584299130,12cyclictest0-21swapper/107:13:411
1584199130,12cyclictest29239-21chrt07:39:520
1584199130,12cyclictest0-21swapper/007:52:100
1584199130,10cyclictest0-21swapper/008:31:090
1584199130,10cyclictest0-21swapper/007:20:050
1584499122,9cyclictest0-21swapper/307:25:053
1584499120,3cyclictest24972-21munin-node07:30:113
1584499120,10cyclictest8742-21df08:05:133
1584399127,4cyclictest0-21swapper/208:02:422
1584299127,4cyclictest30194-21sort07:40:131
1584299120,3cyclictest23812-21ntp_states07:25:181
1584299120,11cyclictest0-21swapper/108:20:401
1584299120,11cyclictest0-21swapper/108:17:001
1584199128,2cyclictest0-21swapper/008:10:220
1584199124,4cyclictest0-21swapper/008:05:180
1584199121,1cyclictest0-21swapper/008:22:010
1584199121,1cyclictest0-21swapper/007:55:240
1584199120,11cyclictest0-21swapper/009:09:410
1584199120,11cyclictest0-21swapper/008:46:470
1584199120,11cyclictest0-21swapper/008:15:230
1584199120,11cyclictest0-21swapper/008:01:120
1584199120,11cyclictest0-21swapper/007:27:170
1584199120,11cyclictest0-21swapper/007:15:060
1584199120,10cyclictest0-21swapper/008:54:580
1584199111,1cyclictest0-21swapper/007:30:570
1584199110,2cyclictest0-21swapper/008:55:210
1584199110,1cyclictest0-21swapper/007:45:040
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional