You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-11-22 - 14:07
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot2.osadl.org (updated Fri Nov 22, 2024 12:44:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
128822195178,12sleep30-21swapper/307:05:483
130042194178,11sleep10-21swapper/107:07:241
128742187171,12sleep00-21swapper/007:05:420
13106211186,20sleep20-21swapper/207:08:402
33752480,0sleep20-21swapper/209:22:282
115242450,0sleep10-21swapper/111:04:041
167962390,0sleep10-21swapper/110:18:191
50462150,0sleep10-21swapper/112:05:201
319452100,0sleep2301ktimersoftd/209:36:202
1340099103,3cyclictest13062-21munin-run11:05:010
2706290,0sleep10-21swapper/110:27:131
24672280,0sleep10-21swapper/110:05:351
134009970,7cyclictest0-21swapper/009:05:140
134009970,6cyclictest5773-21ntp_states09:00:160
25720260,0sleep325723-21pmu-power07:30:193
25720260,0sleep325723-21pmu-power07:30:183
134149960,5cyclictest14620-21apt-get08:15:013
134009962,4cyclictest0-21swapper/010:41:490
134009962,4cyclictest0-21swapper/009:44:300
134009962,4cyclictest0-21swapper/009:14:180
134009961,5cyclictest0-21swapper/011:16:080
134009960,6cyclictest0-21swapper/012:34:050
134009960,6cyclictest0-21swapper/012:28:530
134009960,6cyclictest0-21swapper/012:24:440
134009960,6cyclictest0-21swapper/012:05:050
134009960,6cyclictest0-21swapper/011:45:320
134009960,6cyclictest0-21swapper/011:41:280
134009960,6cyclictest0-21swapper/011:37:440
134009960,6cyclictest0-21swapper/011:31:330
134009960,6cyclictest0-21swapper/011:27:090
134009960,6cyclictest0-21swapper/011:09:050
134009960,6cyclictest0-21swapper/010:58:410
134009960,6cyclictest0-21swapper/010:36:210
134009960,6cyclictest0-21swapper/010:20:040
134009960,5cyclictest9226-21diskmemload09:25:450
134009960,1cyclictest5268-21ssh10:12:260
134009960,1cyclictest20452-21ssh09:30:290
12873260,0sleep20-21swapper/209:43:212
23677250,0sleep20-21swapper/209:16:162
134149955,0cyclictest16134-21kworker/3:212:25:493
134149955,0cyclictest0-21swapper/310:34:213
134149955,0cyclictest0-21swapper/309:40:143
134149953,1cyclictest20024-21/usr/sbin/munin10:20:163
134149953,1cyclictest1960-21/usr/sbin/munin09:55:163
134149950,5cyclictest0-21swapper/310:01:543
134149950,4cyclictest18386-21apt-get11:40:113
134149950,4cyclictest0-21swapper/311:05:123
134149950,4cyclictest0-21swapper/310:35:023
134149950,4cyclictest0-21swapper/308:25:123
134149950,1cyclictest0-21swapper/309:10:163
134109955,0cyclictest0-21swapper/207:10:202
134109952,3cyclictest19703-21ssh09:47:282
134109952,3cyclictest1718-21ssh10:26:352
134109950,5cyclictest0-21swapper/212:07:022
134109950,5cyclictest0-21swapper/210:00:262
134109950,5cyclictest0-21swapper/209:53:452
134109950,5cyclictest0-21swapper/209:33:312
134049951,3cyclictest0-21swapper/111:05:111
134049951,3cyclictest0-21swapper/109:35:111
134049951,3cyclictest0-21swapper/109:00:111
134049951,2cyclictest0-21swapper/112:15:121
134049951,2cyclictest0-21swapper/111:50:141
134049951,2cyclictest0-21swapper/108:25:121
134049951,2cyclictest0-21swapper/107:35:111
134049950,5cyclictest0-21swapper/112:35:441
134049950,5cyclictest0-21swapper/111:37:491
134049950,5cyclictest0-21swapper/110:12:331
134009952,3cyclictest30824-21/usr/sbin/munin07:40:170
134009952,3cyclictest0-21swapper/010:45:240
134009952,3cyclictest0-21swapper/008:24:570
134009952,3cyclictest0-21swapper/008:05:000
134009952,3cyclictest0-21swapper/007:34:560
134009952,3cyclictest0-21swapper/007:34:560
134009950,5cyclictest21025-21ssh09:15:140
134009950,5cyclictest0-21swapper/012:35:010
134009950,5cyclictest0-21swapper/012:15:120
134009950,5cyclictest0-21swapper/012:10:440
134009950,5cyclictest0-21swapper/012:00:010
134009950,5cyclictest0-21swapper/011:55:010
134009950,5cyclictest0-21swapper/011:50:080
134009950,5cyclictest0-21swapper/011:20:160
134009950,5cyclictest0-21swapper/011:10:040
134009950,5cyclictest0-21swapper/010:50:120
134009950,5cyclictest0-21swapper/010:30:130
134009950,5cyclictest0-21swapper/010:25:320
134009950,5cyclictest0-21swapper/010:15:280
134009950,5cyclictest0-21swapper/010:05:500
134009950,5cyclictest0-21swapper/009:55:050
134009950,5cyclictest0-21swapper/009:50:010
134009950,5cyclictest0-21swapper/009:45:140
134009950,5cyclictest0-21swapper/009:36:140
134009950,5cyclictest0-21swapper/009:20:010
134009950,5cyclictest0-21swapper/008:50:010
134009950,5cyclictest0-21swapper/008:45:210
134009950,5cyclictest0-21swapper/008:40:210
134009950,5cyclictest0-21swapper/008:35:000
134009950,5cyclictest0-21swapper/008:30:000
134009950,5cyclictest0-21swapper/008:25:000
134009950,5cyclictest0-21swapper/008:15:170
134009950,5cyclictest0-21swapper/008:04:560
134009950,5cyclictest0-21swapper/007:55:200
134009950,5cyclictest0-21swapper/007:50:130
134009950,5cyclictest0-21swapper/007:45:370
134009950,5cyclictest0-21swapper/007:39:560
134009950,5cyclictest0-21swapper/007:10:130
134009950,4cyclictest0-21swapper/007:25:120
12613250,0sleep00-21swapper/010:00:130
4977240,0sleep30-21swapper/311:33:093
134149944,0cyclictest16134-21kworker/3:208:41:533
134149944,0cyclictest0-21swapper/312:07:553
134149944,0cyclictest0-21swapper/311:35:553
134149944,0cyclictest0-21swapper/311:27:203
134149944,0cyclictest0-21swapper/310:19:583
134149944,0cyclictest0-21swapper/309:35:443
134149943,1cyclictest7006-21/usr/sbin/munin08:00:163
134149942,1cyclictest32221-21ssh10:25:223
134149942,1cyclictest23258-21if_eth410:05:143
134149942,1cyclictest19627-21ssh12:13:203
134149942,1cyclictest11678-21df_inode11:20:123
134149941,3cyclictest28519-21tr10:40:193
134149941,3cyclictest16134-21kworker/3:211:48:483
134149940,4cyclictest25176-21hddtemp_smartct09:50:123
134149940,4cyclictest0-21swapper/312:35:483
134149940,4cyclictest0-21swapper/312:22:413
134149940,4cyclictest0-21swapper/311:59:533
134149940,4cyclictest0-21swapper/311:15:103
134149940,4cyclictest0-21swapper/311:10:163
134149940,4cyclictest0-21swapper/310:50:173
134149940,4cyclictest0-21swapper/309:49:183
134149940,4cyclictest0-21swapper/309:25:583
134149940,4cyclictest0-21swapper/307:10:023
134149940,3cyclictest5466-21sh11:50:003
134149940,3cyclictest4504-21/usr/sbin/munin09:00:183
134149940,3cyclictest25676-21ssh10:55:053
134149940,3cyclictest19366-21date07:20:003
134149940,3cyclictest0-21swapper/308:50:123
134149940,1cyclictest32457-21/usr/sbin/munin10:10:193
134149940,1cyclictest24538-21/usr/sbin/munin08:35:203
134149940,1cyclictest22069-21/usr/sbin/munin08:30:143
134149940,1cyclictest18194-21/usr/sbin/munin09:30:213
134149940,1cyclictest17130-21/usr/sbin/munin08:20:143
134109944,0cyclictest0-21swapper/212:31:102
134109944,0cyclictest0-21swapper/209:04:522
134109943,1cyclictest7772-21gltestperf09:05:162
134109943,1cyclictest11401-21tr11:20:112
134109942,2cyclictest20747-21ssh11:57:162
134109942,1cyclictest29694-21ssh11:45:182
134109941,3cyclictest22031-21ssh10:52:572
134109940,4cyclictest5324-21cat11:00:182
134109940,4cyclictest0-21swapper/212:35:122
134109940,4cyclictest0-21swapper/212:28:532
134109940,4cyclictest0-21swapper/212:20:112
134109940,4cyclictest0-21swapper/212:15:122
134109940,4cyclictest0-21swapper/212:00:092
134109940,4cyclictest0-21swapper/211:50:132
134109940,4cyclictest0-21swapper/211:15:122
134109940,4cyclictest0-21swapper/210:45:112
134109940,4cyclictest0-21swapper/210:30:142
134109940,4cyclictest0-21swapper/210:23:402
134109940,4cyclictest0-21swapper/210:15:122
134109940,4cyclictest0-21swapper/210:05:092
134109940,4cyclictest0-21swapper/209:10:112
134109940,4cyclictest0-21swapper/208:46:132
134109940,4cyclictest0-21swapper/208:40:102
134109940,4cyclictest0-21swapper/208:35:122
134109940,4cyclictest0-21swapper/208:20:132
134109940,4cyclictest0-21swapper/208:15:112
134109940,4cyclictest0-21swapper/207:35:112
134109940,4cyclictest0-21swapper/207:20:102
134109940,3cyclictest3138-21apt-key11:00:012
134109940,3cyclictest26607-21latency_hist07:35:012
134109940,3cyclictest24707-21ssh11:26:202
134109940,3cyclictest22568-21perl07:25:132
134109940,3cyclictest17606-21apt-config10:35:012
134109940,3cyclictest17196-21ssh12:11:462
134109940,3cyclictest16300-21hddtemp_smartct07:15:002
134049944,0cyclictest0-21swapper/111:25:191
134049944,0cyclictest0-21swapper/110:49:051
134049944,0cyclictest0-21swapper/109:53:041
134049944,0cyclictest0-21swapper/108:55:171
134049942,1cyclictest0-21swapper/111:40:121
134049941,2cyclictest0-21swapper/112:30:161
134049941,2cyclictest0-21swapper/112:20:121
134049941,2cyclictest0-21swapper/111:20:111
134049941,2cyclictest0-21swapper/111:15:121
134049941,2cyclictest0-21swapper/110:55:121
134049941,2cyclictest0-21swapper/110:40:161
134049941,2cyclictest0-21swapper/110:20:121
134049941,2cyclictest0-21swapper/109:15:011
134049941,2cyclictest0-21swapper/109:10:121
134049941,2cyclictest0-21swapper/108:50:111
134049941,2cyclictest0-21swapper/108:45:111
134049941,2cyclictest0-21swapper/108:10:111
134049941,2cyclictest0-21swapper/108:05:131
134049941,2cyclictest0-21swapper/107:45:101
134049941,2cyclictest0-21swapper/107:40:111
134049941,2cyclictest0-21swapper/107:10:111
134049940,4cyclictest0-21swapper/112:02:511
134049940,4cyclictest0-21swapper/110:04:171
134049940,2cyclictest0-21swapper/110:50:161
134049940,2cyclictest0-21swapper/108:40:111
134049940,2cyclictest0-21swapper/108:30:111
134049940,0cyclictest0-21swapper/112:26:171
134049940,0cyclictest0-21swapper/110:33:491
134009942,1cyclictest2958-21cat08:55:140
134009941,3cyclictest0-21swapper/008:10:010
134009941,3cyclictest0-21swapper/007:15:130
134009940,4cyclictest0-21swapper/007:20:210
134149932,1cyclictest25490-21ssh12:00:083
134149931,1cyclictest0-21swapper/307:35:103
134149930,3cyclictest5575-21sh10:45:093
134149930,3cyclictest381rcuc/311:00:023
134149930,3cyclictest29448-21sed07:40:003
134149930,3cyclictest20880-21df_inode12:30:183
134149930,3cyclictest20066-21apt-get09:15:103
134149930,3cyclictest19429-21apt-get07:20:113
134149930,3cyclictest0-21swapper/312:15:023
134149930,3cyclictest0-21swapper/309:20:133
134149930,3cyclictest0-21swapper/309:05:133
134149930,3cyclictest0-21swapper/308:55:113
134149930,3cyclictest0-21swapper/308:45:123
134149930,3cyclictest0-21swapper/308:10:103
134149930,3cyclictest0-21swapper/308:05:113
134149930,3cyclictest0-21swapper/307:55:123
134149930,3cyclictest0-21swapper/307:50:113
134149930,3cyclictest0-21swapper/307:45:113
134149930,3cyclictest0-21swapper/307:25:173
134109933,0cyclictest0-21swapper/208:25:082
134109932,1cyclictest6744-21cron08:00:012
134109932,1cyclictest30972-21ssh11:30:122
134109930,3cyclictest7740-21ssh09:25:022
134109930,3cyclictest31975-21apt-get08:50:122
134109930,3cyclictest29088-21apt-get07:40:012
134109930,3cyclictest2048-21apt-get07:50:112
134109930,3cyclictest13351-21ssh11:05:032
134109930,3cyclictest0-21swapper/211:40:022
134109930,3cyclictest0-21swapper/211:35:022
134109930,3cyclictest0-21swapper/211:10:022
134109930,3cyclictest0-21swapper/210:40:172
134109930,3cyclictest0-21swapper/210:10:172
134109930,3cyclictest0-21swapper/209:55:112
134109930,3cyclictest0-21swapper/208:55:112
134109930,3cyclictest0-21swapper/208:30:112
134109930,3cyclictest0-21swapper/208:10:162
134109930,3cyclictest0-21swapper/208:05:002
134109930,3cyclictest0-21swapper/207:55:122
134109930,3cyclictest0-21swapper/207:45:002
134109930,3cyclictest0-21swapper/207:30:122
134049933,0cyclictest0-21swapper/109:07:061
134049931,2cyclictest0-21swapper/108:15:111
134049931,1cyclictest0-21swapper/112:10:151
134049931,1cyclictest0-21swapper/111:45:121
134049931,1cyclictest0-21swapper/111:10:011
134049931,1cyclictest0-21swapper/110:35:081
134049931,1cyclictest0-21swapper/109:20:121
134049931,1cyclictest0-21swapper/108:00:111
134049931,1cyclictest0-21swapper/107:55:111
134049931,1cyclictest0-21swapper/107:50:101
134049931,1cyclictest0-21swapper/107:30:121
134049931,1cyclictest0-21swapper/107:30:111
134049931,1cyclictest0-21swapper/107:25:101
134049930,3cyclictest0-21swapper/108:20:391
134049930,2cyclictest0-21swapper/111:55:101
134049930,2cyclictest0-21swapper/111:30:121
134049921,1cyclictest0-21swapper/107:15:101
134049921,0cyclictest0-21swapper/109:25:121
134049920,2cyclictest0-21swapper/109:55:111
134049920,1cyclictest0-21swapper/109:46:181
134049920,1cyclictest0-21swapper/109:40:111
134049920,1cyclictest0-21swapper/109:30:141
134049920,1cyclictest0-21swapper/108:35:121
134049920,1cyclictest0-21swapper/107:20:101
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional