You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-12-26 - 12:28
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot2.osadl.org (updated Thu Dec 26, 2024 00:44:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4282205189,11sleep10-21swapper/119:08:401
307722188173,11sleep00-21swapper/019:05:060
327642180164,12sleep30-21swapper/319:07:013
5532173156,13sleep20-21swapper/219:09:572
30952480,0sleep10-21swapper/121:13:021
280082440,0sleep20-21swapper/200:15:152
117982440,0sleep00-21swapper/022:58:410
133352430,0sleep00-21swapper/022:09:140
56832110,0sleep00-21swapper/000:03:200
294172110,1sleep275199cyclictest23:59:092
7429991,4cyclictest21214-21munin-run19:50:010
7429973,4cyclictest6377-21perf19:20:010
13690270,0sleep10-21swapper/121:18:191
7579960,5cyclictest2521-21ssh21:46:213
7429962,4cyclictest12474-21perf21:35:000
7579951,2cyclictest0-21swapper/322:15:123
7579950,5cyclictest0-21swapper/323:08:013
7579950,5cyclictest0-21swapper/322:25:223
7579950,5cyclictest0-21swapper/321:30:093
7579950,5cyclictest0-21swapper/320:04:583
7579950,0cyclictest2687-21ssh23:44:593
7519955,0cyclictest0-21swapper/223:50:122
7519950,5cyclictest28952-21ssh22:50:252
7519950,5cyclictest28647-21diskmemload23:38:162
7519950,5cyclictest0-21swapper/222:34:072
7519950,5cyclictest0-21swapper/221:35:292
7469952,2cyclictest0-21swapper/119:30:101
7469951,3cyclictest0-21swapper/120:40:101
7469951,2cyclictest0-21swapper/120:30:101
7469950,5cyclictest0-21swapper/123:58:531
7469950,5cyclictest0-21swapper/122:57:551
7429955,0cyclictest0-21swapper/023:30:350
7429950,5cyclictest0-21swapper/022:12:100
7429950,5cyclictest0-21swapper/021:10:010
7429950,4cyclictest17490-21irqstats19:40:150
7429950,4cyclictest0-21swapper/023:10:080
7429950,4cyclictest0-21swapper/021:35:130
7429950,3cyclictest0-21swapper/023:57:370
7429950,1cyclictest8098-21munin-run22:40:010
7429950,1cyclictest8098-21munin-run22:40:010
7579944,0cyclictest0-21swapper/323:25:103
7579944,0cyclictest0-21swapper/321:11:103
7579944,0cyclictest0-21swapper/319:40:133
7579943,1cyclictest6164-21pmu-power00:20:193
7579943,1cyclictest15241-21ntp_kernel_err19:35:143
7579942,1cyclictest3324-21aten2_r5power_c19:15:003
7579942,1cyclictest18752-21ssh23:01:453
7579942,1cyclictest0-21swapper/320:50:103
7579941,3cyclictest28647-21diskmemload23:14:083
7579941,2cyclictest0-21swapper/321:55:113
7579941,2cyclictest0-21swapper/319:15:143
7579941,1cyclictest0-21swapper/323:35:123
7579941,1cyclictest0-21swapper/319:50:103
7579940,4cyclictest24999-21ssh23:56:203
7579940,4cyclictest11815-21ssh21:50:523
7579940,4cyclictest0-21swapper/323:16:303
7579940,4cyclictest0-21swapper/322:40:073
7579940,4cyclictest0-21swapper/322:07:203
7579940,4cyclictest0-21swapper/322:01:103
7579940,4cyclictest0-21swapper/321:40:113
7579940,4cyclictest0-21swapper/321:25:373
7579940,4cyclictest0-21swapper/321:21:063
7579940,4cyclictest0-21swapper/321:15:273
7579940,4cyclictest0-21swapper/320:45:103
7579940,4cyclictest0-21swapper/319:21:193
7579940,4cyclictest0-21swapper/300:30:013
7579940,4cyclictest0-21swapper/300:25:103
7579940,4cyclictest0-21swapper/300:18:213
7579940,4cyclictest0-21swapper/300:10:573
7579940,4cyclictest0-21swapper/300:05:573
7579940,3cyclictest6284-21diskstats23:30:103
7579940,3cyclictest6057-21ssh23:46:573
7579940,3cyclictest4536-21ssh00:36:363
7579940,3cyclictest32115-21perl00:00:153
7579940,3cyclictest30958-21/usr/sbin/munin22:35:163
7579940,3cyclictest30958-21/usr/sbin/munin22:35:153
7579940,3cyclictest27494-21grep22:50:103
7579940,3cyclictest25884-21ssh23:22:393
7579940,3cyclictest25528-21/usr/sbin/munin21:00:183
7579940,3cyclictest23624-21ssh22:30:423
7579940,3cyclictest21356-21sed19:50:003
7579940,3cyclictest1612-21cat20:14:593
7579940,3cyclictest14882-21ssh22:10:033
7579940,3cyclictest13955-21cut20:39:593
7579940,3cyclictest11137-21ssh23:50:013
7579940,0cyclictest0-21swapper/322:57:493
7579940,0cyclictest0-21swapper/321:05:033
7579940,0cyclictest0-21swapper/320:20:233
7519944,0cyclictest0-21swapper/222:37:102
7519944,0cyclictest0-21swapper/222:37:102
7519941,3cyclictest25864-21cut22:15:142
7519941,3cyclictest0-21swapper/219:50:092
7519940,4cyclictest3679-21ssh22:03:282
7519940,4cyclictest28647-21diskmemload21:22:542
7519940,4cyclictest0-21swapper/223:30:072
7519940,4cyclictest0-21swapper/223:16:262
7519940,4cyclictest0-21swapper/222:10:232
7519940,4cyclictest0-21swapper/221:56:372
7519940,4cyclictest0-21swapper/221:52:132
7519940,4cyclictest0-21swapper/221:30:162
7519940,4cyclictest0-21swapper/221:15:102
7519940,4cyclictest0-21swapper/200:14:302
7519940,4cyclictest0-21swapper/200:07:192
7519940,4cyclictest0-21swapper/200:00:452
7519940,3cyclictest9044-21sed20:30:002
7519940,3cyclictest6556-21gpgv22:05:012
7519940,3cyclictest3872-21diskstats19:15:012
7519940,3cyclictest29109-21/usr/sbin/munin21:10:182
7519940,3cyclictest28228-21ssh21:42:162
7519940,3cyclictest26597-21/usr/sbin/munin20:00:202
7519940,3cyclictest26287-21cat21:05:012
7519940,3cyclictest26277-21latency_hist22:50:022
7519940,3cyclictest22471-21ssh00:30:002
7519940,3cyclictest17775-21ntp_states20:45:162
7519940,3cyclictest15525-21smart_sda19:35:172
7519940,3cyclictest14057-21latency_hist00:25:002
7519940,3cyclictest12820-21ntp_states20:35:192
7519940,3cyclictest0-21swapper/223:15:012
7519940,0cyclictest0-21swapper/223:25:372
7519940,0cyclictest0-21swapper/221:49:522
7519940,0cyclictest0-21swapper/221:27:552
7469944,0cyclictest0-21swapper/123:25:251
7469944,0cyclictest0-21swapper/121:49:221
7469944,0cyclictest0-21swapper/120:10:261
7469944,0cyclictest0-21swapper/100:33:041
7469944,0cyclictest0-21swapper/100:12:241
7469941,2cyclictest0-21swapper/122:35:111
7469941,2cyclictest0-21swapper/122:35:111
7469941,2cyclictest0-21swapper/121:55:121
7469941,2cyclictest0-21swapper/121:50:081
7469941,2cyclictest0-21swapper/121:35:141
7469941,2cyclictest0-21swapper/121:00:101
7469941,2cyclictest0-21swapper/120:55:091
7469941,2cyclictest0-21swapper/119:50:091
7469941,2cyclictest0-21swapper/119:35:091
7469941,2cyclictest0-21swapper/119:20:111
7469941,1cyclictest0-21swapper/122:15:111
7469941,1cyclictest0-21swapper/120:35:131
7469941,1cyclictest0-21swapper/120:05:121
7469940,4cyclictest0-21swapper/122:28:221
7469940,2cyclictest0-21swapper/123:00:101
7469940,2cyclictest0-21swapper/100:35:101
7469940,0cyclictest0-21swapper/122:08:271
7469940,0cyclictest0-21swapper/121:25:041
7429944,0cyclictest0-21swapper/022:40:320
7429944,0cyclictest0-21swapper/022:21:180
7429944,0cyclictest0-21swapper/021:59:550
7429943,1cyclictest21688-21cut20:55:110
7429943,1cyclictest20140-21/usr/sbin/munin23:20:120
7429940,4cyclictest0-21swapper/023:40:490
7429940,4cyclictest0-21swapper/023:07:530
7429940,4cyclictest0-21swapper/022:32:180
7429940,4cyclictest0-21swapper/020:20:180
7429940,4cyclictest0-21swapper/000:15:130
7429940,4cyclictest0-21swapper/000:10:150
7429940,3cyclictest7023-21ssh21:15:120
7429940,3cyclictest5446-21ssh21:48:100
7429940,3cyclictest32663-21ssh00:35:020
7429940,3cyclictest30540-21ssh23:25:280
7429940,3cyclictest2991-21ssh23:45:000
7429940,3cyclictest27547-21ssh21:25:310
7429940,3cyclictest25716-21diskstats22:15:140
7429940,3cyclictest23673-21hddtemp_smartct00:30:110
7429940,3cyclictest22872-21taskset21:40:060
7429940,3cyclictest22851-21sh21:22:430
7429940,3cyclictest22155-21perl19:50:120
7429940,3cyclictest18370-21sh23:35:400
7429940,3cyclictest14296-21ssh00:25:010
7429940,3cyclictest10901-21users21:50:170
7429940,3cyclictest10052-21irqstats19:25:160
7429940,3cyclictest0-21swapper/019:35:080
7429940,2cyclictest17123-21ssh22:27:540
7429940,1cyclictest26685-21/usr/sbin/munin22:50:150
7429940,1cyclictest25004-21sed21:00:140
7429940,1cyclictest12711-21ntp_states23:50:130
7429940,0cyclictest0-21swapper/023:18:030
7579930,3cyclictest7016-21expr20:25:123
7579930,3cyclictest29640-21df_inode20:05:133
7579930,3cyclictest2637-21ssh22:20:073
7579930,3cyclictest22725-21awk20:55:163
7579930,3cyclictest15218-21cut20:40:143
7579930,3cyclictest12763-21ssh21:35:043
7579930,3cyclictest0-21swapper/322:45:033
7579930,3cyclictest0-21swapper/320:30:183
7579930,3cyclictest0-21swapper/320:15:133
7579930,3cyclictest0-21swapper/319:55:103
7579930,3cyclictest0-21swapper/319:30:113
7579930,3cyclictest0-21swapper/319:25:113
7519931,1cyclictest30997-21snmpd19:40:112
7519931,1cyclictest0-21swapper/221:05:132
7519930,3cyclictest6588-21apt19:20:102
7519930,3cyclictest32114-21diskstats20:10:122
7519930,3cyclictest28647-21diskmemload23:00:032
7519930,3cyclictest25922-21grep23:40:122
7519930,3cyclictest20557-21ls23:20:132
7519930,3cyclictest12520-21date22:25:022
7519930,3cyclictest0-21swapper/223:45:302
7519930,3cyclictest0-21swapper/223:05:162
7519930,3cyclictest0-21swapper/222:55:012
7519930,3cyclictest0-21swapper/222:40:022
7519930,3cyclictest0-21swapper/222:20:072
7519930,3cyclictest0-21swapper/220:55:092
7519930,3cyclictest0-21swapper/220:50:092
7519930,3cyclictest0-21swapper/220:40:092
7519930,3cyclictest0-21swapper/220:30:102
7519930,3cyclictest0-21swapper/220:20:082
7519930,3cyclictest0-21swapper/220:15:102
7519930,3cyclictest0-21swapper/220:05:122
7519930,3cyclictest0-21swapper/219:55:122
7519930,3cyclictest0-21swapper/219:45:052
7519930,3cyclictest0-21swapper/219:30:112
7519930,3cyclictest0-21swapper/219:25:112
7519930,3cyclictest0-21swapper/219:10:082
7519930,3cyclictest0-21swapper/200:35:042
7519930,3cyclictest0-21swapper/200:25:082
7469933,0cyclictest0-21swapper/122:11:291
7469933,0cyclictest0-21swapper/121:42:331
7469933,0cyclictest0-21swapper/120:48:161
7469931,2cyclictest0-21swapper/100:20:131
7469931,1cyclictest0-21swapper/123:50:091
7469931,1cyclictest0-21swapper/123:40:101
7469931,1cyclictest0-21swapper/123:35:121
7469931,1cyclictest0-21swapper/123:30:081
7469931,1cyclictest0-21swapper/123:20:121
7469931,1cyclictest0-21swapper/123:15:121
7469931,1cyclictest0-21swapper/123:10:071
7469931,1cyclictest0-21swapper/122:50:091
7469931,1cyclictest0-21swapper/122:40:131
7469931,1cyclictest0-21swapper/122:30:081
7469931,1cyclictest0-21swapper/122:00:131
7469931,1cyclictest0-21swapper/121:05:131
7469931,1cyclictest0-21swapper/120:25:101
7469931,1cyclictest0-21swapper/120:20:081
7469931,1cyclictest0-21swapper/120:00:001
7469931,1cyclictest0-21swapper/119:25:101
7469931,1cyclictest0-21swapper/100:00:121
7469930,3cyclictest0-21swapper/120:50:341
7469930,3cyclictest0-21swapper/119:58:031
7469930,3cyclictest0-21swapper/119:17:111
7469930,2cyclictest0-21swapper/122:20:101
7469930,2cyclictest0-21swapper/121:20:121
7469930,2cyclictest0-21swapper/120:15:111
7469930,2cyclictest0-21swapper/100:15:111
7429932,1cyclictest19221-21ssh22:45:340
7429930,3cyclictest12061-21diskstats19:30:120
7429930,3cyclictest0-21swapper/022:00:120
7429930,3cyclictest0-21swapper/021:05:110
7429930,3cyclictest0-21swapper/020:50:120
7429930,3cyclictest0-21swapper/020:45:190
7429930,3cyclictest0-21swapper/020:40:090
7429930,3cyclictest0-21swapper/020:35:010
7429930,3cyclictest0-21swapper/020:30:090
7429930,3cyclictest0-21swapper/020:25:110
7429930,3cyclictest0-21swapper/020:15:110
7429930,3cyclictest0-21swapper/020:10:100
7429930,3cyclictest0-21swapper/020:05:110
7429930,3cyclictest0-21swapper/020:00:000
7429930,3cyclictest0-21swapper/019:55:090
7429930,3cyclictest0-21swapper/019:20:110
7429930,3cyclictest0-21swapper/019:10:090
7429930,3cyclictest0-21swapper/000:20:060
7429930,1cyclictest9081-21ssh00:05:210
7429930,1cyclictest14273-21ssh23:00:070
14335230,0sleep10-21swapper/100:08:411
7469921,1cyclictest0-21swapper/119:40:121
7469921,0cyclictest0-21swapper/121:30:091
7469920,1cyclictest18958-21chrt19:45:071
7469920,1cyclictest18208-21chrt00:27:311
7469920,1cyclictest0-21swapper/123:05:151
7469920,1cyclictest0-21swapper/122:47:291
7469920,1cyclictest0-21swapper/119:10:101
7469910,1cyclictest0-21swapper/123:45:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional