You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-11-23 - 17:32
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot2.osadl.org (updated Sat Nov 23, 2024 12:44:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
52272202187,10sleep10-21swapper/107:08:441
52612186169,12sleep00-21swapper/007:09:110
51002183168,11sleep30-21swapper/307:07:053
53152178161,12sleep20-21swapper/207:09:532
154572470,0sleep20-21swapper/211:42:362
82802440,0sleep00-21swapper/010:33:240
236412440,0sleep30-21swapper/312:35:333
21782440,0sleep10-21swapper/109:58:101
57442430,0sleep00-21swapper/010:48:050
58082420,0sleep10-21swapper/110:15:271
58082420,0sleep10-21swapper/110:15:271
46202400,0sleep30-21swapper/309:27:053
262582110,0sleep1211ktimersoftd/112:04:561
54929970,7cyclictest1127-21diskmemload12:37:210
54929970,7cyclictest1127-21diskmemload10:36:380
55029960,6cyclictest0-21swapper/309:49:173
54979964,2cyclictest0-21swapper/211:17:532
54929961,5cyclictest0-21swapper/009:33:420
54929960,6cyclictest0-21swapper/010:43:420
54929960,6cyclictest0-21swapper/010:26:540
54929960,6cyclictest0-21swapper/010:15:180
54929960,6cyclictest0-21swapper/010:15:180
54929960,5cyclictest1127-21diskmemload12:28:210
54929960,1cyclictest22746-21ssh12:02:410
55029950,5cyclictest0-21swapper/309:24:593
55029950,4cyclictest0-21swapper/309:05:113
55029950,3cyclictest0-21swapper/310:27:203
54979951,4cyclictest19863-21kworker/2:009:40:302
54979950,5cyclictest0-21swapper/210:20:072
54979950,4cyclictest21411-21apt-get10:40:022
54979950,4cyclictest1493-21ssh10:45:252
54979950,4cyclictest10684-21ssh10:34:542
54939952,2cyclictest0-21swapper/108:40:111
54939951,2cyclictest0-21swapper/108:25:111
54939951,2cyclictest0-21swapper/108:20:111
54939950,5cyclictest0-21swapper/112:36:131
54939950,5cyclictest0-21swapper/111:00:461
54939950,5cyclictest0-21swapper/110:39:481
54929952,3cyclictest13595-21apt-get07:25:020
54929952,3cyclictest1127-21diskmemload11:55:250
54929952,3cyclictest0-21swapper/011:40:180
54929952,3cyclictest0-21swapper/010:55:310
54929952,3cyclictest0-21swapper/010:10:180
54929952,3cyclictest0-21swapper/009:40:020
54929951,3cyclictest26894-21/usr/sbin/munin12:05:140
54929951,2cyclictest0-21swapper/011:05:110
54929950,5cyclictest1127-21diskmemload10:23:180
54929950,5cyclictest1127-21diskmemload09:48:260
54929950,5cyclictest0-21swapper/012:20:520
54929950,5cyclictest0-21swapper/012:10:010
54929950,5cyclictest0-21swapper/011:45:140
54929950,5cyclictest0-21swapper/011:37:580
54929950,5cyclictest0-21swapper/011:32:220
54929950,5cyclictest0-21swapper/011:25:500
54929950,5cyclictest0-21swapper/011:23:100
54929950,5cyclictest0-21swapper/011:10:020
54929950,5cyclictest0-21swapper/010:50:380
54929950,5cyclictest0-21swapper/010:00:120
54929950,5cyclictest0-21swapper/009:35:300
54929950,5cyclictest0-21swapper/009:28:100
54929950,5cyclictest0-21swapper/009:22:300
54929950,5cyclictest0-21swapper/008:32:370
54929950,4cyclictest1127-21diskmemload11:00:140
54929950,2cyclictest8631-21sendmail-msp08:20:000
54929950,0cyclictest1127-21diskmemload12:30:090
54929950,0cyclictest1127-21diskmemload11:50:070
54929950,0cyclictest1127-21diskmemload10:05:420
54929950,0cyclictest1127-21diskmemload09:17:020
54929950,0cyclictest0-21swapper/011:17:020
55029944,0cyclictest0-21swapper/309:57:353
55029944,0cyclictest0-21swapper/309:53:483
55029943,1cyclictest12306-21head12:30:173
55029943,1cyclictest0-21swapper/311:17:193
55029941,3cyclictest6180-21cat12:10:213
55029941,3cyclictest30997-21snmpd09:12:203
55029941,3cyclictest14239-21apt-get12:15:123
55029940,4cyclictest18829-21ssh10:05:563
55029940,4cyclictest0-21swapper/312:25:173
55029940,4cyclictest0-21swapper/312:05:133
55029940,4cyclictest0-21swapper/312:01:333
55029940,4cyclictest0-21swapper/311:56:573
55029940,4cyclictest0-21swapper/310:52:023
55029940,4cyclictest0-21swapper/310:38:123
55029940,4cyclictest0-21swapper/310:17:523
55029940,4cyclictest0-21swapper/310:17:523
55029940,4cyclictest0-21swapper/309:44:233
55029940,4cyclictest0-21swapper/309:33:373
55029940,4cyclictest0-21swapper/308:50:223
55029940,4cyclictest0-21swapper/308:45:103
55029940,4cyclictest0-21swapper/307:15:123
55029940,3cyclictest617-21/usr/sbin/munin10:45:163
55029940,3cyclictest31510-21ssh10:12:333
55029940,3cyclictest26724-21sh10:42:133
55029940,3cyclictest2556-21sh10:30:203
55029940,3cyclictest21458-21apt07:40:113
55029940,3cyclictest21004-21sensors_temp10:55:193
55029940,3cyclictest20651-21hddtemp_smartct11:45:143
55029940,3cyclictest16257-21apt08:35:103
55029940,3cyclictest14089-21sh09:15:283
55029940,3cyclictest13689-21sh10:20:133
55029940,3cyclictest10411-21awk11:40:123
55029940,3cyclictest0-21swapper/308:10:123
55029940,1cyclictest5613-21/usr/sbin/munin07:10:163
55029940,1cyclictest30535-21memory11:00:163
55029940,1cyclictest29613-21/usr/sbin/munin11:50:123
55029940,1cyclictest19968-21/usr/sbin/munin09:35:183
55029940,1cyclictest11314-21/usr/sbin/munin08:25:123
55029940,1cyclictest0-21swapper/312:20:133
55029940,0cyclictest57250irq/125-eth011:05:413
55029940,0cyclictest0-21swapper/311:36:493
55029940,0cyclictest0-21swapper/311:25:543
54979944,0cyclictest0-21swapper/212:19:262
54979944,0cyclictest0-21swapper/210:56:562
54979944,0cyclictest0-21swapper/208:35:122
54979944,0cyclictest0-21swapper/208:25:012
54979943,1cyclictest27659-21grep12:05:152
54979942,2cyclictest509-21nscd09:10:232
54979940,4cyclictest28009-21ssh09:55:112
54979940,4cyclictest19863-21kworker/2:007:45:222
54979940,4cyclictest1393-21apt-get08:05:112
54979940,4cyclictest10577-21grep08:20:202
54979940,4cyclictest0-21swapper/212:35:132
54979940,4cyclictest0-21swapper/212:28:532
54979940,4cyclictest0-21swapper/212:22:152
54979940,4cyclictest0-21swapper/212:10:132
54979940,4cyclictest0-21swapper/212:04:412
54979940,4cyclictest0-21swapper/211:50:112
54979940,4cyclictest0-21swapper/211:46:112
54979940,4cyclictest0-21swapper/211:35:122
54979940,4cyclictest0-21swapper/211:30:092
54979940,4cyclictest0-21swapper/211:27:202
54979940,4cyclictest0-21swapper/211:20:112
54979940,4cyclictest0-21swapper/211:10:142
54979940,4cyclictest0-21swapper/211:05:112
54979940,4cyclictest0-21swapper/210:35:132
54979940,4cyclictest0-21swapper/210:25:502
54979940,4cyclictest0-21swapper/210:15:242
54979940,4cyclictest0-21swapper/210:15:242
54979940,4cyclictest0-21swapper/210:06:352
54979940,4cyclictest0-21swapper/209:45:082
54979940,4cyclictest0-21swapper/209:35:112
54979940,4cyclictest0-21swapper/209:30:192
54979940,4cyclictest0-21swapper/209:20:122
54979940,4cyclictest0-21swapper/208:50:122
54979940,3cyclictest9687-21/usr/sbin/munin10:50:152
54979940,3cyclictest6886-21ntp_states07:10:172
54979940,3cyclictest5680-21/usr/sbin/munin10:00:192
54979940,3cyclictest12844-21if_eth009:15:162
54979940,3cyclictest12542-21ssh12:30:182
54979940,3cyclictest1150-21ssh11:01:432
54979940,3cyclictest11098-21latency_hist07:20:012
54939944,0cyclictest0-21swapper/112:21:131
54939944,0cyclictest0-21swapper/112:10:101
54939944,0cyclictest0-21swapper/110:25:151
54939941,2cyclictest0-21swapper/112:30:141
54939941,2cyclictest0-21swapper/111:55:121
54939941,2cyclictest0-21swapper/111:45:111
54939941,2cyclictest0-21swapper/111:35:121
54939941,2cyclictest0-21swapper/110:50:141
54939941,2cyclictest0-21swapper/110:40:121
54939941,2cyclictest0-21swapper/110:20:121
54939941,2cyclictest0-21swapper/109:50:181
54939941,2cyclictest0-21swapper/109:40:121
54939941,2cyclictest0-21swapper/109:30:191
54939941,2cyclictest0-21swapper/109:15:121
54939941,2cyclictest0-21swapper/109:10:171
54939941,2cyclictest0-21swapper/109:05:111
54939941,2cyclictest0-21swapper/108:50:121
54939941,2cyclictest0-21swapper/108:15:131
54939941,2cyclictest0-21swapper/107:40:111
54939941,2cyclictest0-21swapper/107:25:101
54939941,2cyclictest0-21swapper/107:15:121
54939941,2cyclictest0-21swapper/107:10:111
54939941,1cyclictest0-21swapper/107:35:111
54939940,4cyclictest0-21swapper/110:56:061
54939940,4cyclictest0-21swapper/108:49:561
54939940,3cyclictest0-21swapper/112:05:121
54939940,0cyclictest0-21swapper/111:41:211
54939940,0cyclictest0-21swapper/111:09:211
54929941,3cyclictest0-21swapper/009:55:260
54929941,2cyclictest0-21swapper/008:25:100
54929941,1cyclictest0-21swapper/009:00:120
54929940,4cyclictest0-21swapper/012:15:370
54929940,4cyclictest0-21swapper/009:50:170
54929940,4cyclictest0-21swapper/009:11:470
54929940,4cyclictest0-21swapper/008:56:250
54929940,4cyclictest0-21swapper/008:52:050
54929940,4cyclictest0-21swapper/008:46:490
54929940,4cyclictest0-21swapper/008:41:010
54929940,4cyclictest0-21swapper/008:36:250
54929940,4cyclictest0-21swapper/008:20:110
54929940,4cyclictest0-21swapper/008:13:380
54929940,4cyclictest0-21swapper/008:05:060
54929940,4cyclictest0-21swapper/008:00:110
54929940,4cyclictest0-21swapper/007:55:260
54929940,4cyclictest0-21swapper/007:45:500
54929940,4cyclictest0-21swapper/007:36:060
54929940,4cyclictest0-21swapper/007:31:020
54929940,4cyclictest0-21swapper/007:21:020
54929940,4cyclictest0-21swapper/007:12:140
54929940,3cyclictest31840-21df09:05:130
54929940,3cyclictest27252-21ls07:50:120
54929940,1cyclictest10000-21sed07:15:170
54929940,0cyclictest0-21swapper/007:40:020
28293240,0sleep20-21swapper/210:10:332
1446240,0sleep10-21swapper/111:18:291
14064240,1sleep1211ktimersoftd/109:47:571
55029932,1cyclictest9076-21grep08:20:123
55029931,1cyclictest4124-21date11:20:003
55029931,1cyclictest0-21swapper/308:05:113
55029930,3cyclictest5692-21ssh10:00:113
55029930,3cyclictest31357-21apt-get08:00:113
55029930,3cyclictest29683-21hddtemp_smartct09:00:143
55029930,3cyclictest28864-21apt07:55:103
55029930,3cyclictest22199-21ssh11:30:013
55029930,3cyclictest17029-21diskstats07:30:143
55029930,3cyclictest13788-21/usr/sbin/munin08:30:123
55029930,3cyclictest0-21swapper/308:55:103
55029930,3cyclictest0-21swapper/308:40:083
55029930,3cyclictest0-21swapper/308:15:073
55029930,3cyclictest0-21swapper/307:50:093
55029930,3cyclictest0-21swapper/307:45:103
55029930,3cyclictest0-21swapper/307:35:113
55029930,3cyclictest0-21swapper/307:25:013
55029930,3cyclictest0-21swapper/307:20:123
55029930,1cyclictest17245-21taskset11:10:153
54979932,1cyclictest30997-21snmpd08:10:432
54979931,1cyclictest19672-21grep07:35:142
54979931,1cyclictest0-21swapper/208:55:102
54979931,1cyclictest0-21swapper/208:30:122
54979930,3cyclictest7102-21ssh11:55:122
54979930,3cyclictest31940-21ssh09:25:042
54979930,3cyclictest21772-21expr07:40:122
54979930,3cyclictest17689-21ssh09:50:042
54979930,3cyclictest15196-21sed07:25:162
54979930,3cyclictest11354-21apt-get07:20:142
54979930,3cyclictest0-21swapper/209:05:112
54979930,3cyclictest0-21swapper/209:00:112
54979930,3cyclictest0-21swapper/208:45:022
54979930,3cyclictest0-21swapper/208:40:102
54979930,3cyclictest0-21swapper/208:15:142
54979930,3cyclictest0-21swapper/208:00:112
54979930,3cyclictest0-21swapper/207:55:102
54979930,3cyclictest0-21swapper/207:50:072
54979930,3cyclictest0-21swapper/207:30:122
54939933,0cyclictest0-21swapper/111:28:501
54939933,0cyclictest0-21swapper/109:37:501
54939931,1cyclictest0-21swapper/112:25:111
54939931,1cyclictest0-21swapper/112:15:121
54939931,1cyclictest0-21swapper/111:50:111
54939931,1cyclictest0-21swapper/111:30:091
54939931,1cyclictest0-21swapper/111:20:111
54939931,1cyclictest0-21swapper/111:10:141
54939931,1cyclictest0-21swapper/110:30:151
54939931,1cyclictest0-21swapper/110:10:151
54939931,1cyclictest0-21swapper/110:05:121
54939931,1cyclictest0-21swapper/110:00:111
54939931,1cyclictest0-21swapper/108:10:121
54939931,1cyclictest0-21swapper/107:55:101
54939931,1cyclictest0-21swapper/107:30:121
54939931,1cyclictest0-21swapper/107:20:131
54939930,3cyclictest0-21swapper/107:52:451
54939930,2cyclictest0-21swapper/108:30:121
54939930,2cyclictest0-21swapper/108:05:101
54939930,2cyclictest0-21swapper/108:00:111
54939930,1cyclictest0-21swapper/109:25:111
54939921,1cyclictest0-21swapper/109:20:131
54939921,1cyclictest0-21swapper/109:00:111
54939921,1cyclictest0-21swapper/108:35:101
54939920,1cyclictest0-21swapper/110:45:111
54939920,1cyclictest0-21swapper/108:55:101
54939920,1cyclictest0-21swapper/107:45:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional