You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-16 - 08:23
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot2.osadl.org (updated Mon Jul 15, 2024 12:44:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
33972205190,10sleep10-21swapper/107:09:231
32352203188,11sleep30-21swapper/307:07:173
25302188169,14sleep00-21swapper/007:05:380
25542158141,12sleep20-21swapper/207:05:552
93352460,0sleep20-21swapper/211:22:052
46562460,0sleep00-21swapper/009:12:050
116632430,0sleep20-21swapper/209:47:222
171302420,0sleep30-21swapper/312:15:033
40392130,0sleep30-21swapper/309:43:553
962290,0sleep30-21swapper/311:50:213
4463290,0sleep10-21swapper/110:00:141
22558290,0sleep00-21swapper/011:12:510
18005290,0sleep20-21swapper/211:59:122
36659962,4cyclictest0-21swapper/011:35:000
36659960,6cyclictest0-21swapper/011:43:190
36659960,6cyclictest0-21swapper/010:50:310
36659960,6cyclictest0-21swapper/010:30:110
36659960,6cyclictest0-21swapper/009:58:080
36659960,5cyclictest7101-21ssh09:45:200
36659960,5cyclictest17475-21ssh10:38:130
36659960,3cyclictest26837-21sendmail-msp12:20:000
36659960,1cyclictest27134-21ssh10:42:570
36659960,1cyclictest0-21swapper/009:54:320
36989955,0cyclictest18155-21kworker/3:010:11:383
36989955,0cyclictest18155-21kworker/3:009:15:403
36989955,0cyclictest0-21swapper/309:47:593
36989954,1cyclictest18155-21kworker/3:010:45:133
36989950,5cyclictest0-21swapper/311:26:103
36989950,5cyclictest0-21swapper/310:23:203
36989950,5cyclictest0-21swapper/310:00:123
36989950,4cyclictest21380-21ntp_states12:00:243
36989950,4cyclictest0-21swapper/308:50:093
36989950,4cyclictest0-21swapper/307:10:023
36989950,4cyclictest0-21swapper/307:10:013
36929954,1cyclictest17461-21ssh09:34:432
36929953,1cyclictest17955-21cron09:35:012
36929952,3cyclictest16834-21ls12:15:012
36929950,5cyclictest0-21swapper/209:27:012
36809955,0cyclictest0-21swapper/112:03:321
36809952,2cyclictest0-21swapper/112:15:111
36809952,2cyclictest0-21swapper/108:20:121
36809951,2cyclictest0-21swapper/112:20:111
36809951,2cyclictest0-21swapper/110:55:141
36809950,5cyclictest0-21swapper/111:02:171
36809950,5cyclictest0-21swapper/110:24:441
36809950,5cyclictest0-21swapper/110:14:591
36659952,3cyclictest29562-21ssh12:05:030
36659952,3cyclictest0-21swapper/012:36:510
36659952,3cyclictest0-21swapper/012:21:440
36659952,3cyclictest0-21swapper/011:26:520
36659952,3cyclictest0-21swapper/011:15:190
36659952,3cyclictest0-21swapper/010:45:590
36659952,3cyclictest0-21swapper/010:10:210
36659952,3cyclictest0-21swapper/010:03:160
36659952,3cyclictest0-21swapper/009:20:200
36659952,3cyclictest0-21swapper/007:10:360
36659952,3cyclictest0-21swapper/007:10:360
36659951,4cyclictest0-21swapper/007:30:230
36659950,5cyclictest32522-21ssh09:41:290
36659950,5cyclictest0-21swapper/012:27:110
36659950,5cyclictest0-21swapper/011:57:520
36659950,5cyclictest0-21swapper/011:50:070
36659950,5cyclictest0-21swapper/011:46:110
36659950,5cyclictest0-21swapper/011:20:550
36659950,5cyclictest0-21swapper/011:00:200
36659950,5cyclictest0-21swapper/010:55:190
36659950,5cyclictest0-21swapper/010:20:080
36659950,5cyclictest0-21swapper/010:15:250
36659950,5cyclictest0-21swapper/010:05:170
36659950,5cyclictest0-21swapper/009:34:320
36659950,5cyclictest0-21swapper/009:15:360
36659950,5cyclictest0-21swapper/008:50:190
36659950,5cyclictest0-21swapper/008:25:150
36659950,5cyclictest0-21swapper/008:10:200
36659950,5cyclictest0-21swapper/007:55:150
36659950,5cyclictest0-21swapper/007:50:150
36659950,5cyclictest0-21swapper/007:35:200
36659950,5cyclictest0-21swapper/007:25:110
36659950,5cyclictest0-21swapper/007:20:350
36659950,4cyclictest2103-21apt-get11:35:110
36659950,4cyclictest0-21swapper/012:10:120
36659950,4cyclictest0-21swapper/009:35:160
36659950,0cyclictest16269-21ssh12:30:200
36659950,0cyclictest0-21swapper/012:02:440
36659950,0cyclictest0-21swapper/011:05:040
36659950,0cyclictest0-21swapper/008:20:230
16755250,0sleep10-21swapper/110:37:451
8910240,0sleep30-21swapper/310:50:123
8848240,3sleep30-21swapper/310:17:593
5980240,0sleep10-21swapper/109:12:531
36989944,0cyclictest0-21swapper/309:10:093
36989944,0cyclictest0-21swapper/307:40:303
36989943,1cyclictest6062-21wc08:15:283
36989942,1cyclictest30997-21snmpd10:37:113
36989942,1cyclictest13852-21ssh11:08:413
36989941,2cyclictest0-21swapper/308:05:123
36989941,1cyclictest0-21swapper/309:00:113
36989940,4cyclictest31675-21diskmemload11:40:103
36989940,4cyclictest31675-21diskmemload09:30:013
36989940,4cyclictest29543-21ssh11:32:113
36989940,4cyclictest0-21swapper/312:36:423
36989940,4cyclictest0-21swapper/312:31:423
36989940,4cyclictest0-21swapper/312:11:523
36989940,4cyclictest0-21swapper/312:05:133
36989940,4cyclictest0-21swapper/311:55:133
36989940,4cyclictest0-21swapper/311:36:503
36989940,4cyclictest0-21swapper/311:19:123
36989940,4cyclictest0-21swapper/310:33:413
36989940,4cyclictest0-21swapper/309:55:103
36989940,4cyclictest0-21swapper/309:27:343
36989940,4cyclictest0-21swapper/307:45:143
36989940,3cyclictest7685-21df08:20:213
36989940,3cyclictest5845-21memory11:20:223
36989940,3cyclictest31675-21diskmemload09:35:033
36989940,3cyclictest30955-21ssh11:49:323
36989940,3cyclictest29551-21df_inode11:00:203
36989940,3cyclictest27314-21apt-get12:20:113
36989940,3cyclictest21822-21perl10:40:203
36989940,3cyclictest19529-21apt-get08:45:093
36989940,3cyclictest18561-21ssh10:55:033
36989940,3cyclictest16413-21/usr/sbin/munin09:50:223
36989940,3cyclictest16224-21ssh11:10:023
36989940,3cyclictest147982sleep307:30:023
36989940,3cyclictest13897-21apt-get10:05:013
36989940,3cyclictest12342-21apt07:25:103
36989940,3cyclictest10509-21fschecks_time07:20:183
36989940,3cyclictest0-21swapper/308:55:093
36989940,3cyclictest0-21swapper/308:30:123
36989940,1cyclictest0-21swapper/309:20:013
36929943,1cyclictest26960-21/usr/sbin/munin09:00:232
36929943,1cyclictest14814-21apt-get07:30:112
36929942,1cyclictest14533-21/usr/sbin/munin11:25:192
36929940,4cyclictest61-21kswapd011:15:012
36929940,4cyclictest12834-21df_inode11:40:162
36929940,4cyclictest0-21swapper/212:35:122
36929940,4cyclictest0-21swapper/212:15:102
36929940,4cyclictest0-21swapper/211:35:102
36929940,4cyclictest0-21swapper/210:31:212
36929940,4cyclictest0-21swapper/210:20:152
36929940,4cyclictest0-21swapper/210:12:252
36929940,4cyclictest0-21swapper/209:10:152
36929940,4cyclictest0-21swapper/208:10:122
36929940,3cyclictest6409-21cat07:15:012
36929940,3cyclictest6409-21cat07:15:012
36929940,3cyclictest29929-21hddtemp_smartct11:00:222
36929940,3cyclictest29589-21sh12:20:322
36929940,3cyclictest22580-21ssh10:25:032
36929940,3cyclictest2164-21cat08:10:002
36929940,3cyclictest19525-21/usr/sbin/munin08:45:172
36929940,3cyclictest18652-21ssh10:55:062
36929940,3cyclictest18386-21memory07:35:242
36929940,3cyclictest17282-21perl09:50:172
36929940,3cyclictest16427-21users08:35:302
36929940,3cyclictest15871-21ssh12:30:152
36929940,3cyclictest15839-21sh10:37:112
36929940,3cyclictest1430-21ntp_states11:50:262
36929940,2cyclictest9843-21ssh12:27:012
36929940,2cyclictest0-21swapper/210:41:442
36929940,1cyclictest27175-21/usr/sbin/munin07:55:192
36929940,1cyclictest19707-21munin-run09:20:022
36929940,1cyclictest18077-21ntp_states11:10:242
36929940,1cyclictest15296-21df10:05:182
36929940,1cyclictest0-21swapper/208:55:112
36809944,0cyclictest0-21swapper/112:05:341
36809944,0cyclictest0-21swapper/110:50:311
36809944,0cyclictest0-21swapper/110:05:161
36809944,0cyclictest0-21swapper/109:55:311
36809944,0cyclictest0-21swapper/109:43:341
36809943,1cyclictest0-21swapper/109:21:441
36809941,2cyclictest0-21swapper/112:25:121
36809941,2cyclictest0-21swapper/112:10:121
36809941,2cyclictest0-21swapper/111:40:101
36809941,2cyclictest0-21swapper/111:15:001
36809941,2cyclictest0-21swapper/109:45:131
36809941,2cyclictest0-21swapper/109:30:131
36809941,2cyclictest0-21swapper/108:55:111
36809941,2cyclictest0-21swapper/108:35:111
36809941,2cyclictest0-21swapper/108:05:121
36809941,2cyclictest0-21swapper/107:35:111
36809941,2cyclictest0-21swapper/107:25:111
36809940,4cyclictest0-21swapper/110:47:441
36809940,4cyclictest0-21swapper/108:48:331
36809940,3cyclictest0-21swapper/112:35:111
36809940,2cyclictest0-21swapper/109:05:121
36809940,0cyclictest0-21swapper/110:44:581
36659941,3cyclictest0-21swapper/008:05:360
36659940,4cyclictest0-21swapper/008:55:510
36659940,4cyclictest0-21swapper/008:40:240
36659940,4cyclictest0-21swapper/008:30:160
36659940,4cyclictest0-21swapper/008:15:090
36659940,3cyclictest9611-21cat07:20:000
36659940,3cyclictest27271-21cut09:00:140
36659940,3cyclictest22824-21sh10:25:100
36659940,3cyclictest22536-21cat07:45:160
36659940,3cyclictest2047-21ssh09:26:280
36659940,3cyclictest19604-21basename08:45:090
36659940,3cyclictest0-21swapper/008:35:110
24596240,0sleep10-21swapper/111:14:041
5994230,0sleep10-21swapper/111:52:561
36989931,1cyclictest6176-21apt-get07:15:023
36989931,1cyclictest0-21swapper/308:00:103
36989930,3cyclictest0-21swapper/312:25:013
36989930,3cyclictest0-21swapper/310:25:103
36989930,3cyclictest0-21swapper/309:05:133
36989930,3cyclictest0-21swapper/308:40:103
36989930,3cyclictest0-21swapper/308:35:113
36989930,3cyclictest0-21swapper/308:25:113
36989930,3cyclictest0-21swapper/308:10:013
36989930,3cyclictest0-21swapper/307:55:093
36989930,3cyclictest0-21swapper/307:50:023
36989930,3cyclictest0-21swapper/307:35:113
36929932,1cyclictest57250irq/125-eth011:05:112
36929932,1cyclictest29432-21apt-get09:05:122
36929931,2cyclictest57250irq/125-eth009:55:062
36929931,2cyclictest30997-21snmpd07:25:072
36929931,1cyclictest30997-21snmpd08:30:002
36929930,3cyclictest6953-21grep07:15:012
36929930,3cyclictest29475-21perl09:40:172
36929930,3cyclictest22037-21rm11:45:042
36929930,3cyclictest19778-21apt07:40:132
36929930,3cyclictest0-21swapper/212:05:122
36929930,3cyclictest0-21swapper/210:50:092
36929930,3cyclictest0-21swapper/210:45:142
36929930,3cyclictest0-21swapper/210:15:072
36929930,3cyclictest0-21swapper/209:20:022
36929930,3cyclictest0-21swapper/208:50:042
36929930,3cyclictest0-21swapper/208:40:002
36929930,3cyclictest0-21swapper/208:25:112
36929930,3cyclictest0-21swapper/208:20:042
36929930,3cyclictest0-21swapper/208:15:022
36929930,3cyclictest0-21swapper/208:00:052
36929930,3cyclictest0-21swapper/207:50:122
36929930,3cyclictest0-21swapper/207:45:142
36929930,3cyclictest0-21swapper/207:20:122
36929930,2cyclictest0-21swapper/211:30:002
36929930,0cyclictest19767-21apt-get12:00:102
36929930,0cyclictest0-21swapper/210:00:132
36809932,1cyclictest0-21swapper/112:30:091
36809931,1cyclictest0-21swapper/111:55:121
36809931,1cyclictest0-21swapper/111:45:111
36809931,1cyclictest0-21swapper/111:30:101
36809931,1cyclictest0-21swapper/111:05:111
36809931,1cyclictest0-21swapper/110:30:131
36809931,1cyclictest0-21swapper/110:25:111
36809931,1cyclictest0-21swapper/109:35:141
36809931,1cyclictest0-21swapper/109:15:121
36809931,1cyclictest0-21swapper/108:50:091
36809931,1cyclictest0-21swapper/108:40:091
36809931,1cyclictest0-21swapper/108:30:131
36809931,1cyclictest0-21swapper/108:00:111
36809931,1cyclictest0-21swapper/107:40:131
36809931,1cyclictest0-21swapper/107:30:121
36809931,1cyclictest0-21swapper/107:20:111
36809931,1cyclictest0-21swapper/107:10:011
36809931,1cyclictest0-21swapper/107:10:011
36809930,2cyclictest9415-21chrt07:17:391
36809930,2cyclictest0-21swapper/111:25:141
36809930,2cyclictest0-21swapper/110:15:121
36809930,2cyclictest0-21swapper/109:50:101
36809930,2cyclictest0-21swapper/109:00:121
36659931,1cyclictest0-21swapper/008:00:100
36659930,3cyclictest0-21swapper/009:05:050
36659930,3cyclictest0-21swapper/007:40:030
36809921,1cyclictest0-21swapper/108:15:091
36809921,1cyclictest0-21swapper/108:10:121
36809921,0cyclictest0-21swapper/107:50:111
36809920,1cyclictest0-21swapper/111:35:101
36809920,1cyclictest0-21swapper/111:20:111
36809920,1cyclictest0-21swapper/109:25:121
36809920,1cyclictest0-21swapper/108:25:121
36809920,1cyclictest0-21swapper/107:55:101
36809920,1cyclictest0-21swapper/107:45:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional