You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-11-23 - 20:32

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Sat Nov 23, 2024 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2680821340,1sleep126809-21sh12:00:591
81272122111,6sleep30-21swapper/307:09:163
8042211695,16sleep00-21swapper/007:08:080
8147211594,16sleep10-21swapper/107:09:301
7895210378,19sleep20-21swapper/207:06:142
132442700,0sleep20-21swapper/210:39:152
291772690,0sleep30-21swapper/310:55:163
298782680,0sleep10-21swapper/109:49:081
287552680,0sleep10-21swapper/109:14:091
821499265,19cyclictest203450irq/24-eth109:55:111
821499231,20cyclictest0-21swapper/110:20:131
8215992213,8cyclictest0-21swapper/208:50:122
821499221,19cyclictest0-21swapper/109:50:161
8213992217,3cyclictest1948-21ssh12:10:130
126142220,1sleep10-21swapper/109:30:241
821599210,19cyclictest0-21swapper/209:30:192
821399211,18cyclictest0-21swapper/008:50:130
821699202,11cyclictest0-21swapper/310:18:023
821699200,4cyclictest0-21swapper/312:01:033
821699200,18cyclictest0-21swapper/309:50:163
8214992017,2cyclictest28872-21kworker/u8:208:44:021
8214992017,2cyclictest24436-21kworker/u8:212:34:041
821499200,18cyclictest0-21swapper/112:35:141
8213992017,2cyclictest31746-21kworker/u8:009:22:040
8213991916,2cyclictest6979-21kworker/u8:109:26:050
8213991916,2cyclictest1506-21kworker/u8:210:46:050
821399191,16cyclictest0-21swapper/009:30:180
821599180,2cyclictest0-21swapper/211:10:132
8214991815,2cyclictest31746-21kworker/u8:009:24:051
821499181,2cyclictest0-21swapper/112:11:051
134612180,0sleep20-21swapper/211:47:342
821699171,14cyclictest29606-21ntp_states08:00:173
8214991714,2cyclictest24883-21kworker/u8:209:38:041
8214991714,2cyclictest13129-21kworker/u8:107:37:051
8213991714,2cyclictest30513-21kworker/u8:010:58:040
8213991714,2cyclictest12621-21kworker/u8:010:07:050
8213991714,2cyclictest12621-21kworker/u8:010:07:040
8213991713,2cyclictest31746-21kworker/u8:009:17:050
101492170,0sleep30-21swapper/310:01:253
821599160,3cyclictest29812-21timerandwakeup10:55:252
821599160,14cyclictest0-21swapper/209:45:252
8214991613,2cyclictest3894-21kworker/u8:007:17:041
8214991613,2cyclictest28872-21kworker/u8:208:27:041
8214991613,2cyclictest28872-21kworker/u8:208:04:031
8214991613,2cyclictest26315-21kworker/u8:008:39:041
8214991613,2cyclictest24542-21kworker/u8:110:18:051
8214991613,2cyclictest20184-21kworker/u8:112:08:051
8214991613,2cyclictest16480-21kworker/u8:111:30:041
8214991613,2cyclictest16000-21kworker/u8:207:28:041
8214991613,2cyclictest13954-21kworker/u8:010:41:051
8214991612,2cyclictest3745-21runrttasks08:15:121
821499161,13cyclictest27327-21iostat_ios07:55:151
8214991611,3cyclictest0-21swapper/110:25:241
821499161,13cyclictest0-21swapper/109:19:441
8213991613,2cyclictest29503-21kworker/u8:011:31:050
8213991613,2cyclictest16480-21kworker/u8:111:22:050
8213991611,3cyclictest0-21swapper/010:23:470
821399160,3cyclictest24582-21diskmemload12:22:070
8216991511,2cyclictest0-21swapper/310:08:583
8216991511,2cyclictest0-21swapper/310:08:583
821699150,13cyclictest13129-21kworker/u8:107:50:053
821699150,13cyclictest0-21swapper/309:57:483
8215991511,2cyclictest0-21swapper/212:30:282
8215991511,2cyclictest0-21swapper/212:04:272
8215991511,2cyclictest0-21swapper/210:08:132
8215991511,2cyclictest0-21swapper/210:08:122
821599150,2cyclictest0-21swapper/209:57:452
821599150,13cyclictest15766-21df_abs11:15:142
821599150,13cyclictest0-21swapper/207:25:152
8214991512,2cyclictest7000-21kworker/u8:012:29:041
8214991512,2cyclictest3755-21kworker/u8:111:06:041
8214991512,2cyclictest31746-21kworker/u8:009:25:051
8214991512,2cyclictest30513-21kworker/u8:011:13:051
8214991512,2cyclictest2627-21kworker/u8:211:36:051
8214991512,2cyclictest24883-21kworker/u8:209:40:041
8214991512,2cyclictest13129-21kworker/u8:107:34:041
8214991512,2cyclictest12734-21kworker/u8:109:01:051
8214991512,2cyclictest12621-21kworker/u8:010:11:051
8214991511,2cyclictest6892-21apt-get12:15:121
8214991511,2cyclictest0-21swapper/111:20:121
8214991510,3cyclictest851-21ssh11:00:111
821499150,7cyclictest0-21swapper/111:45:041
821499150,2cyclictest0-21swapper/111:42:491
821499150,13cyclictest0-21swapper/110:47:051
821499150,13cyclictest0-21swapper/110:04:111
821499150,10cyclictest0-21swapper/108:57:051
821399152,7cyclictest0-21swapper/010:35:010
8213991512,2cyclictest24582-21diskmemload10:39:170
8213991512,2cyclictest12621-21kworker/u8:010:14:030
8213991511,2cyclictest0-21swapper/011:35:070
821399151,12cyclictest0-21swapper/009:40:260
821399150,2cyclictest24582-21diskmemload11:16:560
821399150,13cyclictest0-21swapper/009:46:470
85162140,3sleep08526-21ssh11:42:190
821699148,5cyclictest3011-21nscd11:27:053
8216991411,2cyclictest0-21swapper/309:22:583
8216991410,2cyclictest0-21swapper/309:25:233
821699140,2cyclictest0-21swapper/311:23:583
821699140,2cyclictest0-21swapper/309:43:183
821699140,13cyclictest20184-21kworker/u8:112:09:043
821699140,13cyclictest0-21swapper/311:39:473
821699140,12cyclictest23321-21rm11:58:033
821699140,12cyclictest0-21swapper/312:16:493
8215991411,2cyclictest0-21swapper/212:28:442
821599140,2cyclictest6889-21ssh09:25:052
821599140,2cyclictest0-21swapper/211:28:142
821599140,2cyclictest0-21swapper/211:08:352
8214991411,2cyclictest18080-21kworker/u8:007:42:041
821499140,2cyclictest0-21swapper/111:26:381
821499140,2cyclictest0-21swapper/110:37:281
821499140,12cyclictest0-21swapper/111:55:451
821499140,12cyclictest0-21swapper/110:56:321
821499140,12cyclictest0-21swapper/110:30:251
821399142,7cyclictest0-21swapper/012:10:010
821399142,7cyclictest0-21swapper/011:15:000
821399142,7cyclictest0-21swapper/009:40:000
8213991411,2cyclictest0-21swapper/012:38:470
8213991411,2cyclictest0-21swapper/012:30:070
8213991411,2cyclictest0-21swapper/011:06:070
8213991411,2cyclictest0-21swapper/010:28:360
8213991410,2cyclictest4133-21ssh11:03:040
821399140,3cyclictest0-21swapper/012:15:190
821399140,2cyclictest0-21swapper/009:12:070
821399140,2cyclictest0-21swapper/008:15:260
821399140,13cyclictest0-21swapper/012:26:060
821399140,13cyclictest0-21swapper/008:40:160
821399140,12cyclictest0-21swapper/011:55:250
821699135,5cyclictest0-21swapper/307:21:593
821699131,2cyclictest0-21swapper/311:00:103
8216991310,2cyclictest24582-21diskmemload12:33:543
8216991310,2cyclictest24582-21diskmemload10:45:103
8216991310,2cyclictest0-21swapper/312:24:583
8216991310,2cyclictest0-21swapper/312:10:513
8216991310,2cyclictest0-21swapper/311:50:253
8216991310,2cyclictest0-21swapper/311:45:123
8216991310,2cyclictest0-21swapper/311:15:003
8216991310,2cyclictest0-21swapper/311:11:203
8216991310,2cyclictest0-21swapper/310:28:383
8216991310,2cyclictest0-21swapper/308:10:223
8216991310,2cyclictest0-21swapper/307:25:183
821699130,2cyclictest26009-21cut12:35:133
821699130,2cyclictest0-21swapper/310:20:363
821699130,2cyclictest0-21swapper/309:45:443
821699130,12cyclictest0-21swapper/311:40:213
821699130,12cyclictest0-21swapper/311:08:483
821699130,12cyclictest0-21swapper/310:36:433
821699130,12cyclictest0-21swapper/310:30:383
821699130,12cyclictest0-21swapper/310:11:303
821699130,11cyclictest0-21swapper/309:30:103
8215991310,2cyclictest18574-21ssh10:10:222
8215991310,2cyclictest0-21swapper/212:19:132
8215991310,2cyclictest0-21swapper/211:52:252
8215991310,2cyclictest0-21swapper/211:39:492
8215991310,2cyclictest0-21swapper/210:18:502
8215991310,2cyclictest0-21swapper/207:50:232
821599130,2cyclictest31314-21ssh12:05:352
821599130,2cyclictest24280-21ssh11:59:352
821599130,2cyclictest0-21swapper/212:36:162
821599130,2cyclictest0-21swapper/212:10:152
821599130,2cyclictest0-21swapper/210:28:542
821599130,2cyclictest0-21swapper/210:03:252
821599130,2cyclictest0-21swapper/209:18:342
821599130,12cyclictest0-21swapper/211:30:132
821599130,12cyclictest0-21swapper/210:51:182
821599130,11cyclictest0-21swapper/209:41:342
821499131,10cyclictest0-21swapper/108:20:141
821499131,10cyclictest0-21swapper/108:10:201
8214991310,2cyclictest12734-21kworker/u8:108:46:051
8214991310,2cyclictest10480-21kworker/u8:211:15:051
8214991310,2cyclictest0-21swapper/111:52:501
821499130,12cyclictest0-21swapper/110:08:391
821499130,12cyclictest0-21swapper/110:08:381
821399132,6cyclictest0-21swapper/008:00:010
8213991310,2cyclictest0-21swapper/012:00:170
8213991310,2cyclictest0-21swapper/011:51:440
821399130,12cyclictest0-21swapper/009:56:160
821399130,11cyclictest24582-21diskmemload11:47:050
241312130,2sleep024582-21diskmemload10:15:530
821699129,2cyclictest16472-21apt-get12:25:113
821699129,2cyclictest0-21swapper/311:31:093
821699129,2cyclictest0-21swapper/309:35:163
821699129,2cyclictest0-21swapper/309:10:163
821699122,7cyclictest0-21swapper/309:02:583
821699122,7cyclictest0-21swapper/308:06:023
821699122,7cyclictest0-21swapper/307:17:593
821699120,2cyclictest0-21swapper/310:40:163
821699120,2cyclictest0-21swapper/307:40:243
821699120,11cyclictest0-21swapper/310:50:203
821699120,11cyclictest0-21swapper/309:16:193
821699120,11cyclictest0-21swapper/308:55:233
821699120,11cyclictest0-21swapper/308:50:133
821699120,11cyclictest0-21swapper/308:15:193
821599129,2cyclictest0-21swapper/212:21:442
821599129,2cyclictest0-21swapper/210:43:252
821599129,2cyclictest0-21swapper/209:20:132
821599129,2cyclictest0-21swapper/209:11:042
821599129,2cyclictest0-21swapper/207:20:172
821599122,7cyclictest0-21swapper/208:36:592
821599120,2cyclictest0-21swapper/210:30:492
821599120,2cyclictest0-21swapper/209:36:182
821599120,11cyclictest0-21swapper/211:41:182
821599120,11cyclictest0-21swapper/211:20:022
821599120,11cyclictest0-21swapper/211:02:512
821599120,11cyclictest0-21swapper/210:47:052
821599120,11cyclictest0-21swapper/210:20:132
821599120,11cyclictest0-21swapper/209:51:062
821599120,11cyclictest0-21swapper/208:45:172
821499129,2cyclictest0-21swapper/112:20:141
821499129,2cyclictest0-21swapper/108:50:021
821499129,2cyclictest0-21swapper/107:45:181
821499128,3cyclictest0-21swapper/108:30:151
821499127,3cyclictest0-21swapper/107:10:231
821499121,9cyclictest23992-21cpuspeed_turbos10:50:161
821499121,9cyclictest0-21swapper/107:20:141
821499121,3cyclictest30865-21munin-node1
821499120,10cyclictest0-21swapper/109:05:101
821399129,2cyclictest0-21swapper/009:51:280
821399128,2cyclictest3558-21snmpd08:23:050
821399122,7cyclictest0-21swapper/007:25:020
821399122,7cyclictest0-21swapper/007:20:020
821399120,2cyclictest0-21swapper/011:28:590
821399120,2cyclictest0-21swapper/007:35:290
821399120,11cyclictest0-21swapper/010:52:050
821399120,11cyclictest0-21swapper/010:41:080
821699112,7cyclictest0-21swapper/307:47:593
821699112,6cyclictest0-21swapper/307:35:013
821699112,6cyclictest0-21swapper/307:12:023
821599118,2cyclictest0-21swapper/209:00:142
821599118,2cyclictest0-21swapper/208:04:342
821599112,6cyclictest0-21swapper/209:06:592
821599112,6cyclictest0-21swapper/207:35:592
821599112,6cyclictest0-21swapper/207:31:022
821599111,7cyclictest0-21swapper/207:44:592
821499110,9cyclictest0-21swapper/107:50:091
821399118,2cyclictest12734-21kworker/u8:108:55:050
821399118,2cyclictest0-21swapper/010:03:480
821399112,7cyclictest0-21swapper/008:30:000
821399112,7cyclictest0-21swapper/007:48:020
821399112,6cyclictest4572-21gdm-simple-gree08:39:590
821399111,6cyclictest0-21swapper/008:08:010
821399110,10cyclictest0-21swapper/008:45:190
821699107,2cyclictest0-21swapper/308:40:243
821699107,2cyclictest0-21swapper/307:55:213
821699105,3cyclictest11156-21cut08:35:143
821699102,7cyclictest0-21swapper/308:48:023
821699100,7cyclictest0-21swapper/307:33:593
821599102,5cyclictest0-21swapper/208:25:222
821599101,4cyclictest0-21swapper/209:00:002
821599100,7cyclictest0-21swapper/208:32:592
821399107,2cyclictest26315-21kworker/u8:008:31:040
821399105,3cyclictest8970-21fschecks_time07:10:140
821399105,3cyclictest23016-21cpuspeed_turbos09:05:110
821399105,3cyclictest17359-21needreboot07:30:190
821399102,5cyclictest4566-21metacity07:52:590
821399100,2cyclictest0-21swapper/008:10:270
305552100,2sleep00-21swapper/008:04:420
82169994,2cyclictest0-21swapper/308:25:033
82169992,6cyclictest0-21swapper/309:05:243
82159996,2cyclictest0-21swapper/208:21:362
82159994,3cyclictest31526-21interrupts08:05:152
82159994,3cyclictest3103-21if_eth008:15:162
82159994,3cyclictest1031-21if_err_eth008:10:162
82159992,5cyclictest0-21swapper/207:55:232
82159991,3cyclictest22893-21grep07:45:152
82159990,8cyclictest0-21swapper/207:10:232
82139996,2cyclictest10693-21cpuspeed_turbos07:15:130
82139994,3cyclictest3011-21nscd07:40:110
82139994,3cyclictest21263-21grep09:00:150
82169985,2cyclictest6018-21grep08:20:263
82169980,7cyclictest26315-21kworker/u8:008:30:053
82159983,3cyclictest14633-21latency_hist08:44:592
82159983,3cyclictest10740-21expr07:15:132
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional