You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-11-21 - 21:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot6s.osadl.org (updated Thu Nov 21, 2024 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2554211995,19sleep00-21swapper/007:09:120
2593211696,15sleep20-21swapper/207:09:422
2406211289,17sleep30-21swapper/307:07:193
254429988,6sleep10-21swapper/107:09:051
234722870,0sleep30-21swapper/309:14:133
209422750,0sleep00-21swapper/012:35:130
2646993716,19cyclictest0-21swapper/208:00:142
264499240,2cyclictest0-21swapper/011:45:120
72092220,1sleep30-21swapper/310:40:043
264699211,2cyclictest0-21swapper/210:55:112
264499211,2cyclictest0-21swapper/010:55:110
2647992017,2cyclictest23362-21kworker/u8:210:38:043
2646992017,2cyclictest0-21swapper/208:05:132
2644992016,2cyclictest0-21swapper/008:00:150
2647991916,2cyclictest21112-21kworker/u8:009:49:053
287852180,1sleep20-21swapper/211:35:222
2647991814,3cyclictest22809-21kworker/u8:010:58:033
2644991814,2cyclictest7208-21ssh10:40:040
2647991714,2cyclictest30723-21kworker/u8:211:46:043
2647991714,2cyclictest22809-21kworker/u8:011:03:033
2647991714,2cyclictest19427-21kworker/u8:009:38:033
2647991714,2cyclictest14483-21kworker/u8:110:00:043
2644991712,3cyclictest0-21swapper/007:50:140
2647991613,2cyclictest24941-21kworker/u8:011:36:033
2647991613,2cyclictest18907-21kworker/u8:112:39:033
264799160,2cyclictest0-21swapper/309:30:143
264699161,13cyclictest15162-21iostat_ios09:40:142
264699161,13cyclictest11494-21grep12:25:152
2645991613,2cyclictest203450irq/24-eth109:49:051
264599160,14cyclictest0-21swapper/111:55:001
264499161,3cyclictest19946-21ssh09:10:120
2644991611,3cyclictest3745-21runrttasks11:40:110
2644991611,3cyclictest0-21swapper/012:05:130
2644991611,3cyclictest0-21swapper/009:50:160
264799151,3cyclictest32715-21ssh10:32:183
2647991512,2cyclictest23362-21kworker/u8:210:29:053
2647991512,2cyclictest0-21swapper/311:58:243
264799150,3cyclictest13494-21ssh11:53:593
264699150,3cyclictest24083-21cat09:15:012
264699150,14cyclictest0-21swapper/209:20:182
264699150,13cyclictest19183-21diskmemload10:43:382
264699150,13cyclictest0-21swapper/210:49:572
264599151,12cyclictest3745-21runrttasks09:34:181
264599150,3cyclictest0-21swapper/111:15:201
264599150,2cyclictest20252-21munin-node1
264599150,14cyclictest0-21swapper/110:08:261
264599150,14cyclictest0-21swapper/110:08:251
264599150,13cyclictest0-21swapper/112:40:001
264599150,13cyclictest0-21swapper/110:20:011
264499155,7cyclictest4572-21gdm-simple-gree11:35:580
264499152,8cyclictest11132-21copy08:50:000
264499151,3cyclictest0-21swapper/010:24:160
2644991512,2cyclictest4431-21kworker/u8:010:04:050
2644991510,3cyclictest0-21swapper/009:20:160
264499150,13cyclictest1711-21ssh10:34:350
231662150,3sleep323177-21sh10:22:243
264799141,2cyclictest19183-21diskmemload11:20:583
2647991411,2cyclictest6722-21kworker/u8:211:17:053
2647991411,2cyclictest14483-21kworker/u8:109:42:043
2647991411,2cyclictest13186-21kworker/u8:112:10:043
2647991411,2cyclictest12809-21kworker/u8:012:30:053
2647991411,2cyclictest11132-21copy08:50:033
2647991411,2cyclictest0-21swapper/312:16:243
2647991411,2cyclictest0-21swapper/312:01:433
2647991411,2cyclictest0-21swapper/309:26:083
264799141,11cyclictest10708-21ssh10:10:043
2647991410,3cyclictest21259-21kworker/u8:007:30:053
264799140,2cyclictest0-21swapper/312:08:183
264799140,2cyclictest0-21swapper/310:53:403
264799140,2cyclictest0-21swapper/309:16:173
264799140,13cyclictest0-21swapper/310:45:133
264799140,12cyclictest0-21swapper/312:27:373
264799140,12cyclictest0-21swapper/311:25:333
264799140,12cyclictest0-21swapper/309:57:203
264799140,12cyclictest0-21swapper/308:30:263
264699142,6cyclictest22706-21runrttasks11:30:002
2646991411,2cyclictest0-21swapper/211:01:572
2646991411,2cyclictest0-21swapper/210:20:172
2646991411,2cyclictest0-21swapper/209:17:272
2646991410,2cyclictest23202-21ssh11:30:142
2646991410,2cyclictest18337-21ps09:05:182
264699140,2cyclictest0-21swapper/211:40:192
264699140,2cyclictest0-21swapper/211:05:282
264699140,12cyclictest9475-21diskstats07:25:132
264699140,12cyclictest0-21swapper/212:20:002
264699140,12cyclictest0-21swapper/211:48:572
264599149,4cyclictest0-21swapper/110:51:221
264599149,4cyclictest0-21swapper/110:30:321
2645991411,2cyclictest0-21swapper/112:25:501
2645991411,2cyclictest0-21swapper/112:05:141
2645991411,2cyclictest0-21swapper/111:01:001
2645991410,2cyclictest0-21swapper/111:40:251
264599140,2cyclictest0-21swapper/112:18:101
264599140,13cyclictest0-21swapper/112:13:011
264599140,13cyclictest0-21swapper/109:44:201
264599140,13cyclictest0-21swapper/109:25:501
264599140,13cyclictest0-21swapper/107:15:101
264599140,12cyclictest19183-21diskmemload10:41:251
264599140,12cyclictest0-21swapper/112:21:021
264599140,12cyclictest0-21swapper/111:21:261
264599140,12cyclictest0-21swapper/109:20:431
264499142,7cyclictest0-21swapper/011:20:010
2644991411,2cyclictest19427-21kworker/u8:009:39:050
2644991411,2cyclictest16584-21expr09:00:250
2644991411,2cyclictest11474-21kworker/u8:209:18:040
264499141,11cyclictest19183-21diskmemload11:11:170
264499140,12cyclictest20139-21latency_hist10:20:010
264499140,12cyclictest19183-21diskmemload12:30:100
264499140,12cyclictest0-21swapper/012:25:270
264499140,12cyclictest0-21swapper/011:31:320
264499140,12cyclictest0-21swapper/010:52:040
264499140,12cyclictest0-21swapper/009:41:010
213142140,3sleep10-21swapper/107:55:121
2647991310,2cyclictest31233-21apt-get11:05:133
2647991310,2cyclictest16870-21kworker/u8:107:49:033
2647991310,2cyclictest0-21swapper/312:21:113
2647991310,2cyclictest0-21swapper/311:40:383
2647991310,2cyclictest0-21swapper/311:30:393
2647991310,2cyclictest0-21swapper/311:14:183
2647991310,2cyclictest0-21swapper/308:25:193
2647991310,2cyclictest0-21swapper/307:40:143
2647991310,2cyclictest0-21swapper/307:15:113
264799130,2cyclictest21346-21munin-node3
264799130,2cyclictest0-21swapper/308:55:243
264799130,2cyclictest0-21swapper/308:35:183
264799130,12cyclictest0-21swapper/310:08:053
264799130,12cyclictest0-21swapper/310:08:053
264799130,12cyclictest0-21swapper/309:50:593
264799130,12cyclictest0-21swapper/309:20:103
264799130,12cyclictest0-21swapper/308:40:173
264799130,12cyclictest0-21swapper/307:35:203
264799130,12cyclictest0-21swapper/307:10:233
264699138,3cyclictest0-21swapper/210:50:262
2646991310,2cyclictest19183-21diskmemload10:25:242
2646991310,2cyclictest0-21swapper/211:16:482
2646991310,2cyclictest0-21swapper/211:10:202
2646991310,2cyclictest0-21swapper/210:34:142
2646991310,2cyclictest0-21swapper/210:01:032
2646991310,2cyclictest0-21swapper/209:55:452
2646991310,2cyclictest0-21swapper/209:53:272
2646991310,2cyclictest0-21swapper/208:50:062
264699130,3cyclictest0-21swapper/212:30:192
264699130,2cyclictest0-21swapper/212:21:032
264699130,2cyclictest0-21swapper/209:30:172
264699130,12cyclictest0-21swapper/210:11:472
264699130,12cyclictest0-21swapper/210:08:062
264699130,12cyclictest0-21swapper/210:08:062
264699130,12cyclictest0-21swapper/209:25:302
264699130,11cyclictest22486-21ssh09:48:102
264699130,11cyclictest19183-21diskmemload10:16:412
264699130,11cyclictest0-21swapper/211:56:572
264699130,11cyclictest0-21swapper/211:20:202
2645991310,2cyclictest19183-21diskmemload11:05:191
2645991310,2cyclictest0-21swapper/112:30:021
2645991310,2cyclictest0-21swapper/112:01:021
2645991310,2cyclictest0-21swapper/111:55:531
2645991310,2cyclictest0-21swapper/111:45:211
2645991310,2cyclictest0-21swapper/111:35:401
2645991310,2cyclictest0-21swapper/110:35:101
2645991310,2cyclictest0-21swapper/110:26:551
2645991310,2cyclictest0-21swapper/110:10:161
2645991310,2cyclictest0-21swapper/110:01:051
2645991310,2cyclictest0-21swapper/109:57:221
2645991310,2cyclictest0-21swapper/109:53:121
2645991310,2cyclictest0-21swapper/109:15:471
2645991310,2cyclictest0-21swapper/109:00:161
264599130,2cyclictest19183-21diskmemload09:12:181
264599130,2cyclictest0-21swapper/111:12:461
264599130,2cyclictest0-21swapper/110:58:241
264599130,2cyclictest0-21swapper/110:47:461
264599130,2cyclictest0-21swapper/110:20:481
264599130,2cyclictest0-21swapper/109:35:231
264599130,2cyclictest0-21swapper/107:40:241
264599130,12cyclictest19183-21diskmemload11:31:251
264599130,12cyclictest0-21swapper/111:26:541
264499131,1cyclictest7063-21apt-get07:20:110
2644991310,2cyclictest32454-21ssh09:58:510
2644991310,2cyclictest19183-21diskmemload09:28:520
2644991310,2cyclictest13186-21kworker/u8:112:12:050
2644991310,2cyclictest0-21swapper/011:02:140
2644991310,2cyclictest0-21swapper/009:45:370
2644991310,2cyclictest0-21swapper/008:55:120
2644991310,2cyclictest0-21swapper/008:30:130
2644991310,2cyclictest0-21swapper/008:05:160
264499130,2cyclictest0-21swapper/011:50:510
264499130,2cyclictest0-21swapper/008:20:200
264499130,12cyclictest0-21swapper/011:05:240
264499130,12cyclictest0-21swapper/010:12:020
264499130,12cyclictest0-21swapper/010:08:350
264499130,12cyclictest0-21swapper/010:08:340
264499130,11cyclictest0-21swapper/012:16:250
264499130,11cyclictest0-21swapper/010:25:110
90772120,2sleep10-21swapper/107:25:101
264799129,2cyclictest29613-21kworker/u8:008:49:043
264799129,2cyclictest27221-21kworker/u8:108:11:033
264799129,2cyclictest0-21swapper/310:15:193
264699129,2cyclictest19183-21diskmemload11:51:562
264699129,2cyclictest0-21swapper/212:05:592
264699129,2cyclictest0-21swapper/210:35:192
264699129,2cyclictest0-21swapper/209:35:012
264699129,2cyclictest0-21swapper/208:45:112
264699129,2cyclictest0-21swapper/208:40:212
264699120,2cyclictest0-21swapper/212:35:522
264699120,2cyclictest0-21swapper/208:15:272
264699120,11cyclictest0-21swapper/212:11:142
264699120,11cyclictest0-21swapper/212:01:192
264699120,11cyclictest0-21swapper/209:00:102
264699120,11cyclictest0-21swapper/207:50:112
264599129,2cyclictest0-21swapper/108:30:151
264599127,4cyclictest12701-21kworker/1:109:05:111
264599120,11cyclictest0-21swapper/108:50:211
264599120,11cyclictest0-21swapper/108:25:161
264599120,11cyclictest0-21swapper/108:00:181
264499129,2cyclictest30121-21kworker/u8:110:35:030
264499129,2cyclictest0-21swapper/012:24:140
264499129,2cyclictest0-21swapper/010:45:240
264499129,2cyclictest0-21swapper/009:30:210
264499129,2cyclictest0-21swapper/008:50:170
264499129,2cyclictest0-21swapper/008:35:170
264499129,2cyclictest0-21swapper/007:30:050
264499129,2cyclictest0-21swapper/007:15:110
264499127,3cyclictest15053-21latency_hist07:40:010
264499121,3cyclictest19183-21diskmemload09:09:590
264499120,2cyclictest0-21swapper/012:01:000
264499120,2cyclictest0-21swapper/011:15:000
264499120,1cyclictest19183-21diskmemload11:55:050
264499120,11cyclictest0-21swapper/011:27:200
264799118,2cyclictest27221-21kworker/u8:109:06:053
264799118,2cyclictest21259-21kworker/u8:007:51:043
264799110,10cyclictest0-21swapper/308:20:313
264699118,2cyclictest0-21swapper/207:15:162
264699118,2cyclictest0-21swapper/207:10:142
264599118,2cyclictest0-21swapper/108:55:241
264599118,2cyclictest0-21swapper/107:30:091
264599110,9cyclictest7930-21modprobe08:40:131
264599110,9cyclictest0-21swapper/108:15:191
264599110,9cyclictest0-21swapper/107:20:121
264599110,9cyclictest0-21swapper/107:10:111
264499111,7cyclictest0-21swapper/007:55:020
264799107,2cyclictest21376-21kworker/u8:208:07:043
264799104,4cyclictest25350-21cut08:04:593
264699107,2cyclictest0-21swapper/208:25:112
264699102,7cyclictest0-21swapper/208:56:592
264699101,5cyclictest0-21swapper/207:45:002
264599107,2cyclictest13189-21munin-node1
264599107,2cyclictest0-21swapper/108:10:011
264599100,9cyclictest0-21swapper/108:35:201
264599100,2cyclictest0-21swapper/108:05:131
264499107,2cyclictest0-21swapper/008:15:160
264499105,3cyclictest28916-21sshd08:10:370
264499105,3cyclictest1343-21grep08:25:120
26479994,3cyclictest9562-21fschecks_time07:25:143
26479994,3cyclictest7157-21telnet07:20:123
26479994,3cyclictest16757-21unixbench_singl09:00:243
26469995,2cyclictest7044-21cron08:39:592
26469994,3cyclictest17707-21fschecks_count07:45:142
26469994,3cyclictest13711-21tune2fs07:35:122
26469991,7cyclictest0-21swapper/208:34:022
26469991,6cyclictest0-21swapper/208:14:282
26459996,2cyclictest21259-21kworker/u8:007:45:051
26459996,2cyclictest0-21swapper/108:45:161
26459996,2cyclictest0-21swapper/108:20:271
26449996,2cyclictest0-21swapper/008:40:140
26449994,3cyclictest3619-21cat07:10:160
26449994,3cyclictest16206-21processes07:40:180
26449994,3cyclictest10337-21timerwakeupswit07:25:250
26449990,8cyclictest0-21swapper/007:45:190
26479983,3cyclictest29506-21cut08:15:143
26469984,2cyclictest7325-21cpuspeed_turbos07:20:132
26469983,3cyclictest31763-21cut08:20:172
26469983,3cyclictest23043-21cat08:00:002
26469982,5cyclictest0-21swapper/207:30:592
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional