You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-04-05 - 19:33

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot6s.osadl.org (updated Sat Apr 05, 2025 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3430211696,15sleep20-21swapper/207:09:122
3295211394,13sleep10-21swapper/107:07:361
3284211184,6sleep00-21swapper/007:07:270
2496221090,1sleep30-21swapper/309:15:243
3382210897,6sleep30-21swapper/307:08:373
3521993717,2cyclictest0-21swapper/109:30:111
3523993632,2cyclictest0-21swapper/311:15:143
352099340,32cyclictest0-21swapper/009:10:130
352099340,32cyclictest0-21swapper/009:10:130
3523992614,2cyclictest0-21swapper/309:30:113
227012250,1sleep10-21swapper/109:13:581
227012250,1sleep10-21swapper/109:13:581
163992240,1sleep20-21swapper/210:54:012
316862230,1sleep2301ktimersoftd/209:22:402
352399222,18cyclictest381ktimersoftd/312:30:073
352399220,20cyclictest0-21swapper/309:35:143
3522992219,2cyclictest23075-21kworker/u8:009:55:042
3522992219,2cyclictest18278-21kworker/u8:009:18:032
352099220,17cyclictest0-21swapper/011:55:040
352099220,17cyclictest0-21swapper/011:40:050
352099220,16cyclictest0-21swapper/010:41:050
352399211,18cyclictest15528-21ssh10:52:413
352399210,3cyclictest31559-21ssh11:46:123
352399210,3cyclictest10540-21rm11:21:523
352399210,2cyclictest23609-21ssh10:25:383
352399210,2cyclictest0-21swapper/311:04:033
352399210,2cyclictest0-21swapper/310:45:023
352399210,2cyclictest0-21swapper/309:53:423
352399210,19cyclictest0-21swapper/312:01:423
352399210,19cyclictest0-21swapper/312:01:423
3522992118,2cyclictest9525-21kworker/u8:209:47:042
3522992118,2cyclictest32440-21kworker/u8:308:58:032
3522992118,2cyclictest29506-21kworker/u8:211:46:032
3522992118,2cyclictest2623-21kworker/u8:210:07:042
3522992118,2cyclictest23075-21kworker/u8:009:54:052
3522992118,2cyclictest21923-21kworker/u8:209:29:052
3522992118,2cyclictest1679-21kworker/u8:110:38:042
3522992118,2cyclictest16762-21kworker/u8:012:10:042
3522992118,2cyclictest15571-21kworker/u8:110:56:042
352299210,4cyclictest8906-21rm11:56:032
352099210,19cyclictest0-21swapper/009:00:130
322782210,0sleep00-21swapper/009:23:350
161582210,1sleep011-21rcuc/010:53:370
352399201,17cyclictest3745-21runrttasks11:10:073
3523992010,8cyclictest0-21swapper/311:55:153
352399200,3cyclictest30534-21ssh10:33:483
352399200,3cyclictest2486-21aten2.4-expect08:30:163
352399200,3cyclictest19274-21interrupts07:50:133
352399200,3cyclictest13016-21ssh11:25:253
352399200,3cyclictest0-21swapper/310:15:363
352399200,2cyclictest0-21swapper/312:05:023
352399200,2cyclictest0-21swapper/311:35:423
352399200,2cyclictest0-21swapper/311:07:503
352399200,2cyclictest0-21swapper/310:40:203
352399200,2cyclictest0-21swapper/309:24:333
352399200,2cyclictest0-21swapper/308:15:173
352399200,18cyclictest0-21swapper/312:15:443
352399200,18cyclictest0-21swapper/310:20:523
352299202,2cyclictest0-21swapper/210:02:042
3522992017,2cyclictest8024-21kworker/u8:207:45:032
3522992017,2cyclictest4112-21kworker/u8:009:41:032
3522992017,2cyclictest4112-21kworker/u8:009:39:052
3522992017,2cyclictest29923-21kworker/u8:012:22:022
3522992017,2cyclictest1987-21kworker/u8:112:04:042
3522992017,2cyclictest1987-21kworker/u8:112:04:032
3522992017,2cyclictest15571-21kworker/u8:111:05:042
3522992017,2cyclictest12971-21kworker/u8:011:31:042
352399190,3cyclictest6648-21ssh10:07:203
352399190,3cyclictest3638-21ssh12:27:123
352399190,3cyclictest26510-21ssh11:40:173
352399190,3cyclictest23170-21kworker/u8:212:14:293
352399190,2cyclictest0-21swapper/312:35:413
352399190,2cyclictest0-21swapper/312:23:203
352399190,2cyclictest0-21swapper/311:50:493
352399190,2cyclictest0-21swapper/311:30:203
352399190,2cyclictest0-21swapper/310:55:203
352399190,2cyclictest0-21swapper/310:35:133
352399190,2cyclictest0-21swapper/310:14:133
352399190,2cyclictest0-21swapper/310:00:263
352399190,2cyclictest0-21swapper/309:55:293
352399190,2cyclictest0-21swapper/309:47:033
352399190,2cyclictest0-21swapper/309:41:173
352399190,2cyclictest0-21swapper/309:26:373
352399190,2cyclictest0-21swapper/309:12:253
352399190,2cyclictest0-21swapper/309:12:243
352399190,2cyclictest0-21swapper/308:50:213
352399190,2cyclictest0-21swapper/308:35:243
352399190,2cyclictest0-21swapper/308:00:283
3522991916,2cyclictest8024-21kworker/u8:208:04:032
3522991916,2cyclictest7764-21kworker/u8:110:13:042
3522991916,2cyclictest6073-21kworker/u8:108:38:032
3522991916,2cyclictest5485-21kworker/u8:107:30:032
3522991916,2cyclictest5485-21kworker/u8:107:14:032
3522991916,2cyclictest32440-21kworker/u8:308:49:032
3522991916,2cyclictest28828-21kworker/u8:109:31:032
3522991916,2cyclictest22383-21kworker/u8:211:10:032
3522991916,2cyclictest19880-21kworker/u8:111:43:052
3522991916,2cyclictest1987-21kworker/u8:111:52:052
3521991916,2cyclictest7764-21kworker/u8:110:24:041
3523991812,5cyclictest0-21swapper/309:05:143
352399180,3cyclictest13991-21munin-node3
352399180,2cyclictest222832sleep307:58:283
352399180,2cyclictest13752-21apt-get07:35:003
352399180,2cyclictest0-21swapper/309:00:203
352399180,2cyclictest0-21swapper/308:55:363
352399180,2cyclictest0-21swapper/308:05:123
352399180,2cyclictest0-21swapper/307:25:173
352399180,2cyclictest0-21swapper/307:25:003
3522991815,2cyclictest7764-21kworker/u8:110:22:022
3522991815,2cyclictest6791-21kworker/u8:211:29:042
3522991815,2cyclictest6791-21kworker/u8:211:24:042
3522991815,2cyclictest32440-21kworker/u8:309:00:032
3522991815,2cyclictest27007-21kworker/u8:008:12:042
3522991815,2cyclictest2521-21kworker/u8:008:32:052
3522991815,2cyclictest22785-21kworker/u8:210:28:042
3522991815,2cyclictest20691-21kworker/u8:007:59:032
352299180,2cyclictest22383-21kworker/u8:211:02:042
3521991815,2cyclictest23075-21kworker/u8:010:36:031
3521991815,2cyclictest1076-21kworker/u8:111:21:041
352099180,2cyclictest18506-21diskmemload11:09:040
352099180,17cyclictest0-21swapper/010:04:030
352099180,16cyclictest0-21swapper/011:30:080
352399170,2cyclictest0-21swapper/308:45:163
352399170,2cyclictest0-21swapper/308:40:213
352399170,2cyclictest0-21swapper/308:15:003
352399170,2cyclictest0-21swapper/307:45:003
352399170,2cyclictest0-21swapper/307:15:173
352399170,2cyclictest0-21swapper/307:10:253
352399170,1cyclictest0-21swapper/308:25:153
352399170,1cyclictest0-21swapper/308:20:163
3522991714,2cyclictest5485-21kworker/u8:107:21:032
3522991714,2cyclictest5485-21kworker/u8:107:16:042
3522991714,2cyclictest27007-21kworker/u8:008:17:052
3522991714,2cyclictest24359-21kworker/u8:108:22:042
3522991714,2cyclictest22785-21kworker/u8:210:31:042
3522991714,2cyclictest1679-21kworker/u8:110:42:042
3522991714,2cyclictest14842-21kworker/u8:109:06:052
352299170,2cyclictest0-21swapper/212:09:042
352299170,16cyclictest0-21swapper/207:27:052
255832170,0sleep00-21swapper/011:39:470
352399160,2cyclictest0-21swapper/307:45:243
3522991613,2cyclictest8024-21kworker/u8:207:35:032
3522991613,2cyclictest32440-21kworker/u8:308:50:052
352299160,2cyclictest0-21swapper/212:15:042
3521991613,2cyclictest8042-21kworker/u8:212:00:051
3521991613,2cyclictest8042-21kworker/u8:212:00:041
3521991613,2cyclictest7764-21kworker/u8:110:12:041
3521991613,2cyclictest29506-21kworker/u8:211:49:041
3521991613,2cyclictest21923-21kworker/u8:209:21:031
3520991613,2cyclictest15571-21kworker/u8:111:00:040
352099160,14cyclictest0-21swapper/007:37:040
3522991512,2cyclictest8024-21kworker/u8:207:50:042
3522991512,2cyclictest10741-21kworker/u8:012:39:052
3522991511,3cyclictest0-21swapper/210:17:222
352299150,2cyclictest0-21swapper/210:49:042
3521991512,2cyclictest9525-21kworker/u8:209:35:051
3521991512,2cyclictest22383-21kworker/u8:211:12:031
3521991512,2cyclictest21923-21kworker/u8:209:16:051
352199150,14cyclictest0-21swapper/112:33:071
352199150,13cyclictest18506-21diskmemload11:38:171
352199150,13cyclictest0-21swapper/110:18:091
352099150,13cyclictest0-21swapper/012:03:040
352099150,13cyclictest0-21swapper/012:03:030
352299140,2cyclictest0-21swapper/211:16:052
352299140,2cyclictest0-21swapper/208:27:032
352299140,13cyclictest0-21swapper/211:38:042
352299140,12cyclictest0-21swapper/209:12:402
352299140,12cyclictest0-21swapper/209:12:392
352199149,3cyclictest20796-21iostat_ios12:10:121
3521991411,2cyclictest8024-21kworker/u8:208:10:041
3521991411,2cyclictest6791-21kworker/u8:211:19:051
3521991411,2cyclictest29923-21kworker/u8:012:21:041
3521991411,2cyclictest0-21swapper/110:58:181
3521991410,2cyclictest2266-21df_inode11:50:091
352199140,2cyclictest22939-21cpuspeed_turbos08:00:141
352199140,13cyclictest0-21swapper/111:07:291
352199140,13cyclictest0-21swapper/110:27:591
352199140,12cyclictest0-21swapper/112:36:421
352199140,12cyclictest0-21swapper/112:18:401
352099141,2cyclictest29747-21date12:20:010
352099141,2cyclictest10564-21latency_hist08:50:010
3520991411,2cyclictest27912-21kworker/u8:011:18:030
352099140,13cyclictest0-21swapper/009:30:110
352099140,12cyclictest17486-21runrttasks09:05:180
352099140,12cyclictest0-21swapper/011:20:140
352099140,12cyclictest0-21swapper/010:17:540
352099140,12cyclictest0-21swapper/008:15:160
30282140,1sleep00-21swapper/010:38:550
273032140,2sleep10-21swapper/109:54:481
352299137,4cyclictest0-21swapper/212:30:072
3522991310,2cyclictest0-21swapper/208:40:142
352299130,12cyclictest0-21swapper/207:42:052
352199138,3cyclictest8880-21cpu08:45:141
352199132,6cyclictest0-21swapper/107:14:591
3521991310,2cyclictest9525-21kworker/u8:209:46:041
3521991310,2cyclictest6073-21kworker/u8:108:39:031
3521991310,2cyclictest19880-21kworker/u8:111:41:041
3521991310,2cyclictest0-21swapper/112:06:301
3521991310,2cyclictest0-21swapper/111:56:091
3521991310,2cyclictest0-21swapper/111:29:511
3521991310,2cyclictest0-21swapper/110:07:281
3521991310,2cyclictest0-21swapper/107:30:271
352199130,2cyclictest18506-21diskmemload12:26:021
352199130,2cyclictest12490-21apt-get10:50:081
352199130,2cyclictest0-21swapper/110:00:591
352199130,12cyclictest0-21swapper/111:33:111
352199130,12cyclictest0-21swapper/109:29:091
352199130,11cyclictest18506-21diskmemload10:30:101
3520991310,2cyclictest9668-21ssh09:35:130
3520991310,2cyclictest9525-21kworker/u8:209:50:050
3520991310,2cyclictest23075-21kworker/u8:010:14:020
3520991310,2cyclictest18506-21diskmemload12:10:230
3520991310,2cyclictest0-21swapper/011:50:080
3520991310,2cyclictest0-21swapper/011:29:240
3520991310,2cyclictest0-21swapper/010:59:050
3520991310,2cyclictest0-21swapper/010:30:210
3520991310,2cyclictest0-21swapper/010:25:240
352099130,2cyclictest0-21swapper/010:20:050
352099130,11cyclictest24904-21telnet08:05:110
352099130,11cyclictest0-21swapper/012:21:140
321242130,2sleep00-21swapper/011:10:260
196372130,1sleep00-21swapper/009:45:280
352299129,2cyclictest4197-21ssh12:28:032
352199129,2cyclictest8024-21kworker/u8:208:06:051
352199129,2cyclictest32440-21kworker/u8:308:29:041
352199129,2cyclictest20691-21kworker/u8:007:58:031
352199129,2cyclictest0-21swapper/109:55:321
352199129,2cyclictest0-21swapper/108:50:251
352199129,2cyclictest0-21swapper/107:50:151
352199128,2cyclictest15965-21grep07:40:001
352199122,7cyclictest4572-21gdm-simple-gree09:05:591
352199122,7cyclictest0-21swapper/107:19:591
352199120,2cyclictest8994-21ssh10:45:011
352199120,2cyclictest0-21swapper/110:40:031
352199120,2cyclictest0-21swapper/109:40:021
352199120,11cyclictest0-21swapper/111:01:481
352199120,10cyclictest0-21swapper/109:00:231
352099129,2cyclictest18506-21diskmemload11:46:070
352099129,2cyclictest18506-21diskmemload09:25:370
352099129,2cyclictest0-21swapper/010:49:140
352099129,2cyclictest0-21swapper/010:07:050
352099129,2cyclictest0-21swapper/009:55:180
352099129,2cyclictest0-21swapper/009:43:170
352099127,3cyclictest14474-21sendmail09:00:010
352099121,10cyclictest8024-21kworker/u8:207:51:040
352099120,2cyclictest0-21swapper/012:35:570
352099120,2cyclictest0-21swapper/012:25:160
352099120,2cyclictest0-21swapper/012:06:140
352099120,11cyclictest0-21swapper/009:15:050
352099120,11cyclictest0-21swapper/008:20:170
352099120,11cyclictest0-21swapper/007:25:160
352199118,2cyclictest32440-21kworker/u8:308:57:041
352199112,6cyclictest0-21swapper/108:15:591
352199112,6cyclictest0-21swapper/107:40:591
352199112,6cyclictest0-21swapper/107:25:021
352099118,2cyclictest0-21swapper/007:55:280
352099110,10cyclictest0-21swapper/012:30:180
352099110,10cyclictest0-21swapper/008:25:240
67222100,1sleep00-21swapper/007:15:200
352199107,2cyclictest5485-21kworker/u8:107:20:031
352199107,2cyclictest2521-21kworker/u8:008:31:051
352199107,2cyclictest0-21swapper/108:20:151
352199102,5cyclictest0-21swapper/108:40:591
352199102,5cyclictest0-21swapper/107:45:011
352099107,2cyclictest0-21swapper/008:30:170
352099107,2cyclictest0-21swapper/007:10:140
352099105,3cyclictest7955-21aten2.4-expect07:20:150
352099100,9cyclictest0-21swapper/008:50:290
352099100,8cyclictest0-21swapper/008:00:400
35229992,5cyclictest0-21swapper/208:09:592
35209995,2cyclictest3745-21runrttasks07:43:430
35209994,3cyclictest6799-21aten2.4_r3power08:40:140
35209994,3cyclictest27715-21awk08:10:170
35209990,2cyclictest0-21swapper/008:35:220
35209980,7cyclictest0-21swapper/007:30:370
35209970,6cyclictest0-21swapper/007:45:580
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional