You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-02-05 - 10:54

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Wed Feb 05, 2025 00:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2041021400,1sleep120411-21sh21:42:171
4196211995,16sleep20-21swapper/219:05:132
5845211795,17sleep10-21swapper/119:08:361
4060211295,12sleep30-21swapper/319:05:113
5599210977,6sleep00-21swapper/019:05:280
308102860,2sleep122078-21diskmemload22:30:201
309442820,0sleep00-21swapper/023:06:540
205092800,0sleep20-21swapper/200:07:212
44782780,0sleep00-21swapper/022:00:250
239852740,1sleep3381ktimersoftd/321:10:303
56782710,0sleep00-21swapper/000:26:280
108722700,0sleep30-21swapper/320:40:173
105692660,0sleep00-21swapper/000:31:290
93812630,1sleep30-21swapper/323:18:283
598299221,3cyclictest6955-21ssh22:40:133
598299221,3cyclictest6955-21ssh22:40:133
597999220,17cyclictest0-21swapper/022:56:040
597999220,17cyclictest0-21swapper/021:26:050
263552220,1sleep10-21swapper/123:36:581
5982992117,2cyclictest0-21swapper/322:55:123
598199210,4cyclictest0-21swapper/221:15:052
238502210,0sleep20-21swapper/223:35:112
598299207,11cyclictest0-21swapper/319:45:133
598099200,18cyclictest0-21swapper/121:00:141
5981991916,2cyclictest5926-21kworker/u8:221:31:042
5981991916,2cyclictest17742-21kworker/u8:221:47:052
5981991915,3cyclictest22341-21kworker/u8:021:14:052
598099190,2cyclictest0-21swapper/121:15:041
597999190,18cyclictest0-21swapper/020:50:130
314132190,0sleep00-21swapper/023:42:190
598199182,2cyclictest0-21swapper/223:31:052
5981991815,2cyclictest909-21kworker/u8:023:13:042
5981991815,2cyclictest4355-21kworker/u8:223:58:042
5981991815,2cyclictest29574-21kworker/u8:222:38:042
5981991815,2cyclictest22341-21kworker/u8:021:21:042
5980991815,2cyclictest27247-21kworker/u8:022:27:051
5980991814,3cyclictest12986-21kworker/u8:223:03:051
597999180,17cyclictest0-21swapper/022:48:040
597999180,17cyclictest0-21swapper/022:48:040
597999180,15cyclictest0-21swapper/022:24:040
171272180,0sleep1221ktimersoftd/123:27:401
107622180,1sleep00-21swapper/021:32:230
5981991714,2cyclictest7102-21kworker/u8:223:22:052
5981991714,2cyclictest27247-21kworker/u8:022:16:042
5981991714,2cyclictest26447-21kworker/u8:020:22:042
5981991714,2cyclictest26447-21kworker/u8:020:11:052
5981991714,2cyclictest10310-21kworker/u8:219:42:042
598099170,2cyclictest0-21swapper/122:19:041
597999170,16cyclictest0-21swapper/022:29:040
598199161,3cyclictest0-21swapper/223:01:512
5981991613,2cyclictest8191-21kworker/u8:221:02:042
5981991613,2cyclictest440-21kworker/u8:100:03:052
5981991613,2cyclictest27247-21kworker/u8:022:42:052
5981991613,2cyclictest27247-21kworker/u8:022:42:052
5981991613,2cyclictest27247-21kworker/u8:022:01:032
5981991613,2cyclictest21557-21kworker/u8:019:50:052
5981991613,2cyclictest21557-21kworker/u8:019:50:052
5981991613,2cyclictest21557-21kworker/u8:019:46:062
5981991613,2cyclictest14726-21kworker/u8:222:14:052
5981991613,2cyclictest12012-21kworker/u8:021:36:052
598199161,2cyclictest9278-21ssh22:07:052
598199161,13cyclictest10772-21hddtemp_smartct20:40:152
598199160,2cyclictest0-21swapper/222:28:042
598199160,14cyclictest0-21swapper/221:29:042
5980991612,2cyclictest22078-21diskmemload22:05:051
5980991611,3cyclictest3292-21wc22:35:261
598099160,11cyclictest0-21swapper/121:51:031
597999160,6cyclictest0-21swapper/020:45:040
597999160,5cyclictest0-21swapper/000:02:040
5982991510,3cyclictest0-21swapper/321:30:443
598299150,13cyclictest14293-21munin-node3
598299150,13cyclictest0-21swapper/323:35:153
5981991512,2cyclictest8191-21kworker/u8:220:59:042
5981991512,2cyclictest30127-21kworker/u8:220:17:042
5981991512,2cyclictest29574-21kworker/u8:222:31:042
5981991512,2cyclictest26447-21kworker/u8:020:30:052
5981991512,2cyclictest11105-21kworker/u8:100:35:052
598199151,12cyclictest24331-21apt-get19:55:152
598199150,3cyclictest0-21swapper/220:55:002
598199150,2cyclictest22078-21diskmemload23:16:322
598099152,7cyclictest22078-21diskmemload00:20:001
598099152,7cyclictest0-21swapper/121:45:001
5980991512,2cyclictest4355-21kworker/u8:223:57:041
598099151,12cyclictest8741-21grep19:15:151
598099151,12cyclictest302312sleep123:40:261
597999151,2cyclictest4150-21ssh23:49:590
5979991512,2cyclictest22341-21kworker/u8:021:15:040
597999150,13cyclictest22078-21diskmemload23:01:460
598299140,2cyclictest12360-21ssh23:20:353
598299140,12cyclictest20962-21ssh23:31:053
598299140,12cyclictest0-21swapper/322:15:163
598299140,12cyclictest0-21swapper/322:04:393
598199149,3cyclictest0-21swapper/223:27:372
598199149,3cyclictest0-21swapper/222:50:392
5981991411,2cyclictest8191-21kworker/u8:220:37:042
5981991411,2cyclictest5198-21kworker/u8:200:27:052
5981991411,2cyclictest26447-21kworker/u8:020:09:052
5981991411,2cyclictest21557-21kworker/u8:019:39:052
5981991411,2cyclictest21557-21kworker/u8:019:15:052
5981991411,2cyclictest20102-21kworker/u8:022:58:032
5981991411,2cyclictest13686-21kworker/u8:000:10:052
5981991411,2cyclictest10310-21kworker/u8:219:28:062
5981991411,2cyclictest0-21swapper/220:25:132
5981991411,2cyclictest0-21swapper/219:10:242
5981991410,3cyclictest0-21swapper/221:51:402
598199140,3cyclictest31598-21ssh23:07:542
598199140,2cyclictest0-21swapper/223:48:032
598199140,13cyclictest0-21swapper/222:23:342
598199140,12cyclictest30992-21ssh23:41:382
598199140,12cyclictest0-21swapper/222:47:142
598199140,12cyclictest0-21swapper/222:47:132
598099142,7cyclictest0-21swapper/122:15:001
598099142,6cyclictest12016-21copy20:45:011
5980991411,2cyclictest5198-21kworker/u8:200:29:051
5980991411,2cyclictest22341-21kworker/u8:021:27:051
5980991411,2cyclictest12986-21kworker/u8:223:09:041
5980991411,2cyclictest0-21swapper/100:13:051
598099140,12cyclictest0-21swapper/122:44:111
598099140,12cyclictest0-21swapper/122:44:101
598099140,12cyclictest0-21swapper/121:10:171
5979991411,2cyclictest22078-21diskmemload22:44:360
5979991411,2cyclictest22078-21diskmemload22:44:350
5979991410,3cyclictest31869-21ssh00:19:540
597999140,2cyclictest0-21swapper/022:10:460
597999140,2cyclictest0-21swapper/021:43:250
597999140,12cyclictest18792-21ssh22:53:280
597999140,12cyclictest0-21swapper/023:50:130
597999140,12cyclictest0-21swapper/022:17:480
597999140,12cyclictest0-21swapper/021:05:170
92152130,2sleep00-21swapper/019:15:210
598299132,6cyclictest0-21swapper/322:55:003
598299132,6cyclictest0-21swapper/320:55:013
598299132,5cyclictest0-21swapper/323:05:013
598299131,10cyclictest0-21swapper/321:59:193
598299131,10cyclictest0-21swapper/300:24:373
5982991310,2cyclictest8947-21ssh23:54:433
5982991310,2cyclictest0-21swapper/322:32:543
5982991310,2cyclictest0-21swapper/321:41:153
5982991310,2cyclictest0-21swapper/320:20:243
5982991310,2cyclictest0-21swapper/319:10:253
598299130,2cyclictest22078-21diskmemload21:18:453
598299130,2cyclictest15079-21ssh21:36:333
598299130,2cyclictest0-21swapper/323:48:203
598299130,2cyclictest0-21swapper/323:44:133
598299130,2cyclictest0-21swapper/321:00:123
598299130,2cyclictest0-21swapper/300:05:443
598299130,12cyclictest0-21swapper/323:56:153
598299130,12cyclictest0-21swapper/320:35:133
598299130,11cyclictest0-21swapper/322:29:313
598299130,11cyclictest0-21swapper/322:21:593
598299130,11cyclictest0-21swapper/322:10:113
598199131,10cyclictest0-21swapper/221:05:152
5981991310,2cyclictest27247-21kworker/u8:021:57:042
5981991310,2cyclictest0-21swapper/221:42:242
598199130,2cyclictest22078-21diskmemload00:33:252
598199130,2cyclictest0-21swapper/200:16:072
598199130,12cyclictest0-21swapper/200:23:312
598099132,6cyclictest0-21swapper/120:05:011
5980991310,2cyclictest20735-21fschecks_count19:45:161
5980991310,2cyclictest0-21swapper/121:55:181
598099130,3cyclictest22296-21cut22:20:201
598099130,2cyclictest0-21swapper/120:05:011
598099130,12cyclictest0-21swapper/100:05:031
598099130,11cyclictest0-21swapper/121:33:371
598099130,11cyclictest0-21swapper/100:30:251
598099130,11cyclictest0-21swapper/100:24:101
5979991310,2cyclictest22078-21diskmemload23:59:300
5979991310,2cyclictest18301-21apt-get19:40:120
5979991310,2cyclictest0-21swapper/023:27:030
5979991310,2cyclictest0-21swapper/023:22:140
5979991310,2cyclictest0-21swapper/023:15:510
5979991310,2cyclictest0-21swapper/023:14:120
5979991310,2cyclictest0-21swapper/022:35:060
5979991310,2cyclictest0-21swapper/022:05:020
5979991310,2cyclictest0-21swapper/021:37:430
5979991310,2cyclictest0-21swapper/021:20:250
5979991310,2cyclictest0-21swapper/021:11:110
5979991310,2cyclictest0-21swapper/019:45:000
5979991310,2cyclictest0-21swapper/019:35:260
5979991310,2cyclictest0-21swapper/000:38:490
5979991310,2cyclictest0-21swapper/000:11:550
5979991310,2cyclictest0-21swapper/000:05:150
597999130,2cyclictest0-21swapper/023:39:220
597999130,2cyclictest0-21swapper/023:32:580
597999130,2cyclictest0-21swapper/021:45:590
597999130,12cyclictest0-21swapper/022:30:160
597999130,12cyclictest0-21swapper/021:56:260
597999130,12cyclictest0-21swapper/000:21:040
598299129,2cyclictest0-21swapper/321:51:343
598299129,2cyclictest0-21swapper/321:27:043
598299127,3cyclictest0-21swapper/300:15:013
598299122,7cyclictest0-21swapper/321:22:593
598299122,7cyclictest0-21swapper/319:58:593
598299121,6cyclictest0-21swapper/319:20:003
598299121,3cyclictest0-21swapper/321:00:013
598299120,2cyclictest0-21swapper/323:25:133
598299120,2cyclictest0-21swapper/323:11:193
598299120,2cyclictest0-21swapper/323:03:243
598299120,2cyclictest0-21swapper/322:05:253
598299120,2cyclictest0-21swapper/300:38:553
598299120,2cyclictest0-21swapper/300:32:233
598299120,11cyclictest0-21swapper/322:46:313
598299120,11cyclictest0-21swapper/322:46:303
598299120,11cyclictest0-21swapper/319:40:213
598199120,2cyclictest0-21swapper/223:51:102
598199120,11cyclictest0-21swapper/219:30:262
598099129,2cyclictest24080-21kworker/u8:119:58:041
598099129,2cyclictest21557-21kworker/u8:019:13:051
598099129,2cyclictest0-21swapper/123:50:431
598099129,2cyclictest0-21swapper/123:13:291
598099129,2cyclictest0-21swapper/122:53:301
598099129,2cyclictest0-21swapper/122:45:081
598099129,2cyclictest0-21swapper/122:45:071
598099129,2cyclictest0-21swapper/121:20:221
598099129,2cyclictest0-21swapper/120:25:181
598099129,2cyclictest0-21swapper/120:10:151
598099129,2cyclictest0-21swapper/100:35:191
598099127,3cyclictest0-21swapper/119:40:131
598099122,6cyclictest0-21swapper/123:50:001
598099121,9cyclictest14241-21munin-node1
598099121,9cyclictest12695-21ssh23:21:061
598099121,7cyclictest0-21swapper/120:21:321
598099121,3cyclictest6147-21munin-node1
598099121,2cyclictest14961-21munin-node1
598099120,2cyclictest0-21swapper/122:59:161
598099120,2cyclictest0-21swapper/121:35:561
598099120,2cyclictest0-21swapper/119:25:121
598099120,1cyclictest22078-21diskmemload22:00:161
598099120,11cyclictest0-21swapper/123:33:191
598099120,11cyclictest0-21swapper/123:15:171
598099120,11cyclictest0-21swapper/120:55:191
598099120,11cyclictest0-21swapper/119:20:251
597999129,2cyclictest0-21swapper/021:00:140
597999121,10cyclictest2045-21kworker/u8:120:26:040
597999120,2cyclictest0-21swapper/020:55:170
597999120,2cyclictest0-21swapper/020:20:150
597999120,2cyclictest0-21swapper/019:55:180
597999120,11cyclictest0-21swapper/021:50:050
597999120,11cyclictest0-21swapper/020:35:230
597999120,11cyclictest0-21swapper/020:00:120
597999120,11cyclictest0-21swapper/019:25:280
597999120,11cyclictest0-21swapper/019:20:210
53752120,2sleep30-21swapper/300:26:003
598299118,2cyclictest0-21swapper/320:15:153
598299118,2cyclictest0-21swapper/320:10:143
598299118,2cyclictest0-21swapper/319:35:203
598299118,2cyclictest0-21swapper/319:25:143
598299118,2cyclictest0-21swapper/319:20:163
598299112,7cyclictest0-21swapper/319:32:593
598299112,6cyclictest0-21swapper/300:15:003
598299110,2cyclictest0-21swapper/321:45:513
598299110,1cyclictest0-21swapper/320:45:153
598199118,2cyclictest0-21swapper/220:00:182
598099111,8cyclictest0-21swapper/121:05:261
598099110,9cyclictest0-21swapper/120:45:141
598099110,9cyclictest0-21swapper/120:35:171
598099110,9cyclictest0-21swapper/120:15:131
598099110,9cyclictest0-21swapper/119:30:161
598099110,10cyclictest0-21swapper/119:35:161
597999118,2cyclictest0-21swapper/019:10:160
18572110,1sleep30-21swapper/322:35:073
598099100,8cyclictest0-21swapper/119:50:151
598099100,8cyclictest0-21swapper/119:50:141
597999100,9cyclictest21557-21kworker/u8:019:51:050
597999100,9cyclictest21557-21kworker/u8:019:51:040
133502100,2sleep20-21swapper/220:45:262
59829996,2cyclictest0-21swapper/320:00:213
59829994,3cyclictest6437-21cpuspeed_turbos20:30:163
59829994,3cyclictest5547-21vmstat20:25:263
59829990,6cyclictest0-21swapper/320:05:243
59819991,7cyclictest0-21swapper/219:20:592
59799995,2cyclictest10609-21sort20:40:140
59799994,3cyclictest30687-21grep20:10:160
59799992,6cyclictest0-21swapper/020:16:300
59829984,2cyclictest22670-21df_abs19:50:173
59829984,2cyclictest22670-21df_abs19:50:173
59829983,3cyclictest20423-21aten2.4_r3power21:05:163
59799983,3cyclictest2131-21nscd19:30:160
59799981,6cyclictest0-21swapper/020:31:330
59799980,7cyclictest0-21swapper/020:05:590
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional