You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-01-15 - 07:41

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Wed Jan 15, 2025 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
23764212097,18sleep00-21swapper/019:07:420
237552116105,6sleep10-21swapper/119:07:351
23616211594,16sleep30-21swapper/319:05:493
23636211391,17sleep20-21swapper/219:06:042
44932850,0sleep30-21swapper/321:00:143
240632830,0sleep30-21swapper/322:39:193
202512830,1sleep00-21swapper/020:20:130
171732750,0sleep10-21swapper/100:18:371
152372700,0sleep30-21swapper/320:05:253
135152680,0sleep00-21swapper/000:15:120
228182240,0sleep00-21swapper/020:25:140
2396899211,2cyclictest0-21swapper/121:30:081
2396799200,2cyclictest0-21swapper/023:40:110
2396799200,18cyclictest0-21swapper/020:45:110
23969991916,2cyclictest25704-21kworker/u8:221:25:042
2396799190,2cyclictest0-21swapper/021:00:120
23969991815,2cyclictest8263-21kworker/u8:221:48:042
2396999181,15cyclictest8423-21nscd00:30:042
23968991815,2cyclictest28078-21kworker/u8:021:43:031
2396899181,14cyclictest27861-21rm23:55:121
2396999171,2cyclictest0-21swapper/222:30:052
2396999170,4cyclictest9267-21copy23:35:002
2396999170,4cyclictest9267-21copy23:34:592
2396899170,15cyclictest7856-21diskmemload00:34:041
2396799170,16cyclictest0-21swapper/019:35:140
2397099161,13cyclictest0-21swapper/321:19:173
2397099160,14cyclictest0-21swapper/321:58:013
23969991613,2cyclictest16342-21kworker/u8:123:16:042
23968991613,2cyclictest10376-21kworker/u8:122:25:041
23968991611,3cyclictest7856-21diskmemload22:49:071
2396899161,13cyclictest0-21swapper/122:50:101
2396899160,14cyclictest0-21swapper/122:43:041
2396899160,13cyclictest0-21swapper/123:35:011
2396899160,13cyclictest0-21swapper/123:35:001
23970991512,2cyclictest7856-21diskmemload22:53:553
23970991512,2cyclictest0-21swapper/322:19:153
2397099150,2cyclictest0-21swapper/321:35:063
2397099150,13cyclictest23667-21ssh00:25:483
2397099150,13cyclictest11660-21kworker/u8:323:45:053
2397099150,13cyclictest0-21swapper/321:28:063
2397099150,13cyclictest0-21swapper/320:40:263
2396999151,3cyclictest28581-21ssh21:32:022
2396999151,3cyclictest0-21swapper/222:35:402
23969991512,2cyclictest30316-21kworker/u8:100:36:052
23969991512,2cyclictest1195-21kworker/u8:123:35:052
2396999151,12cyclictest14428-21ssh23:03:472
2396999150,3cyclictest0-21swapper/222:53:082
2396999150,13cyclictest30994-21ssh23:58:062
2396999150,13cyclictest0-21swapper/223:40:562
2396899151,3cyclictest0-21swapper/100:00:021
23968991512,2cyclictest7856-21diskmemload22:55:041
2396899151,12cyclictest17644-21ssh23:42:551
2396899151,12cyclictest17467-21ssh23:08:121
2396899151,12cyclictest0-21swapper/119:35:151
23968991510,3cyclictest6755-21sh22:20:031
23968991510,3cyclictest0-21swapper/122:01:431
2396899150,4cyclictest21228-21cut20:20:231
2396899150,3cyclictest0-21swapper/119:45:251
2396899150,2cyclictest0-21swapper/122:30:051
2396899150,13cyclictest9247-21apt-get23:35:061
2396899150,13cyclictest0-21swapper/100:12:341
2396799150,4cyclictest0-21swapper/022:26:020
2396799150,14cyclictest0-21swapper/022:10:040
293382140,3sleep029349-21ssh00:32:040
2397099149,3cyclictest22796-21ssh23:13:593
23970991411,2cyclictest0-21swapper/300:21:263
23970991411,2cyclictest0-21swapper/300:00:263
2397099141,11cyclictest15064-21ssh22:30:073
23970991410,2cyclictest0-21swapper/319:45:233
2397099140,2cyclictest0-21swapper/322:45:563
2397099140,2cyclictest0-21swapper/321:47:363
2397099140,13cyclictest0-21swapper/321:22:263
2397099140,13cyclictest0-21swapper/300:06:153
2397099140,12cyclictest0-21swapper/323:44:083
2397099140,12cyclictest0-21swapper/323:31:333
2397099140,12cyclictest0-21swapper/323:31:333
2397099140,12cyclictest0-21swapper/322:41:303
2397099140,12cyclictest0-21swapper/322:01:413
2397099140,12cyclictest0-21swapper/321:50:523
2396999149,3cyclictest679-21ssh23:24:522
2396999149,3cyclictest679-21ssh23:24:522
23969991411,2cyclictest22433-21ssh00:24:122
23969991411,2cyclictest1880-21kworker/u8:120:02:032
2396999141,11cyclictest15490-21ssh23:05:092
23969991410,2cyclictest0-21swapper/200:00:152
2396999140,3cyclictest0-21swapper/221:43:432
2396999140,2cyclictest0-21swapper/223:29:422
2396999140,12cyclictest7856-21diskmemload00:11:082
2396999140,12cyclictest0-21swapper/223:45:172
2396999140,12cyclictest0-21swapper/222:41:002
2396999140,12cyclictest0-21swapper/222:19:042
2396999140,12cyclictest0-21swapper/221:24:172
2396999140,12cyclictest0-21swapper/220:10:002
2396899149,3cyclictest0-21swapper/120:55:151
2396899142,7cyclictest0-21swapper/120:05:001
2396899142,2cyclictest1195-21kworker/u8:123:45:051
23968991411,2cyclictest23094-21kworker/u8:222:16:051
23968991411,2cyclictest0-21swapper/123:26:541
23968991411,2cyclictest0-21swapper/120:40:141
23968991410,2cyclictest23255-21kworker/u8:023:24:051
23968991410,2cyclictest23255-21kworker/u8:023:24:051
23968991410,2cyclictest18628-21memory21:20:171
2396899140,3cyclictest7856-21diskmemload23:12:521
2396899140,3cyclictest28824-21cat19:20:151
2396899140,2cyclictest7856-21diskmemload00:26:241
2396899140,2cyclictest0-21swapper/122:11:541
2396899140,2cyclictest0-21swapper/121:35:041
2396899140,13cyclictest0-21swapper/121:11:341
2396899140,13cyclictest0-21swapper/120:10:451
2396899140,12cyclictest7856-21diskmemload22:07:211
2396899140,12cyclictest7856-21diskmemload21:19:531
2396899140,12cyclictest0-21swapper/121:53:481
2396899140,12cyclictest0-21swapper/120:50:161
2396899140,12cyclictest0-21swapper/100:39:541
23967991410,2cyclictest24045-21ssh22:02:250
23967991410,2cyclictest14142-21latency_hist23:40:010
23967991410,2cyclictest0-21swapper/020:55:150
2396799140,2cyclictest0-21swapper/022:35:590
2396799140,12cyclictest0-21swapper/022:42:050
2396799140,12cyclictest0-21swapper/022:20:000
91642130,1sleep00-21swapper/000:10:120
290502130,2sleep00-21swapper/021:32:460
2397099139,3cyclictest10988-21df_abs23:00:133
23970991310,2cyclictest7856-21diskmemload23:22:573
23970991310,2cyclictest7856-21diskmemload23:22:573
23970991310,2cyclictest0-21swapper/323:57:363
23970991310,2cyclictest0-21swapper/323:51:063
23970991310,2cyclictest0-21swapper/322:58:563
23970991310,2cyclictest0-21swapper/322:23:363
23970991310,2cyclictest0-21swapper/322:14:293
23970991310,2cyclictest0-21swapper/321:31:363
23970991310,2cyclictest0-21swapper/300:35:163
2397099130,7cyclictest0-21swapper/319:20:593
2397099130,2cyclictest989-21ssh23:25:023
2397099130,2cyclictest0-21swapper/322:27:303
2397099130,2cyclictest0-21swapper/322:07:593
2397099130,2cyclictest0-21swapper/321:40:313
2397099130,2cyclictest0-21swapper/300:17:063
2397099130,12cyclictest0-21swapper/323:37:163
2397099130,12cyclictest0-21swapper/323:05:403
2397099130,12cyclictest0-21swapper/319:20:003
2397099130,12cyclictest0-21swapper/300:30:073
2397099130,12cyclictest0-21swapper/300:12:063
2397099130,11cyclictest0-21swapper/321:10:043
2396999139,3cyclictest0-21swapper/221:13:512
23969991310,2cyclictest7856-21diskmemload22:11:212
23969991310,2cyclictest24176-21kworker/u8:019:44:042
23969991310,2cyclictest19182-21kworker/u8:220:19:052
23969991310,2cyclictest0-21swapper/222:28:272
23969991310,2cyclictest0-21swapper/222:00:252
23969991310,2cyclictest0-21swapper/221:55:362
23969991310,2cyclictest0-21swapper/219:25:162
2396999130,2cyclictest0-21swapper/222:58:372
2396999130,2cyclictest0-21swapper/222:23:172
2396999130,2cyclictest0-21swapper/221:51:122
2396999130,2cyclictest0-21swapper/219:30:182
2396999130,12cyclictest0-21swapper/221:16:262
2396999130,11cyclictest0-21swapper/221:35:162
2396999130,11cyclictest0-21swapper/200:26:162
2396899132,8cyclictest0-21swapper/120:15:591
2396899131,3cyclictest0-21swapper/119:50:241
2396899131,10cyclictest0-21swapper/120:30:251
2396899131,10cyclictest0-21swapper/119:30:171
23968991310,2cyclictest0-21swapper/123:52:041
23968991310,2cyclictest0-21swapper/100:07:191
2396899130,2cyclictest0-21swapper/123:01:221
2396899130,2cyclictest0-21swapper/121:58:341
2396899130,2cyclictest0-21swapper/121:29:051
2396899130,2cyclictest0-21swapper/100:23:451
2396899130,12cyclictest0-21swapper/123:16:311
2396899130,12cyclictest0-21swapper/121:49:581
2396899130,12cyclictest0-21swapper/120:10:001
2396899130,11cyclictest21110-21cut22:35:231
23967991310,2cyclictest7856-21diskmemload22:52:060
23967991310,2cyclictest0-21swapper/023:54:350
23967991310,2cyclictest0-21swapper/023:32:550
23967991310,2cyclictest0-21swapper/023:32:550
23967991310,2cyclictest0-21swapper/023:20:120
23967991310,2cyclictest0-21swapper/023:20:120
23967991310,2cyclictest0-21swapper/023:16:160
23967991310,2cyclictest0-21swapper/022:55:100
23967991310,2cyclictest0-21swapper/000:03:250
2396799130,2cyclictest17399-21ssh21:19:550
2396799130,2cyclictest0-21swapper/021:21:450
2396799130,2cyclictest0-21swapper/019:20:140
2396799130,12cyclictest0-21swapper/023:56:040
2396799130,12cyclictest0-21swapper/023:10:050
2396799130,12cyclictest0-21swapper/000:21:040
2396799130,11cyclictest7856-21diskmemload22:31:550
2396799130,11cyclictest0-21swapper/022:23:160
2396799130,11cyclictest0-21swapper/021:28:220
2396799130,11cyclictest0-21swapper/020:40:130
84822120,0sleep30-21swapper/319:50:153
2397099129,2cyclictest0-21swapper/323:15:273
2397099129,2cyclictest0-21swapper/319:10:123
2397099122,8cyclictest4566-21metacity19:55:593
2397099122,7cyclictest0-21swapper/320:13:593
2397099120,2cyclictest0-21swapper/320:30:323
2396999129,2cyclictest25704-21kworker/u8:220:34:052
2396999129,2cyclictest24176-21kworker/u8:019:55:052
2396999129,2cyclictest24176-21kworker/u8:019:52:052
2396999128,2cyclictest1906-21kworker/u8:000:15:052
2396999128,2cyclictest18901-21ssh23:10:082
2396999120,2cyclictest0-21swapper/223:50:042
2396999120,2cyclictest0-21swapper/200:05:432
2396999120,11cyclictest0-21swapper/222:45:012
2396999120,11cyclictest0-21swapper/222:05:092
2396999120,11cyclictest0-21swapper/220:20:132
2396999120,11cyclictest0-21swapper/219:20:002
2396999120,11cyclictest0-21swapper/219:15:172
2396999120,10cyclictest0-21swapper/221:05:102
2396899127,3cyclictest10083-21munin-node1
2396899122,7cyclictest0-21swapper/121:01:021
2396899121,9cyclictest0-21swapper/120:25:141
2396899120,11cyclictest0-21swapper/120:35:211
2396799129,2cyclictest17915-21apt-get20:15:050
2396799129,2cyclictest0-21swapper/021:38:150
2396799129,2cyclictest0-21swapper/019:45:450
2396799120,2cyclictest0-21swapper/021:52:260
2396799120,2cyclictest0-21swapper/021:05:090
2396799120,2cyclictest0-21swapper/020:05:190
2396799120,11cyclictest7856-21diskmemload23:08:360
2396799120,11cyclictest7856-21diskmemload00:35:350
2396799120,11cyclictest0-21swapper/023:04:510
2396799120,11cyclictest0-21swapper/022:06:460
2396799120,11cyclictest0-21swapper/021:55:060
2396799120,11cyclictest0-21swapper/021:49:360
2396799120,11cyclictest0-21swapper/021:12:060
2396799120,11cyclictest0-21swapper/020:00:160
2396799120,11cyclictest0-21swapper/019:55:160
2396799120,11cyclictest0-21swapper/019:50:160
2396799120,11cyclictest0-21swapper/000:05:550
2396799120,10cyclictest0-21swapper/021:40:120
2397099118,2cyclictest0-21swapper/320:55:273
2397099118,2cyclictest0-21swapper/320:15:203
2397099112,7cyclictest0-21swapper/321:05:593
2397099111,8cyclictest32021-21apt-get19:30:053
2397099110,9cyclictest0-21swapper/320:20:153
2396999118,2cyclictest24176-21kworker/u8:019:49:042
2396999118,2cyclictest21675-21kworker/u8:219:10:052
2396999118,2cyclictest0-21swapper/221:00:132
2396999118,2cyclictest0-21swapper/220:56:152
2396999111,8cyclictest0-21swapper/220:45:112
2396899118,2cyclictest0-21swapper/120:45:121
2396899113,2cyclictest0-21swapper/119:10:141
2396899111,3cyclictest0-21swapper/119:25:201
2396899110,9cyclictest3944-21munin-node1
2396899110,7cyclictest0-21swapper/121:05:101
2396799118,2cyclictest0-21swapper/023:47:270
2396799118,2cyclictest0-21swapper/023:26:540
2396799118,2cyclictest0-21swapper/000:28:120
2396799110,10cyclictest28107-21kworker/u8:122:45:050
2396799110,10cyclictest0-21swapper/019:34:150
2397099107,2cyclictest0-21swapper/319:40:203
2397099105,3cyclictest27118-21ntpq20:35:183
2397099101,7cyclictest0-21swapper/320:53:023
2397099100,7cyclictest0-21swapper/319:37:583
2397099100,2cyclictest0-21swapper/320:27:153
2396999107,2cyclictest0-21swapper/220:50:072
2396999102,6cyclictest0-21swapper/220:12:022
2396799101,7cyclictest26711-21cut20:35:140
2396799100,7cyclictest0-21swapper/020:54:590
239699996,2cyclictest3558-21snmpd20:26:292
239699996,2cyclictest0-21swapper/220:36:212
239699994,3cyclictest28507-21grep20:40:142
239699991,3cyclictest0-21swapper/219:35:142
239689994,3cyclictest27299-21sensors_fan19:15:251
239679996,2cyclictest30229-21apt-get19:25:100
239679996,2cyclictest0-21swapper/020:12:150
239679990,7cyclictest0-21swapper/019:10:230
239709984,2cyclictest0-21swapper/320:45:133
239709983,3cyclictest30705-21cut19:25:123
239709980,7cyclictest0-21swapper/320:00:013
239679986,1cyclictest0-21swapper/019:40:170
239679985,2cyclictest0-21swapper/019:19:250
239679983,3cyclictest25255-21pzem_voltage20:30:300
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional