You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-04-03 - 11:09

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackcslot3s.osadl.org (updated Thu Apr 03, 2025 00:43:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
48932319312,4sleep30-21swapper/319:09:273
47312317306,8sleep00-21swapper/019:07:190
47222315308,5sleep10-21swapper/119:07:121
46052315309,4sleep20-21swapper/219:05:402
5202993120,311cyclictest4215-21kworker/u16:1+efi_rts_wq21:20:151
5203993100,309cyclictest1020-21kworker/u16:2+efi_rts_wq22:10:082
5203993070,306cyclictest22115-21kworker/u16:1+efi_rts_wq00:00:142
5204993030,302cyclictest17031-21kworker/u16:0+efi_rts_wq20:30:153
5201993020,301cyclictest4215-21kworker/u16:1+efi_rts_wq20:35:140
5201993010,299cyclictest1020-21kworker/u16:2+efi_rts_wq21:55:120
5204993000,299cyclictest27787-21kworker/u16:2+efi_rts_wq22:50:083
5203992980,297cyclictest850-21kworker/u16:1+efi_rts_wq19:25:132
5204992960,295cyclictest4215-21kworker/u16:1+efi_rts_wq21:20:153
5202992950,294cyclictest22115-21kworker/u16:1+efi_rts_wq00:35:141
5201992940,293cyclictest15637-21kworker/u16:3+efi_rts_wq19:55:120
5202992930,292cyclictest2995-21kworker/u16:2+efi_rts_wq23:20:121
5201992930,292cyclictest4215-21kworker/u16:1+efi_rts_wq21:50:090
5204992890,287cyclictest1020-21kworker/u16:2+efi_rts_wq22:00:183
5202992890,288cyclictest15637-21kworker/u16:3+efi_rts_wq20:10:151
5202992880,287cyclictest17031-21kworker/u16:0+efi_rts_wq19:10:141
5201992880,287cyclictest17031-21kworker/u16:0+efi_rts_wq19:30:160
5203992870,286cyclictest17031-21kworker/u16:0+efi_rts_wq20:40:132
5201992870,286cyclictest1020-21kworker/u16:2+efi_rts_wq22:30:090
5202992860,284cyclictest21670-21kworker/u16:0+efi_rts_wq22:40:131
5201992860,285cyclictest17031-21kworker/u16:0+efi_rts_wq21:00:130
5204992850,284cyclictest2995-21kworker/u16:2+efi_rts_wq23:20:133
5204992850,284cyclictest19848-21kworker/u16:2+efi_rts_wq00:20:133
5204992840,283cyclictest2995-21kworker/u16:2+efi_rts_wq23:30:193
5201992840,283cyclictest850-21kworker/u16:1+efi_rts_wq19:25:140
5204992820,281cyclictest22115-21kworker/u16:1+efi_rts_wq00:30:093
5202992820,281cyclictest4215-21kworker/u16:1+efi_rts_wq21:40:151
5203992810,280cyclictest1020-21kworker/u16:2+efi_rts_wq22:00:182
5201992800,279cyclictest17031-21kworker/u16:0+efi_rts_wq20:40:150
5202992790,278cyclictest26794-21kworker/u16:1+efi_rts_wq23:00:151
5203992780,277cyclictest17031-21kworker/u16:0+efi_rts_wq19:15:152
5201992760,275cyclictest373-21kworker/u16:3+efi_rts_wq23:35:130
5204992750,274cyclictest17031-21kworker/u16:0+efi_rts_wq20:55:133
5202992750,274cyclictest17031-21kworker/u16:0+efi_rts_wq20:50:171
5204992720,271cyclictest1020-21kworker/u16:2+efi_rts_wq22:30:093
5202992710,270cyclictest373-21kworker/u16:3+efi_rts_wq23:55:141
5203992690,268cyclictest17031-21kworker/u16:0+efi_rts_wq21:35:132
5202992690,268cyclictest22115-21kworker/u16:1+efi_rts_wq00:15:131
5201992680,267cyclictest11663-21kworker/u16:1+efi_rts_wq23:40:130
5201992670,265cyclictest2995-21kworker/u16:2+efi_rts_wq23:10:080
5203992650,264cyclictest4215-21kworker/u16:1+efi_rts_wq21:50:092
5203992630,260cyclictest4215-21kworker/u16:1+efi_rts_wq20:25:142
5203992590,258cyclictest850-21kworker/u16:1+efi_rts_wq19:20:142
5203992570,256cyclictest22115-21kworker/u16:1+efi_rts_wq00:35:142
5201992570,255cyclictest2995-21kworker/u16:2+efi_rts_wq23:15:110
5201992560,255cyclictest16875-21kworker/u16:2+efi_rts_wq19:50:160
5204992500,249cyclictest17031-21kworker/u16:0+efi_rts_wq19:10:143
5204992500,247cyclictest4215-21kworker/u16:1+efi_rts_wq22:15:133
5204992480,247cyclictest4215-21kworker/u16:1+efi_rts_wq21:05:153
5204992470,246cyclictest4215-21kworker/u16:1+efi_rts_wq20:35:133
5201992450,244cyclictest22115-21kworker/u16:1+efi_rts_wq00:15:130
5201992440,241cyclictest16686-21kworker/u16:0+efi_rts_wq23:50:090
5201992410,240cyclictest1020-21kworker/u16:2+efi_rts_wq22:20:160
5203992390,238cyclictest26794-21kworker/u16:1+efi_rts_wq23:00:152
5203992370,236cyclictest16875-21kworker/u16:2+efi_rts_wq19:50:162
5201992370,236cyclictest15637-21kworker/u16:3+efi_rts_wq20:05:140
5203992360,235cyclictest16875-21kworker/u16:2+efi_rts_wq19:40:132
5202992340,233cyclictest373-21kworker/u16:3+efi_rts_wq23:35:131
5203992320,231cyclictest16875-21kworker/u16:2+efi_rts_wq19:45:132
5202992320,231cyclictest4215-21kworker/u16:1+efi_rts_wq21:30:131
5202992320,231cyclictest1020-21kworker/u16:2+efi_rts_wq22:30:081
5202992310,230cyclictest1020-21kworker/u16:2+efi_rts_wq21:55:121
5203992220,221cyclictest15637-21kworker/u16:3+efi_rts_wq19:35:132
5204992210,220cyclictest15637-21kworker/u16:3+efi_rts_wq19:35:133
5203992210,220cyclictest17031-21kworker/u16:0+efi_rts_wq20:55:142
5203992200,217cyclictest4215-21kworker/u16:1+efi_rts_wq22:15:152
5204992190,218cyclictest4215-21kworker/u16:1+efi_rts_wq21:30:133
5204992160,215cyclictest4215-21kworker/u16:1+efi_rts_wq21:40:153
5201992130,212cyclictest16875-21kworker/u16:2+efi_rts_wq20:00:120
5202992110,210cyclictest4215-21kworker/u16:1+efi_rts_wq20:45:151
5203992100,209cyclictest19848-21kworker/u16:2+efi_rts_wq00:10:092
5202992100,209cyclictest17031-21kworker/u16:0+efi_rts_wq19:30:161
5202992030,202cyclictest16875-21kworker/u16:2+efi_rts_wq19:40:141
5201992020,201cyclictest373-21kworker/u16:3+efi_rts_wq23:55:130
5204991990,198cyclictest16686-21kworker/u16:0+efi_rts_wq23:50:073
5204991980,197cyclictest27787-21kworker/u16:2+efi_rts_wq22:55:123
5203991960,195cyclictest16875-21kworker/u16:2+efi_rts_wq20:00:132
5203991950,194cyclictest21670-21kworker/u16:0+efi_rts_wq22:40:132
5204991940,193cyclictest2995-21kworker/u16:2+efi_rts_wq23:15:103
5202991930,192cyclictest27787-21kworker/u16:2+efi_rts_wq22:55:121
5203991920,191cyclictest27787-21kworker/u16:2+efi_rts_wq22:50:082
5203991910,190cyclictest17031-21kworker/u16:0+efi_rts_wq21:15:132
5203991870,186cyclictest17031-21kworker/u16:0+efi_rts_wq20:30:152
5204991860,185cyclictest4215-21kworker/u16:1+efi_rts_wq21:10:163
5204991860,185cyclictest17031-21kworker/u16:0+efi_rts_wq21:15:133
5203991860,185cyclictest4215-21kworker/u16:1+efi_rts_wq22:35:132
5204991830,182cyclictest4215-21kworker/u16:1+efi_rts_wq22:35:133
5202991790,178cyclictest19848-21kworker/u16:2+efi_rts_wq00:20:141
5201991780,177cyclictest22115-21kworker/u16:1+efi_rts_wq00:00:150
5201991770,176cyclictest4215-21kworker/u16:1+efi_rts_wq20:45:150
5201991760,175cyclictest1020-21kworker/u16:2+efi_rts_wq22:35:130
5201991750,174cyclictest16875-21kworker/u16:2+efi_rts_wq20:15:140
5203991700,169cyclictest16875-21kworker/u16:2+efi_rts_wq20:15:142
5203991650,164cyclictest4215-21kworker/u16:1+efi_rts_wq20:45:152
5204991620,161cyclictest1020-21kworker/u16:2+efi_rts_wq22:20:173
5201991590,158cyclictest19848-21kworker/u16:2+efi_rts_wq00:10:100
5201991550,153cyclictest16875-21kworker/u16:2+efi_rts_wq19:45:140
5201991520,151cyclictest16875-21kworker/u16:2+efi_rts_wq20:20:120
5202991440,143cyclictest4215-21kworker/u16:1+efi_rts_wq21:05:141
5202991420,141cyclictest4215-21kworker/u16:1+efi_rts_wq21:10:171
5203991350,134cyclictest15637-21kworker/u16:3+efi_rts_wq19:55:112
5202991330,132cyclictest16875-21kworker/u16:2+efi_rts_wq20:20:121
129412470,1sleep012558-21scp23:30:180
5201993330,3cyclictest808-21snmpd22:56:120
5203993230,2cyclictest808-21snmpd23:38:522
5203993230,2cyclictest808-21snmpd23:24:102
5203993230,2cyclictest808-21snmpd22:25:322
5203993229,2cyclictest808-21snmpd00:22:242
5202993229,2cyclictest808-21snmpd20:09:391
5202993229,2cyclictest808-21snmpd19:46:151
5204993130,1cyclictest808-21snmpd00:17:353
5203993129,2cyclictest808-21snmpd23:57:412
5203993128,2cyclictest808-21snmpd20:51:122
5202993130,1cyclictest808-21snmpd22:35:531
5202993130,1cyclictest808-21snmpd22:18:281
5202993130,1cyclictest808-21snmpd19:59:571
5202993130,1cyclictest808-21snmpd19:21:411
5202993129,2cyclictest808-21snmpd23:54:491
5202993128,2cyclictest808-21snmpd20:27:521
5201993130,1cyclictest808-21snmpd21:40:270
5201993129,2cyclictest29071-21cat22:50:100
5204993029,1cyclictest808-21snmpd22:40:563
5204993029,1cyclictest808-21snmpd19:19:583
5204993029,1cyclictest808-21snmpd00:35:093
5204993028,2cyclictest808-21snmpd22:29:583
5204993028,2cyclictest808-21snmpd21:50:183
5204993028,2cyclictest808-21snmpd20:06:353
5204993028,2cyclictest808-21snmpd19:43:263
5204993028,2cyclictest808-21snmpd19:33:023
5204993027,3cyclictest16518-21kworker/3:2+mm_percpu_wq20:23:463
5204993027,3cyclictest16518-21kworker/3:2-events20:49:223
5203993029,1cyclictest808-21snmpd23:46:192
5203993028,2cyclictest808-21snmpd22:57:032
5203993028,2cyclictest808-21snmpd22:20:162
5203993028,2cyclictest808-21snmpd21:09:532
5203993028,2cyclictest808-21snmpd20:39:552
5203993028,2cyclictest808-21snmpd00:06:082
5202993029,1cyclictest808-21snmpd21:27:381
5202993029,1cyclictest808-21snmpd21:16:041
5202993029,1cyclictest808-21snmpd20:56:291
5202993029,1cyclictest808-21snmpd20:32:481
5202993029,1cyclictest808-21snmpd20:15:241
5202993029,1cyclictest808-21snmpd00:30:301
5202993028,2cyclictest808-21snmpd23:16:331
5202993028,2cyclictest808-21snmpd22:48:591
5202993028,2cyclictest808-21snmpd22:12:311
5202993027,2cyclictest808-21snmpd22:09:251
5201993029,1cyclictest808-21snmpd23:45:340
5201993029,1cyclictest808-21snmpd21:13:530
5201993029,1cyclictest808-21snmpd21:08:280
5201993029,1cyclictest808-21snmpd20:31:150
5201993029,1cyclictest808-21snmpd20:29:010
5201993029,1cyclictest808-21snmpd19:40:010
5201993029,1cyclictest808-21snmpd19:39:530
5201993029,1cyclictest808-21snmpd00:39:410
5201993028,1cyclictest808-21snmpd21:47:300
5204992929,0cyclictest22115-21kworker/u16:1+atlantic00:08:043
5204992928,1cyclictest808-21snmpd23:36:073
5204992928,1cyclictest808-21snmpd23:28:333
5204992928,1cyclictest808-21snmpd23:08:003
5204992928,1cyclictest808-21snmpd23:07:593
5204992928,1cyclictest808-21snmpd21:46:533
5204992928,1cyclictest808-21snmpd21:28:393
5204992928,1cyclictest808-21snmpd19:56:203
5204992928,1cyclictest808-21snmpd00:26:543
5204992928,1cyclictest22990-21cat23:55:163
5204992927,2cyclictest808-21snmpd22:12:163
5203992928,1cyclictest808-21snmpd23:07:542
5203992928,1cyclictest808-21snmpd23:07:532
5203992928,1cyclictest808-21snmpd21:00:372
5203992927,2cyclictest808-21snmpd23:32:152
5203992927,2cyclictest808-21snmpd23:27:102
5203992927,2cyclictest808-21snmpd21:31:332
5202992928,1cyclictest808-21snmpd23:31:061
5202992927,2cyclictest808-21snmpd23:48:041
5202992927,2cyclictest10884-21cat22:00:201
5202992926,2cyclictest808-21snmpd21:51:091
5201992929,0cyclictest808-21snmpd23:00:150
5201992929,0cyclictest15616-21kworker/0:1+events22:45:500
5201992928,1cyclictest808-21snmpd21:31:060
5201992928,1cyclictest3109-21kworker/0:0+events23:09:160
5201992928,1cyclictest3109-21kworker/0:0+events23:09:160
5201992927,2cyclictest808-21snmpd23:22:180
5201992927,2cyclictest808-21snmpd21:35:560
5201992927,2cyclictest808-21snmpd00:25:200
5201992926,3cyclictest25607-21cat22:40:150
5201992926,2cyclictest808-21snmpd22:18:130
5204992827,1cyclictest808-21snmpd20:52:063
5203992828,0cyclictest11663-21kworker/u16:1+atlantic23:40:192
5203992827,1cyclictest808-21snmpd23:53:342
5203992827,1cyclictest808-21snmpd22:47:502
5203992827,1cyclictest808-21snmpd21:57:332
5203992827,1cyclictest808-21snmpd21:43:032
5203992826,2cyclictest808-21snmpd21:29:442
5203992825,3cyclictest808-21snmpd22:33:552
5202992828,0cyclictest808-21snmpd23:10:091
5202992828,0cyclictest15637-21kworker/u16:3+atlantic19:54:561
5202992827,1cyclictest9806-21cat20:35:151
5202992827,1cyclictest808-21snmpd19:36:501
5202992827,1cyclictest808-21snmpd00:28:021
5202992826,2cyclictest808-21snmpd22:51:021
5202992826,2cyclictest808-21snmpd22:21:151
5201992828,0cyclictest15616-21kworker/0:1+events22:09:200
5201992828,0cyclictest15616-21kworker/0:1+events22:00:470
5201992827,1cyclictest808-21snmpd21:22:530
5201992827,1cyclictest808-21snmpd19:15:240
5204992726,1cyclictest808-21snmpd22:06:453
5204992726,1cyclictest808-21snmpd21:03:433
5204992726,1cyclictest808-21snmpd20:11:153
5204992726,1cyclictest808-21snmpd20:02:543
5204992726,1cyclictest808-21snmpd00:14:223
5203992727,0cyclictest19848-21kworker/u16:2+atlantic00:18:442
5203992727,0cyclictest15637-21kworker/u16:3+atlantic20:11:152
5203992727,0cyclictest15637-21kworker/u16:3+atlantic19:32:522
5202992727,0cyclictest17031-21kworker/u16:0+atlantic19:28:351
5202992726,1cyclictest808-21snmpd23:41:301
5202992726,1cyclictest808-21snmpd21:46:021
5202992726,1cyclictest808-21snmpd19:17:541
5201992727,0cyclictest3109-21kworker/0:0+events23:27:040
5201992727,0cyclictest16687-21kworker/0:1+events00:05:330
5201992726,1cyclictest808-21snmpd19:23:320
5201992726,1cyclictest808-21snmpd00:23:090
5204992626,0cyclictest1020-21kworker/u16:2+atlantic21:37:193
5204992624,2cyclictest808-21snmpd20:18:343
5203992624,2cyclictest808-21snmpd23:17:112
5203992624,2cyclictest808-21snmpd23:14:062
5203992624,2cyclictest808-21snmpd00:26:442
5202992624,2cyclictest808-21snmpd00:14:021
5201992625,1cyclictest808-21snmpd21:25:050
5201992625,1cyclictest808-21snmpd20:13:350
5204992524,1cyclictest808-21snmpd22:47:383
5204992524,1cyclictest808-21snmpd19:48:083
5204992522,3cyclictest808-21snmpd23:41:483
5202992525,0cyclictest15637-21kworker/u16:3+atlantic20:04:511
5202992523,2cyclictest808-21snmpd21:03:501
5201992525,0cyclictest15616-21kworker/0:1+events21:18:070
5201992525,0cyclictest15616-21kworker/0:1+events20:54:400
5204992422,2cyclictest808-21snmpd23:00:053
5204992422,2cyclictest808-21snmpd19:53:543
5203992423,1cyclictest808-21snmpd20:09:452
5201992424,0cyclictest13316-21kworker/0:0+events19:12:160
5201992423,1cyclictest808-21snmpd22:29:470
5204992322,1cyclictest808-21snmpd20:40:003
5203992323,0cyclictest4215-21kworker/u16:1+atlantic21:24:322
5203992322,1cyclictest808-21snmpd21:49:052
5203992322,1cyclictest808-21snmpd21:10:142
5202992322,1cyclictest808-21snmpd23:27:581
5204992221,1cyclictest808-21snmpd19:21:593
5204992221,1cyclictest808-21snmpd00:00:343
5203992222,0cyclictest17031-21kworker/u16:0+atlantic19:12:162
5203992220,2cyclictest808-21snmpd22:06:002
5202992220,2cyclictest808-21snmpd23:09:001
5202992220,2cyclictest808-21snmpd23:08:591
5204992120,1cyclictest808-21snmpd23:14:483
5201992121,0cyclictest16687-21kworker/0:1+events00:33:400
5202992019,1cyclictest808-21snmpd20:43:271
5201992019,1cyclictest808-21snmpd20:56:520
520499190,19cyclictest19679-21sshd23:48:343
5203991919,0cyclictest19848-21kworker/u16:2+atlantic00:33:402
5203991818,0cyclictest4215-21kworker/u16:1+atlantic20:24:472
5202991818,0cyclictest74950irq/132-enp1s000:01:441
5201991717,0cyclictest15616-21kworker/0:1+events22:14:590
5202991413,1cyclictest808-21snmpd22:25:351
5202991312,1cyclictest808-21snmpd00:09:411
5204991210,2cyclictest808-21snmpd20:25:223
52049987,1cyclictest12034-21cat19:25:123
52029965,1cyclictest1531-21tune2fs21:35:141
52049954,1cyclictest8266-21sort21:55:103
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional