You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-04-02 - 04:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #0, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot7s.osadl.org (updated Wed Apr 02, 2025 00:43:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2964225211969,21sleep20-21swapper/219:06:212
2964354211871,39sleep00-21swapper/019:08:000
2962764210272,21sleep10-21swapper/119:05:041
2964136210173,20sleep30-21swapper/319:05:233
2964635995818,40cyclictest0-21swapper/120:40:121
296463399260,25cyclictest0-21swapper/021:53:350
296463899250,25cyclictest0-21swapper/200:13:012
296463899250,16cyclictest0-21swapper/200:08:012
296463399250,24cyclictest0-21swapper/023:10:200
296463399250,15cyclictest2950719-21kworker/0:1+kacpid19:53:230
296463399240,16cyclictest0-21swapper/020:22:440
296463399240,15cyclictest0-21swapper/022:03:530
296463399240,15cyclictest0-21swapper/021:12:340
2964635992212,4cyclictest0-21swapper/121:57:201
296464399217,13cyclictest0-21swapper/319:55:023
2964638992111,10cyclictest0-21swapper/220:44:092
2964633992110,4cyclictest0-21swapper/023:09:260
296464399195,8cyclictest0-21swapper/321:15:163
296464399188,4cyclictest2964627-21cyclictest19:23:323
296464399188,4cyclictest0-21swapper/300:01:243
296464399180,17cyclictest0-21swapper/320:50:243
2964638991815,2cyclictest1051-21snmpd19:42:582
296463399180,17cyclictest0-21swapper/022:54:170
296464399177,4cyclictest0-21swapper/323:13:593
296464399175,11cyclictest0-21swapper/323:40:273
296464399175,11cyclictest0-21swapper/320:49:393
296464399173,13cyclictest0-21swapper/320:34:273
2964643991712,5cyclictest0-21swapper/321:59:543
2964638991714,2cyclictest1051-21snmpd21:12:102
296463899170,17cyclictest0-21swapper/223:50:162
296463899170,17cyclictest0-21swapper/221:52:352
296463899170,17cyclictest0-21swapper/200:33:442
296463899170,16cyclictest0-21swapper/223:35:032
296463899170,16cyclictest0-21swapper/222:26:392
2964635991715,1cyclictest1051-21snmpd23:08:461
296463599170,17cyclictest0-21swapper/120:17:501
296463599170,11cyclictest0-21swapper/123:21:361
296463399179,8cyclictest0-21swapper/023:55:120
296463399177,10cyclictest0-21swapper/019:30:460
296463399170,16cyclictest0-21swapper/023:35:200
296463399170,16cyclictest0-21swapper/021:24:320
296463399170,16cyclictest0-21swapper/019:12:350
296463399170,16cyclictest0-21swapper/000:31:520
296464399166,9cyclictest0-21swapper/320:04:123
2964643991613,2cyclictest0-21swapper/323:09:283
2964643991611,4cyclictest1051-21snmpd22:12:083
2964643991611,4cyclictest0-21swapper/320:15:273
296464399160,15cyclictest0-21swapper/319:45:163
296464399160,15cyclictest0-21swapper/319:36:533
296463899160,7cyclictest0-21swapper/219:32:282
2964635991612,4cyclictest0-21swapper/121:49:141
2964633991615,1cyclictest1051-21snmpd22:12:570
2964633991614,1cyclictest1051-21snmpd19:58:050
296463399160,15cyclictest0-21swapper/022:07:270
296464399159,5cyclictest1051-21snmpd20:56:013
296464399159,5cyclictest1051-21snmpd20:56:003
296464399156,4cyclictest0-21swapper/322:46:073
2964643991512,2cyclictest1045-21nmbd20:36:323
296464399150,7cyclictest0-21swapper/323:04:203
296464399150,6cyclictest0-21swapper/323:24:003
296464399150,1cyclictest0-21swapper/319:10:193
296464399150,15cyclictest0-21swapper/323:19:543
2964638991512,2cyclictest1051-21snmpd23:10:142
296463899150,6cyclictest0-21swapper/223:46:452
2964635991511,4cyclictest0-21swapper/122:51:231
2964635991511,4cyclictest0-21swapper/119:25:021
296463599150,7cyclictest0-21swapper/123:43:091
296463599150,7cyclictest0-21swapper/119:24:011
296463599150,6cyclictest0-21swapper/123:02:051
296463599150,6cyclictest0-21swapper/120:55:541
296463599150,6cyclictest0-21swapper/120:55:541
296463599150,15cyclictest0-21swapper/123:27:511
2964633991514,1cyclictest0-21swapper/023:19:480
2964633991514,1cyclictest0-21swapper/021:02:090
2964633991514,1cyclictest0-21swapper/000:15:190
2964633991511,4cyclictest0-21swapper/020:03:290
296463399150,7cyclictest0-21swapper/019:37:100
296463399150,1cyclictest0-21swapper/021:15:160
296463399150,15cyclictest0-21swapper/023:00:500
296463399150,15cyclictest0-21swapper/019:19:160
296464399148,5cyclictest1051-21snmpd20:21:173
296464399147,6cyclictest0-21swapper/323:30:353
296464399143,10cyclictest0-21swapper/322:27:553
296464399143,10cyclictest0-21swapper/322:00:153
2964643991413,1cyclictest0-21swapper/319:43:473
296464399141,12cyclictest0-21swapper/321:12:523
2964643991410,4cyclictest0-21swapper/323:35:273
2964643991410,4cyclictest0-21swapper/321:20:163
296464399140,13cyclictest0-21swapper/322:51:373
296464399140,13cyclictest0-21swapper/320:40:163
296464399140,10cyclictest0-21swapper/321:29:373
296463899144,4cyclictest0-21swapper/222:14:482
296463899144,10cyclictest0-21swapper/222:42:582
296463899144,10cyclictest0-21swapper/220:37:002
2964638991413,1cyclictest0-21swapper/219:45:152
2964638991412,1cyclictest1051-21snmpd00:35:142
2964638991411,2cyclictest1051-21snmpd22:23:032
2964635991411,2cyclictest1051-21snmpd00:37:441
2964635991410,4cyclictest0-21swapper/121:26:161
2964635991410,4cyclictest0-21swapper/100:29:311
296463599140,6cyclictest0-21swapper/119:48:021
296463399149,5cyclictest0-21swapper/023:44:580
2964633991410,4cyclictest0-21swapper/023:20:230
296463399140,6cyclictest0-21swapper/019:40:440
296464399137,5cyclictest0-21swapper/300:30:113
296464399137,2cyclictest1051-21snmpd21:31:343
296464399136,4cyclictest0-21swapper/300:15:233
296464399136,2cyclictest2974567-21tail19:30:243
296464399132,10cyclictest0-21swapper/322:07:063
296464399132,10cyclictest0-21swapper/319:25:073
2964643991310,3cyclictest0-21swapper/322:39:283
2964643991310,2cyclictest1051-21snmpd00:27:253
296464399130,13cyclictest0-21swapper/322:43:013
296464399130,13cyclictest0-21swapper/322:30:113
296464399130,13cyclictest0-21swapper/322:16:543
296463899132,11cyclictest0-21swapper/200:21:442
2964638991311,2cyclictest2995786-21sshd-session20:32:252
2964638991310,2cyclictest1051-21snmpd21:57:292
2964638991310,2cyclictest1051-21snmpd21:28:582
2964638991310,2cyclictest1051-21snmpd19:58:202
2964638991310,2cyclictest1051-21snmpd19:39:082
296463899130,1cyclictest0-21swapper/223:00:202
296463899130,13cyclictest0-21swapper/221:00:202
2964635991310,2cyclictest1051-21snmpd19:40:191
296463599130,13cyclictest0-21swapper/119:50:201
296463399134,9cyclictest0-21swapper/022:55:140
296463399133,10cyclictest0-21swapper/020:34:150
2964633991312,1cyclictest0-21swapper/000:07:250
2964633991310,2cyclictest2980074-21ntp_states19:45:170
2964633991310,2cyclictest1051-21snmpd21:41:170
296463399130,12cyclictest0-21swapper/020:40:120
296464399129,2cyclictest1051-21snmpd23:51:463
296464399129,2cyclictest1051-21snmpd20:25:393
296464399127,1cyclictest0-21swapper/300:08:103
296464399126,2cyclictest1051-21snmpd19:54:513
296464399124,5cyclictest0-21swapper/321:50:473
296464399120,3cyclictest0-21swapper/320:10:413
296464399120,11cyclictest0-21swapper/300:37:503
296463899129,3cyclictest0-21swapper/223:44:522
296463899129,2cyclictest1051-21snmpd23:32:002
296463899129,2cyclictest1051-21snmpd22:53:012
296463899129,2cyclictest1051-21snmpd22:09:152
296463899129,2cyclictest1051-21snmpd22:00:332
296463899129,2cyclictest1051-21snmpd21:41:142
296463899129,2cyclictest1051-21snmpd21:30:282
296463899129,2cyclictest1051-21snmpd21:23:462
296463899129,2cyclictest1051-21snmpd20:56:072
296463899129,2cyclictest1051-21snmpd20:56:062
296463899129,2cyclictest1051-21snmpd20:48:272
296463899129,2cyclictest1051-21snmpd20:11:112
296463899129,2cyclictest1051-21snmpd19:50:392
296463899129,2cyclictest1051-21snmpd00:19:132
296463899128,4cyclictest0-21swapper/220:06:172
296463899127,4cyclictest0-21swapper/223:05:192
296463899122,10cyclictest0-21swapper/220:16:422
2964638991211,1cyclictest0-21swapper/223:20:172
2964638991211,1cyclictest0-21swapper/219:20:222
2964638991210,1cyclictest1051-21snmpd23:28:212
296463599129,2cyclictest3007384-21unixbench_multi21:00:211
296463599129,2cyclictest1051-21snmpd22:47:491
296463599129,2cyclictest1051-21snmpd20:47:481
296463599129,2cyclictest1051-21snmpd00:34:101
296463599128,4cyclictest0-21swapper/122:06:001
296463599127,5cyclictest0-21swapper/123:55:521
2964635991211,1cyclictest1051-21snmpd23:14:201
296463599120,12cyclictest0-21swapper/120:52:421
296463399129,2cyclictest987-21gdbus19:30:000
296463399128,4cyclictest0-21swapper/021:55:500
296463399128,1cyclictest0-21swapper/022:25:460
296463399122,10cyclictest0-21swapper/020:54:270
2964633991211,1cyclictest0-21swapper/022:40:180
296464399119,1cyclictest0-21swapper/320:05:023
296464399118,2cyclictest1051-21snmpd23:55:163
296464399117,4cyclictest0-21swapper/300:24:293
296464399116,1cyclictest0-21swapper/300:10:463
296464399110,10cyclictest0-21swapper/321:46:263
296463899119,1cyclictest1051-21snmpd21:36:142
296463899119,1cyclictest1051-21snmpd20:22:142
296463899118,2cyclictest1051-21snmpd22:57:232
296463899118,2cyclictest1051-21snmpd22:32:192
296463899118,2cyclictest1051-21snmpd21:46:292
296463899118,2cyclictest1051-21snmpd20:27:572
296463899118,2cyclictest1051-21snmpd20:02:142
296463899117,4cyclictest0-21swapper/222:38:102
296463899117,4cyclictest0-21swapper/221:15:142
296463899117,4cyclictest0-21swapper/219:11:052
296463899110,3cyclictest0-21swapper/200:25:342
296463899110,10cyclictest0-21swapper/222:46:192
296463899110,10cyclictest0-21swapper/220:50:032
296463599118,2cyclictest3066695-21fschecks_count00:00:131
296463599118,2cyclictest2996702-21fschecks_time20:35:131
296463599118,2cyclictest1051-21snmpd22:19:061
296463599118,2cyclictest1051-21snmpd21:32:551
296463599118,2cyclictest1051-21snmpd21:21:491
296463599112,9cyclictest0-21swapper/123:52:421
296463599112,9cyclictest0-21swapper/119:13:421
296463599111,4cyclictest0-21swapper/121:53:231
2964635991110,1cyclictest1550-21ntpd19:16:371
2964635991110,1cyclictest1051-21snmpd21:16:521
296463599110,10cyclictest0-21swapper/122:25:361
296463599110,10cyclictest0-21swapper/100:06:401
296463399119,2cyclictest3017024-21fschecks_time21:30:140
296463399119,1cyclictest1051-21snmpd22:15:000
296463399119,1cyclictest0-21swapper/023:47:400
296463399118,2cyclictest3063657-21unixbench_multi23:50:150
296463399118,2cyclictest2989060-21unixbench_singl20:10:180
296463399118,2cyclictest1051-21snmpd00:25:440
296463399117,4cyclictest0-21swapper/021:38:530
296463399111,10cyclictest0-21swapper/022:32:310
296463399111,10cyclictest0-21swapper/020:55:450
296463399111,10cyclictest0-21swapper/020:55:450
2964633991110,1cyclictest1051-21snmpd21:47:380
296463399110,1cyclictest0-21swapper/021:05:170
296463399110,10cyclictest0-21swapper/023:28:120
296463399110,10cyclictest0-21swapper/022:47:220
296463399110,10cyclictest0-21swapper/020:05:120
296463399110,10cyclictest0-21swapper/000:00:000
296464399107,2cyclictest1051-21snmpd21:38:233
296464399100,10cyclictest0-21swapper/321:05:373
296464399100,10cyclictest0-21swapper/319:15:583
296463899107,2cyclictest1051-21snmpd23:19:422
296463899107,2cyclictest1051-21snmpd00:00:122
296463899101,9cyclictest0-21swapper/222:15:182
296463899100,10cyclictest0-21swapper/219:16:192
296463599109,1cyclictest1051-21snmpd00:23:261
296463599109,1cyclictest1045-21nmbd21:41:121
296463599109,1cyclictest0-21swapper/122:56:371
296463599108,2cyclictest3028420-21unixbench_singl22:00:191
296463599108,1cyclictest1051-21snmpd22:39:491
296463599108,1cyclictest1051-21snmpd22:24:031
296463599108,1cyclictest1051-21snmpd20:25:481
296463599108,1cyclictest1051-21snmpd20:06:031
296463599100,4cyclictest0-21swapper/121:35:441
296463599100,10cyclictest0-21swapper/123:33:391
296463599100,10cyclictest0-21swapper/122:44:541
296463599100,10cyclictest0-21swapper/121:07:141
296463599100,10cyclictest0-21swapper/120:31:191
296463599100,10cyclictest0-21swapper/119:59:531
296463599100,10cyclictest0-21swapper/100:15:461
296463399108,2cyclictest1051-21snmpd22:37:460
296463399105,1cyclictest0-21swapper/022:23:030
296463399100,10cyclictest0-21swapper/023:34:120
296463399100,10cyclictest0-21swapper/020:47:580
296463399100,10cyclictest0-21swapper/020:25:240
296463399100,10cyclictest0-21swapper/020:18:200
296463399100,10cyclictest0-21swapper/019:23:040
296463399100,10cyclictest0-21swapper/000:35:160
296463399100,10cyclictest0-21swapper/000:21:080
296463399100,10cyclictest0-21swapper/000:12:320
29646439996,3cyclictest0-21swapper/322:23:243
29646439996,2cyclictest1051-21snmpd23:27:483
29646439993,5cyclictest0-21swapper/321:00:143
29646439990,9cyclictest0-21swapper/323:48:153
29646389996,2cyclictest2971305-21/usr/sbin/munin19:25:162
29646389996,2cyclictest1051-21snmpd23:56:042
29646389990,2cyclictest3008805-21memory21:05:162
29646359998,1cyclictest1051-21snmpd19:33:311
29646359996,2cyclictest3031000-21unixbench_singl22:10:171
29646359996,2cyclictest1051-21snmpd19:39:501
29646359995,4cyclictest0-21swapper/122:32:251
29646359990,9cyclictest0-21swapper/123:36:321
29646359990,9cyclictest0-21swapper/123:15:151
29646359990,9cyclictest0-21swapper/120:22:021
29646339998,1cyclictest1051-21snmpd21:26:340
29646339998,1cyclictest1051-21snmpd20:39:120
29646439985,2cyclictest1051-21snmpd22:58:503
29646359987,1cyclictest1051-21snmpd20:11:021
29646359987,1cyclictest0-21swapper/123:46:181
29646359985,2cyclictest3069394-21grep00:10:101
29646359976,1cyclictest1550-21ntpd20:01:371
29646359974,2cyclictest3011346-21tail21:10:231
29646439963,2cyclictest1058-21runrttasks21:40:083
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional