You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-04-03 - 11:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #0, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack0slot7s.osadl.org (updated Thu Apr 03, 2025 00:43:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3432112212271,19sleep20-21swapper/219:07:382
3430550212071,21sleep00-21swapper/019:05:030
3432121211972,21sleep10-21swapper/119:07:451
3432061210374,21sleep30-21swapper/319:06:593
343242099260,25cyclictest0-21swapper/019:10:590
343242099250,24cyclictest0-21swapper/021:38:230
343242099240,24cyclictest0-21swapper/022:42:150
343242099240,15cyclictest0-21swapper/022:48:310
343242099230,15cyclictest0-21swapper/021:14:550
3432425992112,9cyclictest0-21swapper/222:55:162
343242099213,17cyclictest0-21swapper/022:22:450
343242599190,19cyclictest0-21swapper/219:32:582
3432420991912,7cyclictest0-21swapper/000:19:570
343242099190,1cyclictest0-21swapper/021:34:160
343242099190,19cyclictest0-21swapper/023:52:300
343242099188,10cyclictest0-21swapper/000:30:370
343242099187,1cyclictest0-21swapper/021:47:470
343242099180,17cyclictest0-21swapper/023:12:250
343242099180,17cyclictest0-21swapper/023:12:250
343242099180,17cyclictest0-21swapper/019:44:190
3432429991715,1cyclictest1051-21snmpd20:02:463
3432429991715,1cyclictest1051-21snmpd00:22:063
3432425991715,1cyclictest1051-21snmpd19:45:292
3432423991715,1cyclictest1051-21snmpd19:52:221
343242099174,13cyclictest0-21swapper/020:03:080
3432420991716,1cyclictest0-21swapper/022:31:480
343242099170,17cyclictest0-21swapper/023:38:140
343242099170,17cyclictest0-21swapper/019:57:340
343242099170,16cyclictest0-21swapper/021:05:170
3432425991613,2cyclictest1051-21snmpd21:49:022
3432425991613,2cyclictest1051-21snmpd00:32:162
3432425991612,4cyclictest0-21swapper/221:21:222
343242599160,7cyclictest0-21swapper/220:17:172
343242099160,7cyclictest0-21swapper/000:03:120
343242099160,16cyclictest0-21swapper/022:13:020
343242099160,16cyclictest0-21swapper/021:01:060
343242599155,9cyclictest0-21swapper/223:09:432
343242599150,7cyclictest0-21swapper/223:01:552
343242599150,6cyclictest0-21swapper/223:21:052
343242599150,6cyclictest0-21swapper/220:52:432
343242099155,10cyclictest0-21swapper/020:47:120
3432420991514,1cyclictest0-21swapper/020:15:170
3432420991511,4cyclictest0-21swapper/023:49:390
343242099150,6cyclictest0-21swapper/020:27:390
3432429991412,1cyclictest1051-21snmpd19:10:323
3432429991412,1cyclictest0-21swapper/300:26:463
3432425991410,4cyclictest0-21swapper/220:06:382
343242599140,6cyclictest0-21swapper/219:29:062
343242099145,9cyclictest0-21swapper/020:09:530
343242099144,10cyclictest0-21swapper/021:17:430
3432420991413,1cyclictest1051-21snmpd19:39:460
3432420991412,1cyclictest0-21swapper/021:29:550
3432420991410,4cyclictest0-21swapper/020:14:350
343242099140,5cyclictest0-21swapper/020:55:390
343242099140,13cyclictest0-21swapper/022:00:200
343242099140,13cyclictest0-21swapper/019:50:150
3432429991310,2cyclictest1550-21ntpd23:16:373
343242599134,9cyclictest0-21swapper/220:42:092
3432425991312,1cyclictest0-21swapper/221:10:222
3432425991312,1cyclictest0-21swapper/220:20:132
3432425991311,2cyclictest1051-21snmpd21:39:352
3432425991310,2cyclictest1051-21snmpd22:06:202
343242599130,7cyclictest0-21swapper/223:49:152
343242599130,4cyclictest0-21swapper/223:53:432
343242099138,5cyclictest0-21swapper/020:37:360
3432420991312,1cyclictest767-21dbus-daemon23:59:590
3432420991312,1cyclictest0-21swapper/021:52:530
3432420991310,2cyclictest1051-21snmpd20:42:280
3432420991310,1cyclictest0-21swapper/022:35:510
343242999129,2cyclictest1051-21snmpd21:49:533
343242999129,2cyclictest1051-21snmpd21:27:073
343242999129,2cyclictest1051-21snmpd21:10:373
343242999129,2cyclictest1051-21snmpd20:08:233
343242999123,9cyclictest0-21swapper/320:25:143
343242999123,9cyclictest0-21swapper/319:33:133
3432429991211,1cyclictest0-21swapper/321:36:323
3432429991210,1cyclictest1051-21snmpd21:19:263
343242599129,2cyclictest1051-21snmpd22:20:152
343242599129,2cyclictest1051-21snmpd00:39:212
3432425991210,2cyclictest1051-21snmpd22:41:162
3432425991210,1cyclictest1051-21snmpd19:36:182
3432425991210,1cyclictest1051-21snmpd00:12:212
343242399129,2cyclictest3481169-21awk21:10:171
343242399129,2cyclictest1051-21snmpd23:57:471
343242399129,2cyclictest1051-21snmpd23:32:531
343242399129,2cyclictest1051-21snmpd23:07:181
343242399129,2cyclictest1051-21snmpd21:21:311
343242399129,2cyclictest1051-21snmpd20:08:291
3432423991211,1cyclictest0-21swapper/120:02:471
3432423991211,1cyclictest0-21swapper/100:22:061
3432423991210,1cyclictest1051-21snmpd22:18:241
3432423991210,1cyclictest1051-21snmpd20:12:091
343242099129,2cyclictest3548744-21needreboot00:35:170
343242099129,2cyclictest1051-21snmpd22:05:140
343242099129,2cyclictest1051-21snmpd21:55:080
343242099128,4cyclictest0-21swapper/021:40:380
343242099128,4cyclictest0-21swapper/019:31:190
3432420991210,1cyclictest1051-21snmpd23:04:280
3432420991210,1cyclictest0-21swapper/023:25:560
343242999119,2cyclictest1045-21nmbd20:56:033
343242999119,1cyclictest1550-21ntpd20:51:373
343242999119,1cyclictest1550-21ntpd19:21:373
343242999119,1cyclictest1051-21snmpd23:04:253
343242999119,1cyclictest1051-21snmpd22:50:583
343242999119,1cyclictest1051-21snmpd22:31:303
343242999119,1cyclictest1051-21snmpd22:29:333
343242999119,1cyclictest1051-21snmpd20:17:143
343242999119,1cyclictest1051-21snmpd19:28:153
343242999119,1cyclictest1051-21snmpd00:11:573
343242999118,2cyclictest3447085-21cpuspeed_turbos19:45:133
343242999118,2cyclictest1051-21snmpd22:37:183
343242999118,2cyclictest1051-21snmpd22:20:333
343242999118,2cyclictest1051-21snmpd21:58:113
343242999118,2cyclictest1051-21snmpd20:39:373
343242999118,2cyclictest1051-21snmpd00:07:563
343242999112,9cyclictest0-21swapper/320:11:383
3432429991110,1cyclictest1045-21nmbd23:43:433
3432429991110,1cyclictest0-21swapper/321:53:083
3432429991110,1cyclictest0-21swapper/319:40:563
343242599119,2cyclictest1051-21snmpd20:36:132
343242599119,2cyclictest1051-21snmpd19:20:542
343242599119,1cyclictest1051-21snmpd23:57:122
343242599119,1cyclictest1051-21snmpd21:29:432
343242599118,2cyclictest3491162-21cpuspeed_turbos21:40:132
343242599118,2cyclictest3434396-21latency_hist19:14:592
343242599117,4cyclictest0-21swapper/222:19:122
343242599117,1cyclictest0-21swapper/200:27:072
343242599116,5cyclictest0-21swapper/220:30:022
343242599111,10cyclictest0-21swapper/200:01:482
3432425991110,1cyclictest1051-21snmpd23:43:202
3432425991110,1cyclictest1051-21snmpd20:03:072
3432425991110,1cyclictest1051-21snmpd00:15:072
343242599110,10cyclictest0-21swapper/223:25:372
343242599110,10cyclictest0-21swapper/222:45:432
343242599110,10cyclictest0-21swapper/219:40:072
343242399119,2cyclictest3463396-21awk20:25:151
343242399119,2cyclictest1051-21snmpd21:53:171
343242399119,2cyclictest1051-21snmpd19:32:191
343242399119,1cyclictest1051-21snmpd22:27:391
343242399119,1cyclictest1051-21snmpd00:26:521
343242399119,1cyclictest1051-21snmpd00:15:521
343242399119,1cyclictest1051-21snmpd00:05:211
343242399118,2cyclictest3524089-21fschecks_count23:20:131
343242399118,2cyclictest3504932-21needreboot22:20:191
343242399118,2cyclictest1045-21nmbd19:41:131
343242099119,2cyclictest1051-21snmpd23:21:320
343242099119,2cyclictest1051-21snmpd22:55:490
343242099119,1cyclictest1051-21snmpd19:15:510
343242099119,1cyclictest1051-21snmpd00:06:120
343242099118,2cyclictest3522534-21missed_timers23:15:120
343242099118,2cyclictest1051-21snmpd20:22:350
343242099118,2cyclictest1051-21snmpd19:46:200
343242099117,4cyclictest0-21swapper/023:34:320
3432420991110,1cyclictest0-21swapper/022:53:070
343242099110,1cyclictest0-21swapper/019:27:360
343242099110,11cyclictest0-21swapper/022:15:540
343242099110,10cyclictest0-21swapper/022:26:000
343242099110,10cyclictest0-21swapper/019:21:550
343242999109,1cyclictest3469296-21awk20:40:153
343242999109,1cyclictest1051-21snmpd23:39:143
343242999109,1cyclictest0-21swapper/322:42:253
343242999108,1cyclictest1051-21snmpd23:46:513
343242999108,1cyclictest1051-21snmpd23:30:143
343242999108,1cyclictest1051-21snmpd23:07:343
343242999108,1cyclictest1051-21snmpd22:03:593
343242999108,1cyclictest1051-21snmpd21:40:233
343242999108,1cyclictest1051-21snmpd21:07:283
343242999108,1cyclictest1051-21snmpd20:33:213
343242999108,1cyclictest1045-21nmbd21:22:233
343242599109,1cyclictest1051-21snmpd22:36:512
343242599109,1cyclictest1051-21snmpd21:18:072
343242599109,1cyclictest1045-21nmbd19:51:222
343242599109,1cyclictest0-21swapper/222:12:422
343242599108,2cyclictest1051-21snmpd19:59:412
343242599108,2cyclictest1051-21snmpd00:20:002
343242599105,1cyclictest0-21swapper/222:30:242
343242599100,9cyclictest0-21swapper/223:10:042
343242599100,9cyclictest0-21swapper/223:10:042
343242599100,10cyclictest0-21swapper/223:37:142
343242599100,10cyclictest0-21swapper/221:05:152
343242599100,10cyclictest0-21swapper/219:18:042
343242399109,1cyclictest767-21dbus-daemon19:20:001
343242399109,1cyclictest1051-21snmpd23:39:591
343242399109,1cyclictest1051-21snmpd23:01:101
343242399109,1cyclictest1051-21snmpd22:56:131
343242399109,1cyclictest1051-21snmpd21:32:491
343242399109,1cyclictest1051-21snmpd00:30:311
343242399108,1cyclictest1051-21snmpd23:50:181
343242399108,1cyclictest1051-21snmpd23:19:531
343242399108,1cyclictest1051-21snmpd21:45:061
343242399108,1cyclictest1051-21snmpd20:35:391
343242399108,1cyclictest1051-21snmpd20:17:561
343242399107,2cyclictest1051-21snmpd22:05:051
343242099108,2cyclictest3505903-21kworker/0:2+kacpid00:12:170
343242099107,2cyclictest3544689-21unixbench_multi00:20:210
343242099107,2cyclictest1051-21snmpd23:41:080
343242099104,5cyclictest3465142-21sort20:30:160
343242099100,10cyclictest0-21swapper/021:23:080
343242099100,10cyclictest0-21swapper/020:50:390
343242099100,10cyclictest0-21swapper/000:29:040
34324299998,1cyclictest0-21swapper/323:22:053
34324299998,1cyclictest0-21swapper/319:15:283
34324299997,1cyclictest1051-21snmpd23:14:083
34324299997,1cyclictest1051-21snmpd23:14:073
34324299996,2cyclictest3449910-21pmu-power19:50:213
34324299996,2cyclictest1051-21snmpd20:49:483
34324299996,2cyclictest1051-21snmpd20:21:003
34324299996,2cyclictest1051-21snmpd19:59:053
34324299990,9cyclictest0-21swapper/300:30:303
34324299990,9cyclictest0-21swapper/300:15:523
34324259998,1cyclictest1051-21snmpd20:45:332
34324259997,2cyclictest1051-21snmpd23:31:232
34324259990,9cyclictest0-21swapper/221:00:302
34324259990,8cyclictest3487782-21latency21:30:152
34324259990,8cyclictest0-21swapper/220:55:172
34324239998,1cyclictest3541176-21munin-run00:15:001
34324239998,1cyclictest1051-21snmpd19:49:051
34324239997,2cyclictest3473087-21fschecks_time20:50:181
34324239997,2cyclictest1051-21snmpd22:02:471
34324239997,2cyclictest1051-21snmpd21:08:111
34324239997,1cyclictest1051-21snmpd20:48:481
34324239996,2cyclictest1051-21snmpd22:38:481
34324239996,2cyclictest1051-21snmpd22:31:061
34324239996,2cyclictest1051-21snmpd19:10:141
34324239995,3cyclictest3470167-21sshd-session20:41:271
34324209996,2cyclictest1051-21snmpd23:05:040
34324299986,1cyclictest1051-21snmpd23:53:473
34324299986,1cyclictest1051-21snmpd22:10:243
34324299986,1cyclictest1045-21nmbd23:25:323
34324299985,2cyclictest1051-21snmpd23:55:423
34324259987,1cyclictest1051-21snmpd22:04:352
34324259987,1cyclictest1051-21snmpd00:05:172
34324259985,2cyclictest1051-21snmpd20:11:032
34324239987,1cyclictest3482855-21df_abs21:15:121
34324239987,1cyclictest3475235-21if_p4p120:55:141
34324239987,1cyclictest1-21systemd19:59:581
34324239987,1cyclictest1051-21snmpd21:36:321
34324239986,2cyclictest3492348-21unixbench_multi21:40:231
34324239986,2cyclictest1051-21snmpd19:24:251
34324239986,1cyclictest1051-21snmpd23:46:181
34324239986,1cyclictest1051-21snmpd22:42:341
34324239984,3cyclictest3501055-21awk22:10:121
34324239980,7cyclictest3549772-21sed00:39:581
34324299976,1cyclictest1051-21snmpd22:18:093
34324299976,1cyclictest0-21swapper/322:49:553
34324299976,1cyclictest0-21swapper/322:07:453
34324299975,1cyclictest1051-21snmpd00:04:153
34324299974,2cyclictest1051-21snmpd21:30:463
34324299974,2cyclictest1051-21snmpd00:36:223
34324299973,4cyclictest3516110-21ntpq22:55:163
34324299973,3cyclictest3476747-21expr21:00:113
34324259975,2cyclictest1051-21snmpd20:25:532
34324259970,7cyclictest3513257-21/usr/sbin/munin22:50:122
34324259970,7cyclictest0-21swapper/223:15:162
34324259970,1cyclictest3493641-21/usr/sbin/munin21:50:092
34324239976,1cyclictest3461267-21fschecks_time20:20:131
34324239976,1cyclictest1051-21snmpd23:29:111
34324239975,1cyclictest35135062sleep122:50:091
34324239975,1cyclictest1051-21snmpd20:30:441
34324239975,1cyclictest1045-21nmbd21:26:231
34324239974,2cyclictest1045-21nmbd23:11:331
34324239974,2cyclictest1045-21nmbd23:11:331
34324239974,2cyclictest1045-21nmbd19:29:121
34324239973,3cyclictest3530901-21interrupts23:40:141
34324299963,2cyclictest1051-21snmpd19:38:063
34324259965,1cyclictest0-21swapper/222:25:162
34324259965,1cyclictest0-21swapper/221:55:102
34324239964,1cyclictest0-21swapper/121:00:181
34324239964,1cyclictest0-21swapper/100:00:191
34324239963,3cyclictest3496725-21cat21:55:191
34324239963,2cyclictest3443627-21awk19:35:151
34324239953,1cyclictest1051-21snmpd22:47:551
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional