You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-04-02 - 03:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot6s.osadl.org (updated Wed Apr 02, 2025 00:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
18792992019,1cyclictest65850irq/126-lan22:15:173
18792991919,0cyclictest65850irq/126-lan23:22:283
18792991918,1cyclictest65850irq/126-lan22:54:163
18792991918,1cyclictest65850irq/126-lan22:40:163
18792991918,1cyclictest65850irq/126-lan22:23:553
18792991918,1cyclictest65850irq/126-lan22:10:133
18792991918,1cyclictest65850irq/126-lan22:10:123
18792991918,1cyclictest65850irq/126-lan21:35:103
18792991818,0cyclictest65850irq/126-lan23:39:453
18792991818,0cyclictest65850irq/126-lan23:30:103
18792991818,0cyclictest65850irq/126-lan21:42:413
18792991818,0cyclictest65850irq/126-lan19:33:213
18792991817,1cyclictest65850irq/126-lan22:46:253
18792991817,1cyclictest65850irq/126-lan22:30:133
18792991817,1cyclictest65850irq/126-lan21:50:123
18792991817,1cyclictest65850irq/126-lan21:29:393
18792991817,1cyclictest65850irq/126-lan20:56:213
18792991817,1cyclictest65850irq/126-lan00:32:373
18792991817,1cyclictest65850irq/126-lan00:26:573
18792991817,1cyclictest65850irq/126-lan00:00:143
18776991818,0cyclictest765-21snmpd23:02:450
18792991717,0cyclictest65850irq/126-lan23:26:443
18792991717,0cyclictest65850irq/126-lan23:16:053
18792991717,0cyclictest65850irq/126-lan22:57:203
18792991717,0cyclictest65850irq/126-lan22:28:473
18792991717,0cyclictest65850irq/126-lan22:06:303
18792991717,0cyclictest65850irq/126-lan21:46:423
18792991717,0cyclictest65850irq/126-lan21:24:533
18792991717,0cyclictest65850irq/126-lan00:16:213
18792991717,0cyclictest65850irq/126-lan00:13:423
18792991716,1cyclictest65850irq/126-lan23:55:153
18792991716,1cyclictest65850irq/126-lan23:50:103
18792991716,1cyclictest65850irq/126-lan23:45:033
18792991716,1cyclictest65850irq/126-lan23:13:043
18792991716,1cyclictest65850irq/126-lan22:37:143
18792991716,1cyclictest65850irq/126-lan21:55:143
18792991716,1cyclictest65850irq/126-lan21:34:443
18792991716,1cyclictest65850irq/126-lan21:18:153
18792991716,1cyclictest65850irq/126-lan21:05:183
18792991716,1cyclictest65850irq/126-lan20:49:173
18792991716,1cyclictest65850irq/126-lan19:20:183
18792991716,1cyclictest65850irq/126-lan00:37:333
18792991716,1cyclictest65850irq/126-lan00:20:163
18792991616,0cyclictest65850irq/126-lan20:30:123
18792991616,0cyclictest65850irq/126-lan19:40:003
18792991616,0cyclictest65850irq/126-lan19:15:123
18792991616,0cyclictest65850irq/126-lan00:05:063
18792991615,1cyclictest65850irq/126-lan23:42:183
18792991615,1cyclictest65850irq/126-lan23:07:243
18792991615,1cyclictest65850irq/126-lan22:01:083
18792991615,1cyclictest65850irq/126-lan21:13:343
18792991615,1cyclictest65850irq/126-lan20:40:183
18792991615,1cyclictest65850irq/126-lan20:00:193
18792991615,1cyclictest65850irq/126-lan19:55:153
18792991515,0cyclictest65850irq/126-lan23:00:033
18792991515,0cyclictest65850irq/126-lan21:00:133
18792991514,1cyclictest65850irq/126-lan20:15:193
18792991514,1cyclictest65850irq/126-lan19:45:143
18776991515,0cyclictest765-21snmpd23:05:350
18776991515,0cyclictest765-21snmpd19:50:520
18776991515,0cyclictest4760-21cat22:35:140
18792991414,0cyclictest65850irq/126-lan19:50:253
18792991413,1cyclictest65850irq/126-lan20:35:173
18776991414,0cyclictest765-21snmpd23:57:340
18776991414,0cyclictest765-21snmpd21:58:060
18776991414,0cyclictest765-21snmpd21:41:350
18776991414,0cyclictest765-21snmpd21:20:580
18776991414,0cyclictest765-21snmpd20:18:020
18776991414,0cyclictest765-21snmpd20:08:020
18776991414,0cyclictest765-21snmpd20:02:530
18776991414,0cyclictest765-21snmpd19:58:470
18776991414,0cyclictest765-21snmpd19:31:550
18776991414,0cyclictest765-21snmpd19:10:060
18776991414,0cyclictest765-21snmpd00:12:220
18776991414,0cyclictest27820-21cat19:35:150
18792991313,0cyclictest65850irq/126-lan20:20:213
18792991313,0cyclictest65850irq/126-lan19:25:193
18792991312,1cyclictest65850irq/126-lan19:40:183
18792991312,1cyclictest65850irq/126-lan19:10:213
18776991313,0cyclictest765-21snmpd23:51:280
18776991313,0cyclictest765-21snmpd23:19:490
18776991313,0cyclictest765-21snmpd22:31:130
18776991313,0cyclictest765-21snmpd22:26:520
18776991313,0cyclictest765-21snmpd22:22:450
18776991313,0cyclictest765-21snmpd21:30:380
18776991313,0cyclictest765-21snmpd21:08:490
18776991313,0cyclictest765-21snmpd20:32:270
18776991313,0cyclictest765-21snmpd19:25:180
18776991313,0cyclictest765-21snmpd00:31:470
18776991313,0cyclictest739-21ntpd22:51:120
18776991313,0cyclictest739-21ntpd00:15:000
18776991313,0cyclictest19322-21cat22:15:140
18792991211,1cyclictest65850irq/126-lan20:50:193
18776991212,0cyclictest765-21snmpd19:48:340
18776991212,0cyclictest739-21ntpd22:10:080
18776991212,0cyclictest739-21ntpd22:10:080
18792991111,0cyclictest65850irq/126-lan20:12:003
1878499109,1cyclictest506-21avahi-daemon00:00:181
187929998,1cyclictest65850irq/126-lan20:27:213
187899998,1cyclictest765-21snmpd22:54:502
187899998,1cyclictest765-21snmpd22:08:152
187899998,1cyclictest765-21snmpd20:52:482
187899998,1cyclictest765-21snmpd20:48:542
187899998,1cyclictest765-21snmpd20:27:452
187899998,1cyclictest763-21lldpd20:32:272
187899996,3cyclictest765-21snmpd19:35:102
187769999,0cyclictest765-21snmpd21:10:040
187769998,1cyclictest765-21snmpd22:00:480
187899988,0cyclictest765-21snmpd22:40:102
187899988,0cyclictest765-21snmpd21:31:052
187899988,0cyclictest765-21snmpd21:01:312
187899988,0cyclictest765-21snmpd19:24:452
187899988,0cyclictest765-21snmpd00:32:002
187899988,0cyclictest765-21snmpd00:17:542
187899988,0cyclictest763-21lldpd21:12:442
187899987,1cyclictest765-21snmpd23:28:092
187899987,1cyclictest765-21snmpd19:26:212
187899987,1cyclictest506-21avahi-daemon23:22:412
187899987,1cyclictest506-21avahi-daemon22:58:532
187899986,2cyclictest765-21snmpd23:08:172
187899985,3cyclictest7835-21cat20:15:162
187849988,0cyclictest765-21snmpd23:44:481
187849988,0cyclictest765-21snmpd22:47:311
187849988,0cyclictest765-21snmpd21:13:101
187849988,0cyclictest763-21lldpd23:03:331
187849988,0cyclictest763-21lldpd21:49:271
187849988,0cyclictest763-21lldpd20:44:131
187849987,1cyclictest765-21snmpd21:52:481
187849987,1cyclictest763-21lldpd23:07:141
187849987,1cyclictest763-21lldpd19:24:181
187849987,1cyclictest506-21avahi-daemon22:40:501
187849987,1cyclictest506-21avahi-daemon21:35:471
187849987,1cyclictest506-21avahi-daemon21:19:441
187849986,2cyclictest765-21snmpd22:20:571
187849986,2cyclictest765-21snmpd21:05:071
187849986,2cyclictest765-21snmpd20:11:081
187769988,0cyclictest763-21lldpd21:39:500
187769988,0cyclictest763-21lldpd20:51:340
187769988,0cyclictest763-21lldpd20:23:350
187769988,0cyclictest763-21lldpd20:10:070
187769987,1cyclictest765-21snmpd21:18:100
187769987,1cyclictest254-20systemd-journal22:46:590
187929976,1cyclictest765-21snmpd20:06:173
187899977,0cyclictest765-21snmpd23:42:182
187899977,0cyclictest765-21snmpd23:30:252
187899977,0cyclictest765-21snmpd21:37:592
187899977,0cyclictest765-21snmpd19:12:572
187899977,0cyclictest765-21snmpd00:03:292
187899977,0cyclictest763-21lldpd21:40:462
187899977,0cyclictest763-21lldpd21:25:182
187899977,0cyclictest763-21lldpd19:50:212
187899977,0cyclictest763-21lldpd00:24:352
187899976,1cyclictest765-21snmpd22:38:012
187899976,1cyclictest765-21snmpd22:26:252
187899976,1cyclictest765-21snmpd22:15:092
187899976,1cyclictest765-21snmpd20:22:022
187899976,1cyclictest763-21lldpd19:56:252
187899976,1cyclictest5891-21cpuspeed_turbos22:00:112
187899976,1cyclictest506-21avahi-daemon23:36:372
187899976,1cyclictest506-21avahi-daemon00:06:322
187899976,1cyclictest499-21systemd-resolve21:21:092
187899976,1cyclictest27033-21cut00:14:592
187899975,2cyclictest765-21snmpd19:41:492
187899973,3cyclictest4720-21ssh23:48:142
187899973,3cyclictest11830-21ntp_states23:55:182
187849977,0cyclictest765-21snmpd23:10:081
187849977,0cyclictest765-21snmpd20:59:221
187849977,0cyclictest765-21snmpd20:32:121
187849977,0cyclictest765-21snmpd19:49:041
187849977,0cyclictest765-21snmpd19:36:011
187849977,0cyclictest763-21lldpd23:54:501
187849977,0cyclictest763-21lldpd23:30:251
187849977,0cyclictest763-21lldpd21:31:551
187849977,0cyclictest763-21lldpd19:40:481
187849977,0cyclictest763-21lldpd00:18:031
187849977,0cyclictest506-21avahi-daemon00:11:441
187849976,1cyclictest765-21snmpd21:58:181
187849976,1cyclictest763-21lldpd22:06:451
187849976,1cyclictest763-21lldpd20:18:551
187849975,2cyclictest765-21snmpd19:14:391
187849975,2cyclictest765-21snmpd00:23:381
187849973,3cyclictest16856-21ssh22:12:341
187849973,3cyclictest16856-21ssh22:12:341
187769977,0cyclictest765-21snmpd23:29:150
187769977,0cyclictest763-21lldpd23:43:560
187769977,0cyclictest763-21lldpd23:11:120
187769977,0cyclictest763-21lldpd00:35:320
187769977,0cyclictest763-21lldpd00:23:540
187769977,0cyclictest763-21lldpd00:06:010
187769976,1cyclictest551-21in:imuxsock21:04:060
187769976,1cyclictest506-21avahi-daemon23:32:500
187769976,1cyclictest506-21avahi-daemon23:22:350
187769976,1cyclictest499-21systemd-resolve20:49:250
187769975,2cyclictest765-21snmpd23:39:570
187899966,0cyclictest765-21snmpd23:13:262
187899966,0cyclictest763-21lldpd20:10:512
187899966,0cyclictest763-21lldpd19:18:442
187899966,0cyclictest499-21systemd-resolve21:46:162
187899965,1cyclictest765-21snmpd22:14:282
187899965,1cyclictest765-21snmpd22:14:272
187899965,1cyclictest765-21snmpd20:58:342
187899965,1cyclictest499-21systemd-resolve23:00:212
187899964,2cyclictest765-21snmpd20:39:182
187899964,2cyclictest765-21snmpd19:30:092
187899963,3cyclictest693-21ssh22:30:182
187899963,2cyclictest254-20systemd-journal22:22:082
187899963,2cyclictest16040-21ssh22:48:042
187899962,3cyclictest10322-21ssh23:54:342
187899960,5cyclictest5653-21ssh00:28:112
187849966,0cyclictest31647-21cron22:30:001
187849965,1cyclictest9184-21cpuspeed_turbos20:20:131
187849965,1cyclictest506-21avahi-daemon22:18:241
187849965,1cyclictest506-21avahi-daemon20:35:001
187849965,1cyclictest254-20systemd-journal00:31:301
187849964,2cyclictest11387-21cat00:35:161
187849963,3cyclictest530-21NetworkManager22:53:201
187849963,2cyclictest254-20systemd-journal23:56:251
187849963,2cyclictest254-20systemd-journal00:09:081
187849962,3cyclictest9181-21ssh21:27:401
187849962,3cyclictest7827-21ls23:15:141
187849962,3cyclictest5824-21ssh22:35:541
187849962,3cyclictest3312-21ssh23:46:081
187849962,3cyclictest19091-21memory20:50:221
187769966,0cyclictest765-21snmpd19:15:090
187769965,1cyclictest765-21snmpd20:29:450
187769964,2cyclictest765-21snmpd22:55:230
187769962,3cyclictest9540-21needreboot22:40:150
187769961,5cyclictest530-21NetworkManager19:43:330
187769961,5cyclictest530-21NetworkManager19:20:490
187899953,2cyclictest765-21snmpd20:05:262
187899952,3cyclictest530-21NetworkManager23:17:572
187899952,3cyclictest530-21NetworkManager21:17:292
187899952,2cyclictest4587-21ssh21:58:452
187899952,2cyclictest30410-21ssh21:50:552
187899952,2cyclictest254-20systemd-journal19:45:062
187899952,2cyclictest25006-21grep21:05:202
187899950,4cyclictest4129-21ntpq20:00:182
187899950,2cyclictest1358950ssh00:38:572
187849955,0cyclictest765-21snmpd23:21:331
187849955,0cyclictest765-21snmpd21:40:081
187849955,0cyclictest506-21avahi-daemon20:29:501
187849954,1cyclictest16975-21cpuspeed_turbos20:45:131
187849954,1cyclictest0-21swapper/119:15:181
187849953,2cyclictest32600-21tr19:50:191
187849952,2cyclictest4414-21ssh00:26:061
187849952,2cyclictest32459-21kernelversion22:30:111
187849952,2cyclictest254-20systemd-journal23:35:031
187849951,3cyclictest3781-21sensors_temp21:20:201
187849951,3cyclictest24331-21fw_forwarded_lo19:25:141
187849950,4cyclictest6522-21ntpq22:00:151
187849950,4cyclictest23102-21ntpq22:55:171
187769955,0cyclictest28897-21ssh21:50:070
187769955,0cyclictest24129-21kworker/0:2+events21:45:590
187769953,2cyclictest0-21swapper/023:45:210
187769952,2cyclictest8733-21ssh21:27:000
187769952,2cyclictest6577-21ssh00:29:390
187769952,2cyclictest14090-21unixbench_singl20:35:190
187769952,2cyclictest12222-21sh22:07:420
187769951,3cyclictest17065-21ssh00:00:420
187769950,4cyclictest15507-21ntpq20:40:180
187899943,1cyclictest0-21swapper/220:40:132
187849943,1cyclictest25722-21apt-get19:30:151
187849941,3cyclictest530-21NetworkManager20:05:581
187849941,2cyclictest3480-21cpuspeed_turbos20:00:141
187849941,2cyclictest17124-21ssh23:25:061
187849940,3cyclictest2458-21ntp_states19:55:181
187849940,3cyclictest22678-21fw_forwarded_lo21:00:141
187769941,3cyclictest530-21NetworkManager20:56:110
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional