You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-04-03 - 11:10

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack8slot6s.osadl.org (updated Thu Apr 03, 2025 00:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1762993636,0cyclictest15476-21fwupd21:14:042
1766991918,1cyclictest65850irq/126-lan23:48:523
1766991918,1cyclictest65850irq/126-lan22:54:243
1766991918,1cyclictest65850irq/126-lan21:55:113
1766991918,1cyclictest65850irq/126-lan21:40:223
1766991918,1cyclictest65850irq/126-lan21:24:563
1766991918,1cyclictest65850irq/126-lan21:10:173
1766991918,1cyclictest65850irq/126-lan21:05:153
1766991918,1cyclictest65850irq/126-lan00:20:143
1766991818,0cyclictest65850irq/126-lan23:57:393
1766991818,0cyclictest65850irq/126-lan23:30:033
1766991818,0cyclictest65850irq/126-lan22:44:563
1766991818,0cyclictest65850irq/126-lan22:32:073
1766991818,0cyclictest65850irq/126-lan22:13:033
1766991818,0cyclictest65850irq/126-lan21:37:543
1766991817,1cyclictest65850irq/126-lan23:15:113
1766991817,1cyclictest65850irq/126-lan21:46:303
1766991817,1cyclictest65850irq/126-lan21:28:223
1766991817,1cyclictest65850irq/126-lan20:25:193
1766991817,1cyclictest65850irq/126-lan00:05:403
1766991717,0cyclictest65850irq/126-lan23:25:043
1766991717,0cyclictest65850irq/126-lan22:27:053
1766991717,0cyclictest65850irq/126-lan22:16:593
1766991717,0cyclictest65850irq/126-lan00:38:393
1766991716,1cyclictest65850irq/126-lan23:42:283
1766991716,1cyclictest65850irq/126-lan23:35:303
1766991716,1cyclictest65850irq/126-lan23:21:363
1766991716,1cyclictest65850irq/126-lan23:10:113
1766991716,1cyclictest65850irq/126-lan23:08:273
1766991716,1cyclictest65850irq/126-lan23:00:143
1766991716,1cyclictest65850irq/126-lan22:55:163
1766991716,1cyclictest65850irq/126-lan22:47:453
1766991716,1cyclictest65850irq/126-lan22:38:243
1766991716,1cyclictest65850irq/126-lan19:30:153
1766991716,1cyclictest65850irq/126-lan00:32:143
1766991716,1cyclictest65850irq/126-lan00:29:563
1766991716,1cyclictest65850irq/126-lan00:14:163
1766991616,0cyclictest65850irq/126-lan22:06:263
1766991616,0cyclictest65850irq/126-lan19:55:093
1766991616,0cyclictest65850irq/126-lan19:35:163
1766991616,0cyclictest65850irq/126-lan00:01:283
1766991615,1cyclictest65850irq/126-lan23:50:143
1766991615,1cyclictest65850irq/126-lan22:21:203
1766991615,1cyclictest65850irq/126-lan21:30:123
1766991615,1cyclictest65850irq/126-lan21:15:123
1766991615,1cyclictest65850irq/126-lan20:40:203
1766991615,1cyclictest65850irq/126-lan19:45:163
1766991615,1cyclictest65850irq/126-lan00:15:173
1766991515,0cyclictest65850irq/126-lan22:00:213
1766991515,0cyclictest65850irq/126-lan21:03:353
1766991515,0cyclictest65850irq/126-lan19:50:193
1766991514,1cyclictest65850irq/126-lan21:50:123
1766991514,1cyclictest65850irq/126-lan19:10:163
1766991413,1cyclictest65850irq/126-lan20:15:163
1766991312,1cyclictest65850irq/126-lan20:20:123
1766991211,1cyclictest65850irq/126-lan20:55:143
1766991211,1cyclictest65850irq/126-lan19:15:223
1766991111,0cyclictest65850irq/126-lan20:45:263
1766991111,0cyclictest65850irq/126-lan20:35:183
1766991111,0cyclictest65850irq/126-lan20:34:053
1766991111,0cyclictest65850irq/126-lan20:05:163
1766991110,1cyclictest65850irq/126-lan19:21:453
175199109,1cyclictest506-21avahi-daemon00:18:460
17669999,0cyclictest65850irq/126-lan20:11:273
17669999,0cyclictest65850irq/126-lan20:02:033
17669998,1cyclictest65850irq/126-lan20:52:273
17669998,1cyclictest65850irq/126-lan19:45:003
17629998,1cyclictest765-21snmpd22:06:442
17629998,1cyclictest765-21snmpd21:03:482
17629998,1cyclictest763-21lldpd20:25:582
17629998,1cyclictest499-21systemd-resolve23:04:082
17629996,3cyclictest765-21snmpd21:37:282
17519998,1cyclictest765-21snmpd23:35:030
17519998,1cyclictest765-21snmpd22:29:500
17519998,1cyclictest765-21snmpd20:19:280
17519996,3cyclictest765-21snmpd23:10:430
17629988,0cyclictest765-21snmpd23:36:212
17629988,0cyclictest765-21snmpd22:59:362
17629988,0cyclictest765-21snmpd21:49:352
17629988,0cyclictest765-21snmpd20:33:202
17629988,0cyclictest765-21snmpd19:12:112
17629988,0cyclictest763-21lldpd23:46:542
17629988,0cyclictest763-21lldpd23:24:092
17629987,1cyclictest765-21snmpd21:30:282
17629987,1cyclictest765-21snmpd21:06:092
17629987,1cyclictest763-21lldpd20:24:252
17629987,1cyclictest506-21avahi-daemon23:16:262
17629987,1cyclictest506-21avahi-daemon22:42:062
17629987,1cyclictest506-21avahi-daemon00:25:112
17629986,2cyclictest765-21snmpd23:06:562
17629986,2cyclictest765-21snmpd20:17:042
17589988,0cyclictest765-21snmpd23:00:391
17589988,0cyclictest765-21snmpd20:31:591
17589988,0cyclictest763-21lldpd22:51:071
17589988,0cyclictest763-21lldpd22:35:001
17589988,0cyclictest763-21lldpd20:59:471
17589988,0cyclictest763-21lldpd20:07:171
17589987,1cyclictest763-21lldpd23:09:531
17589987,1cyclictest506-21avahi-daemon00:34:101
17519988,0cyclictest765-21snmpd23:15:340
17519988,0cyclictest765-21snmpd21:55:520
17519988,0cyclictest765-21snmpd21:41:370
17519988,0cyclictest765-21snmpd19:34:240
17519988,0cyclictest763-21lldpd23:34:440
17519988,0cyclictest763-21lldpd23:07:450
17519988,0cyclictest763-21lldpd22:40:350
17519988,0cyclictest763-21lldpd22:17:240
17519988,0cyclictest763-21lldpd20:27:080
17519988,0cyclictest763-21lldpd00:20:210
17519987,1cyclictest765-21snmpd22:58:240
17519987,1cyclictest763-21lldpd23:54:190
17519987,1cyclictest763-21lldpd19:35:270
17519986,2cyclictest765-21snmpd22:22:090
17519986,2cyclictest765-21snmpd20:07:580
17629977,0cyclictest765-21snmpd22:32:272
17629977,0cyclictest765-21snmpd21:16:572
17629977,0cyclictest765-21snmpd19:46:152
17629977,0cyclictest763-21lldpd20:12:482
17629977,0cyclictest763-21lldpd19:53:042
17629977,0cyclictest763-21lldpd19:32:202
17629977,0cyclictest763-21lldpd19:17:162
17629977,0cyclictest763-21lldpd00:03:092
17629976,1cyclictest763-21lldpd22:54:032
17629976,1cyclictest506-21avahi-daemon22:35:262
17629976,1cyclictest506-21avahi-daemon22:20:502
17629976,1cyclictest499-21systemd-resolve22:03:152
17629976,1cyclictest21609-21gltestperf20:05:152
17629975,2cyclictest765-21snmpd22:13:472
17629975,2cyclictest765-21snmpd21:26:522
17629975,2cyclictest765-21snmpd19:38:432
17629975,2cyclictest765-21snmpd00:37:502
17629975,2cyclictest765-21snmpd00:14:162
17629975,2cyclictest21585-21cat21:20:162
17629973,3cyclictest5938-21users20:50:232
17629973,3cyclictest254-20systemd-journal21:52:142
17589977,0cyclictest765-21snmpd23:32:141
17589977,0cyclictest765-21snmpd22:36:011
17589977,0cyclictest765-21snmpd21:41:251
17589977,0cyclictest765-21snmpd21:30:221
17589977,0cyclictest765-21snmpd21:04:331
17589977,0cyclictest765-21snmpd20:46:531
17589977,0cyclictest765-21snmpd20:29:511
17589977,0cyclictest765-21snmpd19:53:101
17589977,0cyclictest765-21snmpd19:41:521
17589977,0cyclictest765-21snmpd00:11:431
17589977,0cyclictest765-21snmpd00:04:361
17589977,0cyclictest763-21lldpd22:43:491
17589977,0cyclictest763-21lldpd22:24:021
17589977,0cyclictest763-21lldpd22:09:211
17589977,0cyclictest763-21lldpd21:06:201
17589977,0cyclictest763-21lldpd00:15:491
17589976,1cyclictest765-21snmpd19:32:271
17589976,1cyclictest765-21snmpd19:10:321
17589976,1cyclictest763-21lldpd22:15:561
17589976,1cyclictest506-21avahi-daemon20:11:151
17589976,1cyclictest32253-21cat20:35:141
17589975,2cyclictest765-21snmpd21:58:461
17589975,2cyclictest765-21snmpd21:49:051
17589975,2cyclictest765-21snmpd00:23:551
17589975,2cyclictest27221-21cat20:20:141
17589973,3cyclictest3260-21ssh23:26:431
17519977,0cyclictest765-21snmpd23:48:590
17519977,0cyclictest765-21snmpd23:02:480
17519977,0cyclictest765-21snmpd20:10:020
17519977,0cyclictest763-21lldpd21:20:420
17519976,1cyclictest765-21snmpd21:37:010
17519976,1cyclictest765-21snmpd00:13:100
17519976,1cyclictest763-21lldpd00:37:330
17519976,1cyclictest506-21avahi-daemon22:37:390
17519976,1cyclictest506-21avahi-daemon21:08:110
17519976,1cyclictest499-21systemd-resolve19:50:180
17519975,2cyclictest7871-21cat19:25:160
17519975,2cyclictest765-21snmpd23:21:320
17519975,2cyclictest765-21snmpd20:41:150
17519974,3cyclictest254-20systemd-journal00:06:070
17519973,3cyclictest7300-21ntp_states20:55:180
17519973,3cyclictest30236-21smartctl21:30:180
17519973,3cyclictest254-20systemd-journal21:29:450
17519973,3cyclictest21293-21ssh22:33:520
17519972,4cyclictest4161-21grep19:15:180
17629966,0cyclictest765-21snmpd20:35:202
17629966,0cyclictest763-21lldpd22:26:312
17629966,0cyclictest763-21lldpd21:44:482
17629966,0cyclictest499-21systemd-resolve20:47:192
17629965,1cyclictest506-21avahi-daemon23:55:432
17629965,1cyclictest0-21swapper/200:20:142
17629964,2cyclictest765-21snmpd19:28:362
17629963,3cyclictest530-21NetworkManager00:18:262
17629963,2cyclictest7056-21ssh22:17:112
17629963,2cyclictest26761-21ssh00:34:592
17629963,2cyclictest21606-21ssh21:56:592
17629962,3cyclictest7031-21sh23:30:282
17629962,3cyclictest6148-21ssh00:07:412
17629962,3cyclictest6044-21fw_forwarded_lo19:20:152
17589966,0cyclictest765-21snmpd23:16:191
17589966,0cyclictest765-21snmpd19:36:361
17589966,0cyclictest765-21snmpd00:25:041
17589966,0cyclictest763-21lldpd23:40:591
17589966,0cyclictest763-21lldpd19:46:231
17589966,0cyclictest551-21in:imuxsock19:19:391
17589965,1cyclictest765-21snmpd22:26:291
17589965,1cyclictest763-21lldpd23:22:471
17589965,1cyclictest506-21avahi-daemon22:13:021
17589965,1cyclictest506-21avahi-daemon00:06:011
17589965,1cyclictest28021-21cpuspeed_turbos23:55:131
17589965,1cyclictest21090-21gltestperf23:10:091
17589964,2cyclictest765-21snmpd21:51:581
17589964,2cyclictest765-21snmpd21:12:311
17589964,2cyclictest765-21snmpd20:03:431
17589964,1cyclictest765-21snmpd23:45:531
17589963,2cyclictest862-21ssh22:47:231
17589963,2cyclictest14452-21ssh23:39:401
17519966,0cyclictest765-21snmpd22:01:230
17519966,0cyclictest765-21snmpd00:32:280
17519966,0cyclictest506-21avahi-daemon19:22:450
17519965,1cyclictest506-21avahi-daemon21:19:080
17519965,1cyclictest20336-21ntp_offset20:00:160
17519964,2cyclictest765-21snmpd21:52:430
17519964,2cyclictest765-21snmpd21:10:270
17519964,2cyclictest765-21snmpd21:00:100
17519964,1cyclictest554-21rs:main0
17519963,2cyclictest554-21rs:main0
17519960,5cyclictest27498-21ntpq20:20:170
17669952,2cyclictest554-21rs:main3
17629955,0cyclictest763-21lldpd23:50:332
17629955,0cyclictest763-21lldpd22:45:462
17629955,0cyclictest499-21systemd-resolve19:44:142
17629953,2cyclictest765-21snmpd20:00:072
17629952,2cyclictest554-21rs:main2
17629952,2cyclictest22049-21ssh23:10:312
17629952,2cyclictest17226-21rm23:41:502
17629951,3cyclictest6842-21cut20:55:142
17629950,4cyclictest1716-21ntp_192.168.11420:40:172
17589955,0cyclictest765-21snmpd20:51:531
17589954,1cyclictest506-21avahi-daemon20:17:481
17589954,1cyclictest331ktimers/119:25:171
17589953,2cyclictest530-21NetworkManager21:26:111
17589953,2cyclictest23537-21fschecks_count23:50:091
17589953,2cyclictest18379-21cat19:55:131
17589952,2cyclictest6065-21grep19:20:151
17589952,2cyclictest554-21rs:main1
17589952,2cyclictest254-20systemd-journal00:36:031
17589952,2cyclictest17912-21ssh21:15:481
17589952,2cyclictest10579-21ssh22:57:191
17589951,3cyclictest23945-21ssh22:00:031
17519955,0cyclictest763-21lldpd21:46:360
17519955,0cyclictest763-21lldpd20:32:370
17519954,1cyclictest765-21snmpd20:54:350
17519953,2cyclictest739-21ntpd19:56:330
17519953,2cyclictest4477-21ssh22:50:500
17519952,3cyclictest739-21ntpd19:11:530
17519952,2cyclictest821-21ssh22:47:190
17519952,2cyclictest32719-21sh00:00:150
17519952,2cyclictest29323-21ssh22:06:100
17519952,2cyclictest20897-21rm00:26:430
17519951,4cyclictest530-21NetworkManager20:46:020
17519950,4cyclictest28626-21ntpq23:55:180
17519950,4cyclictest15278-21df_inode23:40:140
17519950,4cyclictest13166-21ntpq19:40:180
17629941,2cyclictest3626-21ssh23:27:172
17589942,2cyclictest1112-21cat20:40:131
17589941,2cyclictest21804-21ntpq21:20:181
17519940,3cyclictest32454-21ntpq20:35:160
17519940,3cyclictest14581-21apt-get19:45:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional