You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-04-11 - 22:30

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack8slot6s.osadl.org (updated Fri Apr 11, 2025 12:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
16892991918,1cyclictest65850irq/126-lan12:20:162
16892991918,1cyclictest65850irq/126-lan11:55:202
16892991918,1cyclictest65850irq/126-lan10:15:182
16892991918,1cyclictest65850irq/126-lan09:32:032
16892991918,1cyclictest65850irq/126-lan09:17:042
16892991918,1cyclictest65850irq/126-lan09:13:182
16892991818,0cyclictest65850irq/126-lan11:27:272
16892991818,0cyclictest65850irq/126-lan11:21:372
16892991818,0cyclictest65850irq/126-lan10:56:372
16892991818,0cyclictest65850irq/126-lan10:44:482
16892991817,1cyclictest65850irq/126-lan12:36:302
16892991817,1cyclictest65850irq/126-lan12:30:152
16892991817,1cyclictest65850irq/126-lan12:15:432
16892991817,1cyclictest65850irq/126-lan12:10:422
16892991817,1cyclictest65850irq/126-lan11:50:152
16892991817,1cyclictest65850irq/126-lan11:50:142
16892991817,1cyclictest65850irq/126-lan11:41:572
16892991817,1cyclictest65850irq/126-lan11:36:192
16892991817,1cyclictest65850irq/126-lan11:16:222
16892991817,1cyclictest65850irq/126-lan10:50:592
16892991817,1cyclictest65850irq/126-lan10:48:232
16892991817,1cyclictest65850irq/126-lan10:35:172
16892991817,1cyclictest65850irq/126-lan10:26:162
16892991817,1cyclictest65850irq/126-lan09:28:042
16892991817,1cyclictest65850irq/126-lan07:20:132
16892991817,1cyclictest65850irq/126-lan07:10:152
16892991717,0cyclictest65850irq/126-lan11:45:062
16892991717,0cyclictest65850irq/126-lan11:03:182
16892991717,0cyclictest65850irq/126-lan10:12:282
16892991717,0cyclictest65850irq/126-lan09:05:182
16892991717,0cyclictest65850irq/126-lan09:00:162
16892991716,1cyclictest65850irq/126-lan12:07:192
16892991716,1cyclictest65850irq/126-lan11:30:182
16892991716,1cyclictest65850irq/126-lan10:34:502
16892991716,1cyclictest65850irq/126-lan10:22:182
16892991716,1cyclictest65850irq/126-lan10:02:222
16892991716,1cyclictest65850irq/126-lan09:55:142
16892991716,1cyclictest65850irq/126-lan09:50:092
16892991716,1cyclictest65850irq/126-lan09:39:172
16892991716,1cyclictest65850irq/126-lan08:40:132
16892991616,0cyclictest65850irq/126-lan12:01:292
16892991616,0cyclictest65850irq/126-lan09:47:302
16892991616,0cyclictest65850irq/126-lan08:30:162
16892991616,0cyclictest65850irq/126-lan08:00:172
16892991616,0cyclictest65850irq/126-lan07:35:592
16892991615,1cyclictest65850irq/126-lan12:27:492
16892991615,1cyclictest65850irq/126-lan11:14:452
16892991615,1cyclictest65850irq/126-lan09:40:002
16892991615,1cyclictest65850irq/126-lan09:20:402
16892991615,1cyclictest65850irq/126-lan08:35:152
16892991615,1cyclictest65850irq/126-lan08:10:172
16892991615,1cyclictest65850irq/126-lan07:57:072
16892991615,1cyclictest65850irq/126-lan07:30:162
16892991615,1cyclictest65850irq/126-lan07:28:392
16892991515,0cyclictest65850irq/126-lan08:55:102
16892991515,0cyclictest65850irq/126-lan08:20:142
16892991514,1cyclictest65850irq/126-lan11:05:592
16892991514,1cyclictest65850irq/126-lan08:05:102
16892991514,1cyclictest65850irq/126-lan07:40:182
16892991414,0cyclictest65850irq/126-lan08:45:212
16892991413,1cyclictest65850irq/126-lan10:05:222
16892991413,1cyclictest65850irq/126-lan08:15:132
16892991312,1cyclictest65850irq/126-lan08:25:122
16884991311,2cyclictest2685-21cat11:30:170
16892991211,1cyclictest65850irq/126-lan07:15:182
16892991111,0cyclictest65850irq/126-lan08:50:172
16892991010,0cyclictest65850irq/126-lan07:50:392
16892991010,0cyclictest65850irq/126-lan07:48:562
168979998,1cyclictest765-21snmpd08:07:373
168979998,1cyclictest763-21lldpd07:48:063
168879998,1cyclictest8051-21idleruntime-cro08:20:001
168879998,1cyclictest765-21snmpd11:11:451
168879998,1cyclictest765-21snmpd09:44:151
168879998,1cyclictest765-21snmpd09:05:011
168879998,1cyclictest763-21lldpd09:48:271
168849998,1cyclictest499-21systemd-resolve11:46:130
168979988,0cyclictest765-21snmpd11:58:373
168979988,0cyclictest765-21snmpd10:51:263
168979988,0cyclictest765-21snmpd10:44:113
168979988,0cyclictest763-21lldpd12:02:133
168979988,0cyclictest763-21lldpd11:00:023
168979988,0cyclictest763-21lldpd10:59:213
168979988,0cyclictest763-21lldpd08:00:103
168979987,1cyclictest765-21snmpd07:15:183
168979987,1cyclictest29836-21ntp_offset12:30:113
168979987,1cyclictest254-20systemd-journal11:16:293
168979986,2cyclictest765-21snmpd12:21:173
168979986,2cyclictest765-21snmpd09:35:563
168979986,2cyclictest765-21snmpd09:29:253
168979986,2cyclictest765-21snmpd08:40:173
168979986,2cyclictest765-21snmpd07:23:363
168879988,0cyclictest765-21snmpd09:17:191
168879988,0cyclictest763-21lldpd12:31:461
168879988,0cyclictest763-21lldpd11:05:121
168879988,0cyclictest763-21lldpd10:10:081
168879988,0cyclictest763-21lldpd07:28:371
168879987,1cyclictest765-21snmpd07:37:331
168879987,1cyclictest763-21lldpd10:19:191
168879987,1cyclictest763-21lldpd07:51:511
168879987,1cyclictest506-21avahi-daemon10:36:451
168879987,1cyclictest499-21systemd-resolve11:35:151
168879987,1cyclictest28085-21fschecks_time11:20:131
168879986,2cyclictest765-21snmpd08:13:491
168879985,2cyclictest765-21snmpd08:35:181
168849988,0cyclictest765-21snmpd12:37:050
168849988,0cyclictest765-21snmpd10:13:370
168849988,0cyclictest765-21snmpd10:08:370
168849988,0cyclictest763-21lldpd12:12:580
168849988,0cyclictest763-21lldpd11:55:500
168849988,0cyclictest763-21lldpd11:13:510
168849988,0cyclictest763-21lldpd10:50:100
168849987,1cyclictest765-21snmpd10:58:170
168849987,1cyclictest765-21snmpd08:44:360
168849987,1cyclictest506-21avahi-daemon12:26:350
168849987,1cyclictest506-21avahi-daemon11:27:260
168849987,1cyclictest506-21avahi-daemon09:28:340
168849987,1cyclictest2092-21needreboot08:00:150
168849986,2cyclictest765-21snmpd08:51:220
168849986,2cyclictest765-21snmpd08:34:200
168849986,2cyclictest765-21snmpd07:52:380
168849986,2cyclictest394-21cat12:00:160
168979977,0cyclictest765-21snmpd11:33:333
168979977,0cyclictest765-21snmpd11:12:543
168979977,0cyclictest765-21snmpd09:57:023
168979977,0cyclictest765-21snmpd08:33:093
168979977,0cyclictest763-21lldpd08:25:133
168979976,1cyclictest765-21snmpd12:11:323
168979976,1cyclictest765-21snmpd10:15:003
168979976,1cyclictest765-21snmpd09:07:343
168979976,1cyclictest765-21snmpd09:00:493
168979976,1cyclictest765-21snmpd08:16:393
168979976,1cyclictest765-21snmpd07:35:003
168979976,1cyclictest763-21lldpd10:48:363
168979976,1cyclictest506-21avahi-daemon09:41:103
168979975,2cyclictest765-21snmpd12:35:423
168979975,2cyclictest765-21snmpd10:05:363
168979975,2cyclictest765-21snmpd07:55:313
168979973,3cyclictest19482-21ssh10:25:593
168879977,0cyclictest765-21snmpd09:26:411
168879977,0cyclictest765-21snmpd09:02:001
168879977,0cyclictest763-21lldpd10:09:061
168879977,0cyclictest763-21lldpd08:23:401
168879977,0cyclictest763-21lldpd07:21:201
168879977,0cyclictest763-21lldpd07:15:091
168879976,1cyclictest551-21in:imuxsock10:00:161
168879976,1cyclictest506-21avahi-daemon10:49:571
168879976,1cyclictest499-21systemd-resolve08:04:231
168879976,1cyclictest32359-21cpuspeed_turbos07:55:121
168879975,2cyclictest765-21snmpd12:10:081
168879975,2cyclictest765-21snmpd11:15:151
168879975,2cyclictest765-21snmpd10:50:131
168879975,2cyclictest765-21snmpd09:59:451
168879975,2cyclictest765-21snmpd09:31:011
168879973,3cyclictest530-21NetworkManager12:02:241
168849977,0cyclictest765-21snmpd11:52:220
168849977,0cyclictest765-21snmpd11:52:210
168849977,0cyclictest765-21snmpd11:37:390
168849977,0cyclictest765-21snmpd09:36:230
168849977,0cyclictest763-21lldpd11:01:010
168849977,0cyclictest763-21lldpd08:26:350
168849977,0cyclictest763-21lldpd07:35:420
168849977,0cyclictest763-21lldpd07:30:580
168849977,0cyclictest506-21avahi-daemon07:28:040
168849976,1cyclictest765-21snmpd07:47:440
168849976,1cyclictest763-21lldpd07:12:360
168849976,1cyclictest506-21avahi-daemon10:44:280
168849976,1cyclictest506-21avahi-daemon09:15:290
168849976,1cyclictest499-21systemd-resolve09:58:230
168849975,2cyclictest765-21snmpd11:16:060
168849975,2cyclictest765-21snmpd09:30:520
168849975,2cyclictest765-21snmpd08:55:280
168849973,3cyclictest27790-21grep07:40:150
168849973,3cyclictest2483-21ssh10:45:130
168849973,3cyclictest16961-21cron12:17:000
168979966,0cyclictest765-21snmpd08:50:553
168979966,0cyclictest765-21snmpd08:21:003
168979966,0cyclictest763-21lldpd10:38:153
168979966,0cyclictest763-21lldpd10:31:233
168979966,0cyclictest763-21lldpd10:21:043
168979966,0cyclictest506-21avahi-daemon07:10:263
168979965,1cyclictest506-21avahi-daemon07:44:273
168979964,2cyclictest765-21snmpd12:27:443
168979964,2cyclictest765-21snmpd09:53:363
168979964,2cyclictest530-21NetworkManager09:10:333
168979963,2cyclictest554-21rs:main3
168979963,2cyclictest254-20systemd-journal09:22:183
168979962,3cyclictest9416-21ssh10:12:103
168979962,3cyclictest30769-21df07:50:153
168979960,5cyclictest21171-21ssh11:49:243
168879966,0cyclictest765-21snmpd10:44:411
168879966,0cyclictest763-21lldpd09:11:181
168879965,1cyclictest765-21snmpd12:35:041
168879965,1cyclictest765-21snmpd11:55:281
168879965,1cyclictest765-21snmpd10:34:151
168879965,1cyclictest763-21lldpd11:46:521
168879965,1cyclictest499-21systemd-resolve10:22:111
168879965,1cyclictest27799-21cut07:40:151
168879965,1cyclictest11946-21fschecks_time08:30:171
168879964,2cyclictest765-21snmpd10:28:251
168879963,3cyclictest530-21NetworkManager11:30:481
168879963,2cyclictest26023-21ssh09:51:291
168879963,2cyclictest14388-21sshd09:35:391
168879962,3cyclictest6285-21ssh12:06:451
168879962,3cyclictest25751-21sh12:26:101
168879962,3cyclictest23349-21ssh11:50:341
168879962,3cyclictest23349-21ssh11:50:331
168879962,3cyclictest16769-21ssh12:16:441
168849966,0cyclictest763-21lldpd09:21:210
168849966,0cyclictest763-21lldpd08:46:060
168849965,1cyclictest763-21lldpd10:00:390
168849965,1cyclictest506-21avahi-daemon11:06:510
168849964,2cyclictest765-21snmpd09:50:030
168849964,2cyclictest765-21snmpd07:56:220
168849963,2cyclictest21963-21sed10:30:010
168849962,3cyclictest8324-21apt-get08:20:130
168849962,3cyclictest26377-21df10:35:150
168849962,3cyclictest254-20systemd-journal11:21:150
168979955,0cyclictest763-21lldpd11:06:513
168979954,1cyclictest763-21lldpd11:53:123
168979954,1cyclictest763-21lldpd11:53:113
168979954,1cyclictest0-21swapper/308:35:183
168979953,2cyclictest765-21snmpd11:42:433
168979953,2cyclictest765-21snmpd11:35:223
168979953,2cyclictest765-21snmpd07:30:193
168979953,2cyclictest530-21NetworkManager12:17:243
168979953,2cyclictest451-21kworker/u16:2+nfsiod12:07:343
168979952,3cyclictest530-21NetworkManager09:47:253
168979952,3cyclictest31482-21ssh11:25:153
168979952,2cyclictest30496-21ssh09:15:163
168979952,2cyclictest17591-21apt-get08:45:153
168979952,2cyclictest1414-21ssh10:00:563
168879955,0cyclictest506-21avahi-daemon11:25:421
168879955,0cyclictest499-21systemd-resolve08:55:131
168879953,2cyclictest739-21ntpd11:40:201
168879953,2cyclictest739-21ntpd09:24:321
168879952,3cyclictest765-21snmpd08:47:091
168879952,2cyclictest9045-21ssh10:55:011
168879952,2cyclictest21519-21ssh12:21:061
168879952,2cyclictest13575-21grep11:00:171
168879951,3cyclictest24606-21sed07:30:221
168849955,0cyclictest763-21lldpd08:19:230
168849955,0cyclictest499-21systemd-resolve08:36:180
168849954,1cyclictest765-21snmpd12:20:170
168849953,2cyclictest765-21snmpd10:17:060
168849953,2cyclictest765-21snmpd07:19:010
168849952,3cyclictest254-20systemd-journal09:08:220
168849952,2cyclictest254-20systemd-journal09:01:270
168849952,2cyclictest23755-21ssh10:31:230
168849952,2cyclictest22548-21ssh09:47:330
168849952,2cyclictest20959-21needreboot07:20:110
168849952,2cyclictest17981-21ld09:40:230
168849952,2cyclictest16725-21ssh10:21:040
168849952,2cyclictest14033-21ssh11:40:280
168849951,3cyclictest5487-21ssh12:05:450
168849951,3cyclictest27708-21sh09:11:520
168979942,2cyclictest765-21snmpd07:25:073
168979941,2cyclictest5629-21ldconfig08:10:203
168979941,2cyclictest28424-21uname11:20:163
168979940,4cyclictest20937-21apt-get08:55:113
168879944,0cyclictest19804-21needreboot08:50:181
168879942,2cyclictest765-21snmpd08:05:081
168879941,3cyclictest17431-21grep07:10:151
168879941,3cyclictest16066-21df08:40:131
168879941,2cyclictest554-21rs:main1
168879941,2cyclictest29595-21ntpq07:45:161
168849941,2cyclictest4104-21grep08:05:180
168849940,3cyclictest4950-21apt-get08:10:150
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional