You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-04-05 - 19:10

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot5s.osadl.org (updated Sat Apr 05, 2025 12:44:25)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
180599261,24cyclictest0-21swapper/311:29:593
1796992422,1cyclictest29345-21idleruntime-cro08:10:011
179599240,23cyclictest15566-21perf10:00:000
179599240,1cyclictest4142-21cron07:15:000
180599230,22cyclictest6545-21apt-get08:29:593
180599230,22cyclictest609-21polkitd07:20:013
180599230,22cyclictest598-21rs:main3
180599230,22cyclictest598-21rs:main3
180599230,22cyclictest593-21dbus-daemon11:55:003
180599230,22cyclictest19140-21munin-plugin-st07:44:593
180599230,21cyclictest313-21systemd-journal08:50:013
180099230,22cyclictest10898-21idleruntime-cro12:30:002
180099230,1cyclictest29334-21cron08:10:002
179599234,18cyclictest3049-21turbostat.cron12:10:010
1795992321,1cyclictest13934-21apt12:39:590
1795992320,2cyclictest22200-21cron09:00:000
179599230,2cyclictest26981-21munin-run08:05:010
179599230,22cyclictest0-21swapper/011:27:190
179599230,0cyclictest0-21swapper/009:47:200
1805992220,1cyclictest30596-21awk10:35:013
1805992220,1cyclictest0-21swapper/312:15:003
1805992220,1cyclictest0-21swapper/307:55:013
1805992220,1cyclictest0-21swapper/307:55:013
180599220,21cyclictest22864-21apt-get09:00:023
180599220,21cyclictest20261-21apt-get08:57:203
180599220,21cyclictest1666-21apt-get10:47:183
180599220,1cyclictest16645-21latency_hist07:39:593
1800992220,1cyclictest593-21dbus-daemon08:55:012
1800992220,1cyclictest4257-21apt-get10:50:012
1800992220,1cyclictest31098-21apt-get12:02:142
1800992220,1cyclictest0-21swapper/210:04:592
1800992220,1cyclictest0-21swapper/207:29:592
180099220,21cyclictest9484-21latency_hist11:04:592
180099220,21cyclictest22231-21awk08:59:592
180099220,21cyclictest17393-21munin-run11:25:012
180099220,21cyclictest15082-21apt-get08:47:182
180099220,1cyclictest5056-21apt-get09:32:192
1796992222,0cyclictest0-21swapper/112:32:201
1796992220,1cyclictest313-21systemd-journal10:35:001
1796992220,1cyclictest10890-21apt12:30:001
179699220,21cyclictest32247-21munin-run09:20:001
179699220,21cyclictest20261-21apt-get08:57:181
179699220,21cyclictest14154-21ls07:35:001
179699220,21cyclictest0-21swapper/111:32:191
179699220,21cyclictest0-21swapper/110:49:591
179699220,21cyclictest0-21swapper/109:42:131
179699220,21cyclictest0-21swapper/107:27:191
179699220,21cyclictest0-21swapper/107:12:191
179699220,1cyclictest593-21dbus-daemon10:10:001
179699220,1cyclictest0-21swapper/112:15:011
1795992221,1cyclictest7435-21apt-get08:32:180
1795992220,1cyclictest29823-21apt09:15:000
1795992220,1cyclictest0-21swapper/010:30:000
1795992219,2cyclictest22844-21idleruntime-cro11:39:590
179599220,21cyclictest24562-21perf08:00:010
179599220,21cyclictest0-21swapper/010:10:000
179599220,21cyclictest0-21swapper/009:52:200
179599220,21cyclictest0-21swapper/009:02:240
179599220,21cyclictest0-21swapper/007:42:230
179599220,1cyclictest0-21swapper/008:37:190
1805992121,0cyclictest0-21swapper/312:07:183
1805992121,0cyclictest0-21swapper/311:02:153
1805992120,1cyclictest0-21swapper/310:27:183
1805992120,0cyclictest19566-21apt-get07:47:243
180599210,20cyclictest0-21swapper/308:42:223
180599210,20cyclictest0-21swapper/308:17:233
180599210,0cyclictest0-21swapper/307:20:023
1800992121,0cyclictest0-21swapper/212:12:212
1800992119,1cyclictest31682-21apt-get10:42:142
180099210,20cyclictest11332-21apt-get12:32:202
180099210,20cyclictest0-21swapper/212:07:182
180099210,20cyclictest0-21swapper/210:47:182
180099210,1cyclictest30588-21turbostat.cron10:35:012
180099210,1cyclictest25044-21munin-run09:04:592
180099210,0cyclictest0-21swapper/207:47:242
1796992120,1cyclictest0-21swapper/112:10:011
1796992120,0cyclictest12894-21apt-get09:52:201
179699210,20cyclictest0-21swapper/111:02:151
179699210,20cyclictest0-21swapper/109:47:191
179699210,0cyclictest0-21swapper/108:45:011
1795992121,0cyclictest0-21swapper/011:47:190
1795992120,1cyclictest7518-21apt-get11:02:140
1795992119,1cyclictest17383-21sleep11:25:010
179599210,21cyclictest0-21swapper/008:50:030
179599210,0cyclictest6569-21apt-get07:20:020
179599210,0cyclictest0-21swapper/008:22:180
179599210,0cyclictest0-21swapper/007:47:230
1805992020,0cyclictest8104-21apt-get09:42:143
1805992020,0cyclictest0-21swapper/310:22:153
1805992020,0cyclictest0-21swapper/309:47:203
1805992020,0cyclictest0-21swapper/308:07:193
1805992019,1cyclictest20205-21apt-get11:32:193
1805992019,1cyclictest0-21swapper/312:02:143
1805992018,1cyclictest11866-21idleruntime-cro11:10:003
180599200,20cyclictest0-21swapper/308:37:203
180599200,0cyclictest2214-21apt-get07:12:213
180599200,0cyclictest0-21swapper/311:22:133
180599200,0cyclictest0-21swapper/309:22:193
1800992020,0cyclictest23838-21apt-get10:22:142
1800992020,0cyclictest0-21swapper/211:15:002
1800992020,0cyclictest0-21swapper/209:52:192
1800992020,0cyclictest0-21swapper/208:02:132
1800992019,1cyclictest2200-21apt-get08:22:182
1800992018,1cyclictest7435-21apt-get08:32:192
1800992018,1cyclictest4594-21apt-get08:27:202
180099200,20cyclictest32670-21apt-get09:22:192
180099200,19cyclictest0-21swapper/209:27:192
180099200,19cyclictest0-21swapper/209:27:192
180099200,0cyclictest17811-21apt-get11:27:202
180099200,0cyclictest0-21swapper/209:42:132
180099200,0cyclictest0-21swapper/207:17:202
1796992020,0cyclictest0-21swapper/112:22:141
1796992020,0cyclictest0-21swapper/109:32:181
1796992020,0cyclictest0-21swapper/109:22:201
1796992020,0cyclictest0-21swapper/108:12:191
1796992020,0cyclictest0-21swapper/107:47:241
1796992019,0cyclictest15411-21apt-get11:22:141
1796992018,1cyclictest20789-21apt-get10:12:211
1796992018,1cyclictest17658-21apt-get08:50:021
1796992018,1cyclictest0-21swapper/111:10:011
179699200,20cyclictest0-21swapper/110:22:131
1795992020,0cyclictest4594-21apt-get08:27:210
1795992020,0cyclictest15999-21apt-get10:02:170
1795992020,0cyclictest0-21swapper/012:22:140
1795992020,0cyclictest0-21swapper/010:22:140
1795992020,0cyclictest0-21swapper/008:47:180
1795992020,0cyclictest0-21swapper/007:27:190
1795992018,1cyclictest0-21swapper/011:10:010
179599200,20cyclictest0-21swapper/007:37:190
179599200,19cyclictest0-21swapper/009:17:190
1805991919,0cyclictest0-21swapper/308:02:143
1805991917,1cyclictest313-21systemd-journal12:00:013
1805991917,1cyclictest14986-21perf11:20:003
1800991919,0cyclictest32185-21apt-get08:17:152
1800991919,0cyclictest29793-21apt-get08:12:192
1800991919,0cyclictest27861-21apt-get09:12:182
1800991918,1cyclictest18393-21apt-get10:07:182
1800991917,1cyclictest12243-21apt-get08:42:232
1796991919,0cyclictest0-21swapper/112:02:151
1796991919,0cyclictest0-21swapper/111:27:201
1796991919,0cyclictest0-21swapper/110:02:171
1796991917,1cyclictest27429-21perf09:10:001
1795991919,0cyclictest0-21swapper/010:47:190
1795991919,0cyclictest0-21swapper/009:07:190
1795991919,0cyclictest0-21swapper/007:32:210
179599190,18cyclictest0-21swapper/010:52:210
1805991818,0cyclictest0-21swapper/310:52:213
1805991818,0cyclictest0-21swapper/310:07:173
1805991818,0cyclictest0-21swapper/308:12:203
1805991815,2cyclictest7653-21apt09:40:013
1800991818,0cyclictest28049-21apt-get11:52:192
1800991818,0cyclictest0-21swapper/210:27:182
1800991818,0cyclictest0-21swapper/207:12:202
1800991817,0cyclictest25466-21apt-get09:07:192
1800991817,0cyclictest10503-21apt-get09:47:192
1800991817,0cyclictest0-21swapper/207:52:202
1800991817,0cyclictest0-21swapper/207:52:202
1796991818,0cyclictest0-21swapper/111:44:591
1796991818,0cyclictest0-21swapper/107:20:011
1796991818,0cyclictest0-21swapper/107:17:191
1796991816,1cyclictest3638-21apt-get10:50:021
1796991816,1cyclictest0-21swapper/111:15:011
1795991818,0cyclictest0-21swapper/012:12:210
1795991818,0cyclictest0-21swapper/011:52:210
1795991817,0cyclictest0-21swapper/008:42:210
1795991816,1cyclictest6568-21latency_hist07:20:000
1805991717,0cyclictest0-21swapper/312:22:143
1805991717,0cyclictest0-21swapper/310:45:003
1805991717,0cyclictest0-21swapper/308:22:173
1805991715,2cyclictest11784-21idleruntime-cro07:29:593
1800991717,0cyclictest12205-21apt-get07:32:202
1800991717,0cyclictest0-21swapper/211:42:142
1800991716,1cyclictest9828-21apt-get08:37:202
1800991715,1cyclictest24561-21grep08:00:012
180099170,16cyclictest0-21swapper/211:32:202
180099170,15cyclictest313-21systemd-journal10:14:432
1796991717,0cyclictest0-21swapper/111:52:201
1796991717,0cyclictest0-21swapper/109:27:191
1796991717,0cyclictest0-21swapper/109:27:191
1796991717,0cyclictest0-21swapper/109:00:141
1796991717,0cyclictest0-21swapper/108:02:131
1796991716,0cyclictest0-21swapper/108:17:161
179699170,16cyclictest11779-21latency_hist08:40:001
179599172,1cyclictest13-21ksoftirqd/009:40:010
1795991717,0cyclictest0-21swapper/012:32:190
1795991717,0cyclictest0-21swapper/012:02:150
1795991717,0cyclictest0-21swapper/011:12:200
1795991717,0cyclictest0-21swapper/010:14:590
1795991717,0cyclictest0-21swapper/009:42:140
1795991717,0cyclictest0-21swapper/008:12:200
1805991616,0cyclictest0-21swapper/312:27:193
1805991616,0cyclictest0-21swapper/309:12:203
1805991614,1cyclictest25658-21apt-get11:47:203
1805991614,1cyclictest0-21swapper/310:04:593
1800991616,0cyclictest0-21swapper/207:37:192
1796991616,0cyclictest0-21swapper/109:12:191
1796991616,0cyclictest0-21swapper/108:32:191
1796991616,0cyclictest0-21swapper/108:22:181
1796991616,0cyclictest0-21swapper/107:37:191
1796991614,1cyclictest0-21swapper/108:45:011
179699160,5cyclictest0-21swapper/107:42:251
179699160,1cyclictest0-21swapper/112:20:001
1795991616,0cyclictest0-21swapper/010:32:180
1795991613,2cyclictest1228-21dump-pmu-power10:45:000
1805991515,0cyclictest0-21swapper/309:07:203
1800991515,0cyclictest30655-21perf12:00:002
1800991515,0cyclictest0-21swapper/212:22:152
180099150,1cyclictest0-21swapper/212:18:222
1796991515,0cyclictest26235-21apt-get10:27:171
1795991515,0cyclictest21952-21apt-get07:52:190
1795991515,0cyclictest21952-21apt-get07:52:190
179599150,1cyclictest0-21swapper/011:32:250
180599148,6cyclictest22115-21munin-node09:54:053
1805991414,0cyclictest0-21swapper/309:25:283
1805991414,0cyclictest0-21swapper/309:25:283
180599140,14cyclictest0-21swapper/312:36:133
180599140,14cyclictest0-21swapper/312:15:453
180599140,14cyclictest0-21swapper/311:40:373
180599140,14cyclictest0-21swapper/310:55:173
180599140,14cyclictest0-21swapper/310:35:033
180599140,14cyclictest0-21swapper/309:56:103
180599140,14cyclictest0-21swapper/309:16:183
180599140,14cyclictest0-21swapper/307:34:183
180599140,0cyclictest0-21swapper/312:30:163
180599140,0cyclictest0-21swapper/311:35:533
180599140,0cyclictest0-21swapper/309:31:233
180599140,0cyclictest0-21swapper/308:31:023
1800991414,0cyclictest0-21swapper/211:16:102
1800991414,0cyclictest0-21swapper/209:15:012
180099140,14cyclictest0-21swapper/212:35:582
180099140,14cyclictest0-21swapper/211:47:152
180099140,14cyclictest0-21swapper/211:35:162
180099140,14cyclictest0-21swapper/210:56:092
180099140,14cyclictest0-21swapper/210:37:512
180099140,14cyclictest0-21swapper/210:15:262
180099140,14cyclictest0-21swapper/210:15:262
180099140,14cyclictest0-21swapper/209:57:582
180099140,14cyclictest0-21swapper/209:39:172
180099140,14cyclictest0-21swapper/207:40:192
180099140,0cyclictest0-21swapper/211:05:102
1796991414,0cyclictest0-21swapper/111:55:271
179699140,8cyclictest81591ptp4l11:15:061
179699140,14cyclictest0-21swapper/112:35:561
179699140,14cyclictest0-21swapper/111:45:091
179699140,14cyclictest0-21swapper/111:35:151
179699140,14cyclictest0-21swapper/110:56:561
179699140,14cyclictest0-21swapper/110:38:571
179699140,14cyclictest0-21swapper/110:15:581
179699140,14cyclictest0-21swapper/110:15:581
179699140,14cyclictest0-21swapper/109:58:431
179699140,14cyclictest0-21swapper/109:37:281
179699140,14cyclictest0-21swapper/108:25:581
179699140,14cyclictest0-21swapper/107:52:161
179699140,14cyclictest0-21swapper/107:52:151
179699140,0cyclictest0-21swapper/107:55:591
1795991414,0cyclictest0-21swapper/011:55:500
1795991414,0cyclictest0-21swapper/009:20:190
179599140,14cyclictest0-21swapper/010:55:090
179599140,14cyclictest0-21swapper/010:15:140
179599140,14cyclictest0-21swapper/010:15:140
179599140,14cyclictest0-21swapper/009:32:040
179599140,14cyclictest0-21swapper/008:15:070
179599140,14cyclictest0-21swapper/008:05:010
179599140,0cyclictest0-21swapper/012:25:260
179599140,0cyclictest0-21swapper/012:15:400
179599140,0cyclictest0-21swapper/011:15:330
179599140,0cyclictest0-21swapper/010:37:100
179599140,0cyclictest0-21swapper/009:26:060
179599140,0cyclictest0-21swapper/009:26:060
1805991313,0cyclictest0-21swapper/310:11:203
180599130,0cyclictest0-21swapper/307:58:003
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional