You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-11-23 - 20:47

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot4s.osadl.org (updated Sat Nov 23, 2024 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1098459993732,4cyclictest1305497-21kworker/u8:0+flush-259:011:05:002
1098459993732,4cyclictest1305497-21kworker/u8:0+flush-259:011:05:002
1098456993530,3cyclictest1233534-21/usr/sbin/munin09:20:241
1098451993432,2cyclictest1197034-21kworker/u8:3+events_unbound08:45:230
1098464993330,2cyclictest1124192-21gpgv07:35:013
1098451993326,5cyclictest1117191-21systemd-journal10:20:000
1098451993230,1cyclictest1223232-21kworker/u8:4+events_unbound09:10:190
1098451993225,5cyclictest1242730-21ntpq09:25:190
1098464993126,3cyclictest1249418-21/usr/sbin/munin09:35:133
1098459993124,5cyclictest1347474-21latency_hist11:10:012
1098451993128,2cyclictest1384390-21kworker/u8:4+events_unbound12:25:200
1098451993128,2cyclictest1379065-21kworker/u8:2+events_unbound11:53:370
1098451993128,2cyclictest1155329-21kworker/u8:1+events_unbound08:10:240
1098451993128,2cyclictest1108911-21kworker/u8:2+events_unbound09:35:220
1098451993128,2cyclictest1108911-21kworker/u8:2+events_unbound08:50:240
1098451993124,5cyclictest1409928-21latency_hist12:15:010
1098459993026,3cyclictest1108911-21kworker/u8:2+flush-259:007:20:152
1098451993027,2cyclictest1139918-21kworker/u8:0+events_unbound08:05:230
1098464992922,5cyclictest1139872-21latency_hist07:50:003
1098451992926,2cyclictest1311040-21kworker/u8:2+events_unbound10:35:590
1098451992926,2cyclictest1248815-21kworker/u8:3+events_unbound09:45:140
1098451992926,2cyclictest1165809-21kworker/u8:3+events_unbound08:20:130
1098464992823,4cyclictest1117191-21systemd-journal12:15:003
1098456992821,5cyclictest1279285-21ntpq10:00:211
1098451992826,2cyclictest1295177-21kworker/u8:1+events_unbound10:41:370
1098451992825,2cyclictest1326482-21kworker/u8:3+events_unbound11:31:390
1098451992824,3cyclictest1347493-21kworker/u8:1+events_unbound11:41:130
1098464992724,2cyclictest1399863-21apt-get12:05:133
1098464992722,4cyclictest1430576-21latency_hist12:35:003
1098459992719,5cyclictest1254343-21latency_hist09:40:012
1098451992725,2cyclictest1384390-21kworker/u8:4+events_unbound12:19:370
1098451992724,2cyclictest1379065-21kworker/u8:2+events_unbound12:38:360
1098451992724,2cyclictest1108911-21kworker/u8:2+events_unbound07:45:200
1098451992722,3cyclictest1117191-21systemd-journal07:41:370
1098464992621,3cyclictest1117191-21systemd-journal12:39:363
1098464992620,4cyclictest1280552-21diskstats10:05:143
1098456992620,4cyclictest1285247-21latency_hist10:10:011
1098451992623,2cyclictest1379065-21kworker/u8:2+events_unbound11:56:360
1098451992623,2cyclictest1305497-21kworker/u8:0+events_unbound10:50:160
1098451992623,2cyclictest1175876-21kworker/u8:1+events_unbound09:00:280
1098464992522,2cyclictest1368767-21kworker/u8:0+flush-259:011:40:003
1098464992521,3cyclictest1379065-21kworker/u8:2+flush-259:011:55:003
1098464992521,3cyclictest1331644-21kworker/u8:4+flush-259:011:25:003
1098456992522,2cyclictest1108911-21kworker/u8:2+flush-259:008:15:171
1098451992522,2cyclictest1384390-21kworker/u8:4+events_unbound12:01:370
1098451992522,2cyclictest1331644-21kworker/u8:4+events_unbound11:09:560
1098451992522,2cyclictest1311040-21kworker/u8:2+events_unbound10:56:020
1098451992522,2cyclictest1108911-21kworker/u8:2+events_unbound07:22:390
1098451992518,5cyclictest1103517-21latency_hist07:15:010
1098459992419,3cyclictest1108911-21kworker/u8:2+flush-259:008:29:592
1098459992418,4cyclictest1394487-21latency_hist12:00:012
1098451992421,2cyclictest1305497-21kworker/u8:0+events_unbound10:45:390
1098451992421,2cyclictest1305497-21kworker/u8:0+events_unbound10:25:580
1098451992421,2cyclictest1248815-21kworker/u8:3+events_unbound09:30:490
1098451992421,2cyclictest1175876-21kworker/u8:1+events_unbound08:58:380
1098459992319,3cyclictest1295177-21kworker/u8:1+flush-259:010:35:182
1098459992317,4cyclictest1117191-21systemd-journal08:05:382
1098451992320,2cyclictest1399829-21kworker/u8:3+events_unbound12:22:050
1098451992320,2cyclictest1275173-21kworker/u8:3+events_unbound10:20:280
1098451992320,2cyclictest1254388-21kworker/u8:1+events_unbound09:41:370
1098451992320,2cyclictest1223232-21kworker/u8:4+events_unbound09:20:490
1098451992320,2cyclictest1139918-21kworker/u8:0+events_unbound08:30:290
1098451992320,2cyclictest1139918-21kworker/u8:0+events_unbound08:30:280
1098451992320,2cyclictest1118961-21kworker/u8:3+events_unbound07:54:380
1098451992320,2cyclictest1118961-21kworker/u8:3+events_unbound07:33:370
1098451992320,2cyclictest1108911-21kworker/u8:2+events_unbound09:59:560
1098451992320,2cyclictest1108911-21kworker/u8:2+events_unbound07:29:370
1098451992317,4cyclictest1233323-21unin-run09:20:010
1098464992218,3cyclictest1186141-21apt-get08:35:003
1098464992218,3cyclictest1186141-21apt-get08:34:593
1098459992216,4cyclictest1117191-21systemd-journal09:24:562
1098459992216,4cyclictest1117191-21systemd-journal09:05:362
1098456992218,3cyclictest1108911-21kworker/u8:2+flush-259:008:00:251
1098451992220,2cyclictest1108911-21kworker/u8:2+events_unbound08:03:380
1098451992219,2cyclictest1311040-21kworker/u8:2+events_unbound11:16:380
1098451992219,2cyclictest1275174-21kworker/u8:4+events_unbound10:10:380
1098451992219,2cyclictest1275173-21kworker/u8:3+events_unbound10:00:560
1098451992219,2cyclictest1118961-21kworker/u8:3+events_unbound07:35:040
1098464992116,3cyclictest1117191-21systemd-journal07:38:373
1098456992118,2cyclictest1103535-21kworker/u8:1+flush-259:007:15:151
1098456992117,3cyclictest1320450-21ntpq10:40:221
1098456992116,4cyclictest1336796-21apt-get11:00:001
1098451992119,2cyclictest1108911-21kworker/u8:2+events_unbound08:16:380
1098464992015,3cyclictest1300994-21apt-get10:25:133
1098459992017,2cyclictest509-21rs:main2
1098459992016,3cyclictest509-21rs:main2
1098459992016,3cyclictest1384390-21kworker/u8:4+flush-259:012:25:162
1098456992016,3cyclictest1117191-21systemd-journal11:44:361
1098456992015,4cyclictest1264669-21latency_hist09:50:011
1098451992018,2cyclictest1108911-21kworker/u8:2+events_unbound09:50:310
1098451992017,2cyclictest1347493-21kworker/u8:1+events_unbound11:35:280
1098451992015,2cyclictest1139918-21kworker/u8:0+events_unbound07:59:310
1098464991915,3cyclictest1379065-21kworker/u8:2+flush-259:012:00:003
1098464991913,4cyclictest1259510-21latency_hist09:45:013
1098459991913,4cyclictest1435712-21latency_hist12:40:002
1098459991913,4cyclictest1117191-21systemd-journal11:50:002
1098459991913,4cyclictest1117191-21systemd-journal08:20:282
1098456991917,1cyclictest1390606-21kthreadcore11:55:181
1098456991916,2cyclictest1139918-21kworker/u8:0+flush-259:008:30:181
1098456991916,2cyclictest1139918-21kworker/u8:0+flush-259:008:30:181
1098451991916,2cyclictest1384390-21kworker/u8:4+events_unbound12:06:140
1098451991916,2cyclictest1295177-21kworker/u8:1+events_unbound10:30:010
1098451991915,3cyclictest1311040-21kworker/u8:2+events_unbound11:29:240
1098451991915,3cyclictest1108911-21kworker/u8:2+events_unbound08:43:150
1098451991913,4cyclictest1342327-21latency_hist11:05:010
1098451991913,4cyclictest1342327-21latency_hist11:05:010
1098464991815,2cyclictest1212703-21idleruntime-cro09:00:003
1098464991814,3cyclictest1275173-21kworker/u8:3+flush-259:010:25:003
1098464991814,3cyclictest1186823-21apt-get08:35:103
1098459991816,1cyclictest0-21swapper/207:45:012
1098459991815,2cyclictest0-21swapper/212:20:012
1098459991814,2cyclictest0-21swapper/209:50:002
1098459991813,4cyclictest1124738-21/usr/sbin/munin07:35:192
1098456991816,1cyclictest1430571-21sh12:35:001
1098456991814,3cyclictest1275174-21kworker/u8:4+flush-259:010:15:181
1098451991815,2cyclictest1217878-21kworker/u8:3+events_unbound09:09:390
1098451991814,3cyclictest1175876-21kworker/u8:1+events_unbound08:39:390
1098464991715,1cyclictest1275174-21kworker/u8:4+flush-259:010:10:203
1098464991714,2cyclictest1399829-21kworker/u8:3+events_unbound12:20:203
1098464991714,2cyclictest1305497-21kworker/u8:0+events_unbound11:00:243
1098464991714,2cyclictest1305497-21kworker/u8:0+events_unbound11:00:243
1098464991714,2cyclictest1139918-21kworker/u8:0+flush-259:008:05:153
1098464991714,2cyclictest1108911-21kworker/u8:2+flush-259:008:00:273
1098464991713,3cyclictest1379285-21apt-get11:45:113
1098459991714,2cyclictest509-21rs:main2
1098456991714,2cyclictest1331644-21kworker/u8:4+flush-259:011:20:171
1098451991715,2cyclictest1326482-21kworker/u8:3+events_unbound11:13:380
1098451991714,2cyclictest61450irq/134-enp0s29f1:tx-011:45:250
1098451991714,2cyclictest1399829-21kworker/u8:3+events_unbound12:31:390
1098451991714,2cyclictest1175876-21kworker/u8:1+events_unbound08:26:360
1098451991714,2cyclictest1066248-21kworker/u8:3+events_unbound07:18:200
1098464991613,2cyclictest1108911-21kworker/u8:2+flush-259:008:50:173
1098464991612,3cyclictest1103961-21awk07:15:153
109845999169,5cyclictest1098369-21latency_hist07:10:012
109845999162,7cyclictest1311022-21munin-run10:35:002
1098456991613,2cyclictest1399829-21kworker/u8:3+events_unbound12:20:261
1098456991613,2cyclictest1326482-21kworker/u8:3+flush-259:011:30:141
1098456991613,2cyclictest1049845-21kworker/u8:2+flush-259:007:10:161
1098456991610,4cyclictest1117191-21systemd-journal10:12:371
1098451991613,2cyclictest1275174-21kworker/u8:4+events_unbound10:07:360
1098451991610,4cyclictest1358105-21apt-get11:20:120
1098464991513,1cyclictest1272358-21kthreadcore09:55:193
1098464991512,2cyclictest1248815-21kworker/u8:3+flush-259:009:45:173
1098459991512,2cyclictest1139918-21kworker/u8:0+flush-259:008:30:262
1098459991512,2cyclictest1139918-21kworker/u8:0+flush-259:008:30:252
1098459991511,3cyclictest1305497-21kworker/u8:0+flush-259:010:50:192
1098459991510,4cyclictest1275174-21kworker/u8:4+flush-259:010:00:242
1098456991513,1cyclictest0-21swapper/110:25:181
1098456991512,2cyclictest1403900-21ntp_kernel_pll_12:05:231
1098456991512,2cyclictest1118961-21kworker/u8:3+events_unbound07:55:171
1098456991511,3cyclictest1175876-21kworker/u8:1+events_unbound09:00:141
1098456991510,4cyclictest1190802-21ntpq08:35:191
1098456991510,4cyclictest1160462-21latency_hist08:10:011
109846499149,4cyclictest1374179-21apt-get11:40:103
1098464991411,2cyclictest1175876-21kworker/u8:1+events_unbound08:25:143
1098464991411,2cyclictest0-21swapper/309:15:193
1098464991410,3cyclictest1196867-21gpgv08:45:003
1098459991411,2cyclictest0-21swapper/211:00:002
1098459991410,3cyclictest1407328-21tr12:10:192
1098459991410,3cyclictest1175876-21kworker/u8:1+flush-259:009:00:172
1098459991410,2cyclictest0-21swapper/207:30:012
109845699149,4cyclictest1117191-21systemd-journal09:40:361
1098456991412,1cyclictest0-21swapper/108:50:001
1098456991411,2cyclictest1108911-21kworker/u8:2+events_unbound08:50:251
1098456991411,2cyclictest1103535-21kworker/u8:1+flush-259:007:35:241
1098456991410,3cyclictest1311040-21kworker/u8:2+flush-259:011:10:001
109846499139,3cyclictest1117191-21systemd-journal12:04:553
109846499138,3cyclictest1109736-21irqcore07:20:173
1098464991311,1cyclictest0-21swapper/310:35:003
1098464991311,1cyclictest0-21swapper/307:15:003
109845999139,3cyclictest1118961-21kworker/u8:3+flush-259:008:00:002
109845999138,3cyclictest1326482-21kworker/u8:3+flush-259:011:15:002
1098459991310,1cyclictest0-21swapper/211:50:172
109845699139,3cyclictest1117191-21systemd-journal11:27:381
109845699139,2cyclictest1144999-21cron07:55:001
109845699138,4cyclictest1244244-21cat09:30:011
1098456991310,2cyclictest1424902-21unixbench_multi12:25:251
1098456991310,2cyclictest1325990-21unixbench_multi10:45:251
1098456991310,2cyclictest1103535-21kworker/u8:1+events_unbound07:40:231
109846499129,2cyclictest1311040-21kworker/u8:2+flush-259:011:05:203
109846499129,2cyclictest1305497-21kworker/u8:0+flush-259:010:50:273
109846499129,2cyclictest1275174-21kworker/u8:4+flush-259:010:15:153
109846499128,3cyclictest1243617-21latency_hist09:30:013
1098464991210,1cyclictest0-21swapper/311:30:003
1098464991210,1cyclictest0-21swapper/307:25:113
109845999129,2cyclictest0-21swapper/211:19:592
109845999129,1cyclictest0-21swapper/212:30:242
109845999129,1cyclictest0-21swapper/208:45:182
109845999128,3cyclictest1399829-21kworker/u8:3+flush-259:012:10:012
109845999128,3cyclictest1374322-21tr11:40:122
109845999128,3cyclictest1285709-21fschecks_count10:10:172
109845999127,3cyclictest1118961-21kworker/u8:3+flush-259:007:50:152
109845999127,3cyclictest0-21swapper/210:29:592
109845999126,4cyclictest1117191-21systemd-journal08:35:002
1098459991210,1cyclictest0-21swapper/209:20:002
109845699129,2cyclictest1108911-21kworker/u8:2+flush-259:009:15:151
109845699128,3cyclictest1196833-21sh08:45:001
1098456991210,1cyclictest1135426-21irqcore07:45:181
109846499119,1cyclictest1223407-21cpuspeed_turbos09:10:183
109846499119,1cyclictest0-21swapper/310:35:263
109846499118,2cyclictest0-21swapper/308:15:003
109846499116,4cyclictest1379065-21kworker/u8:2+flush-259:012:26:483
109846499110,5cyclictest13578411latency_hist11:20:013
109845999118,2cyclictest1394920-21fschecks_count12:00:152
109845999118,1cyclictest0-21swapper/210:05:172
109845999118,1cyclictest0-21swapper/208:14:592
109845999116,3cyclictest1238452-21kworker/u8:0+flush-259:009:25:162
109845999116,3cyclictest1119201-21apt-get07:30:122
109845699119,1cyclictest492-21dbus-daemon09:00:011
109845699118,2cyclictest1409563-21kworker/u8:0+flush-259:012:15:221
109845699118,2cyclictest1326482-21kworker/u8:3+flush-259:010:50:211
109845699118,2cyclictest1175876-21kworker/u8:1+flush-259:008:25:151
109845699118,2cyclictest0-21swapper/108:25:011
109845699110,5cyclictest13829131kthreadcore11:45:191
109846499107,2cyclictest1118961-21kworker/u8:3+flush-259:007:55:253
109846499107,2cyclictest1118961-21kworker/u8:3+flush-259:007:40:253
109845999107,2cyclictest1098759-21cut07:10:122
109845999106,2cyclictest1363630-21sh11:30:002
109845999100,8cyclictest1259510-21latency_hist09:45:012
10984569991,6cyclictest1254372-21systemd09:40:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional