You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-11-21 - 22:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Thu Nov 21, 2024 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3137798994743,3cyclictest3184430-21kworker/u8:3+events_unbound07:55:211
3137798994237,3cyclictest3278110-21/usr/sbin/munin09:30:111
3137805994134,5cyclictest1117191-21systemd-journal08:40:013
3137795994138,2cyclictest3397338-21kworker/u8:4+events_unbound11:25:200
3137795993933,4cyclictest3153311-21latency_hist07:25:000
3137805993832,4cyclictest3266979-21latency_hist09:15:003
3137801993734,2cyclictest3334709-21kworker/u8:4+events_unbound10:25:202
3137801993734,2cyclictest3334709-21kworker/u8:4+events_unbound10:25:202
3137801993734,2cyclictest3236126-21kworker/u8:1+events_unbound09:00:212
3137795993734,2cyclictest3256878-21kworker/u8:4+events_unbound09:45:150
3137805993631,3cyclictest3256878-21kworker/u8:4+flush-259:009:45:163
3137805993630,4cyclictest3276306-21ntpq09:20:213
3137795993634,2cyclictest3226043-21kworker/u8:0+events_unbound09:10:200
3137795993533,2cyclictest3083703-21kworker/u8:4+events_unbound07:15:150
3137795993532,2cyclictest3437944-21kworker/u8:2+events_unbound12:10:280
3137795993532,2cyclictest3334709-21kworker/u8:4+events_unbound10:55:160
3137795993532,2cyclictest3163626-21kworker/u8:2+events_unbound07:35:220
3137795993531,3cyclictest3148172-21kworker/u8:0+events_unbound07:45:130
3137795993431,2cyclictest3256878-21kworker/u8:4+events_unbound09:20:150
3137795993331,2cyclictest3298504-21kworker/u8:3+events_unbound09:50:270
3137795993330,2cyclictest3132184-21kworker/u8:3+events_unbound07:10:230
3137795993328,4cyclictest3313098-21ntpq10:00:220
3137805993226,4cyclictest3366183-21/usr/sbin/munin10:55:143
3137798993229,2cyclictest3256878-21kworker/u8:4+events_unbound09:45:201
3137798993228,3cyclictest3298704-21/usr/sbin/munin09:50:181
3137795993229,2cyclictest3437944-21kworker/u8:2+events_unbound12:15:160
3137795993229,2cyclictest3334709-21kworker/u8:4+events_unbound10:30:220
3137805993126,4cyclictest3355831-21kworker/u8:3+flush-259:011:10:233
3137798993125,5cyclictest3241238-21latency_hist08:50:011
3137795993128,2cyclictest3344850-21kworker/u8:0+events_unbound10:35:120
3137795993128,2cyclictest3236126-21kworker/u8:1+events_unbound09:05:140
3137798993026,3cyclictest3334709-21kworker/u8:4+flush-259:010:55:181
3137798993023,3cyclictest3344850-21kworker/u8:0+flush-259:010:35:151
3137795993027,2cyclictest3464789-21kworker/u8:1+events_unbound12:35:220
3137795993027,2cyclictest3288196-21kworker/u8:1+events_unbound10:15:270
3137798992926,2cyclictest3334709-21kworker/u8:4+events_unbound10:30:201
3137795992926,2cyclictest3209960-21kworker/u8:1+events_unbound08:20:270
3137795992923,4cyclictest3215529-21diskstats08:25:120
3137801992825,2cyclictest3423314-21kworker/u8:1+events_unbound12:20:002
3137801992825,2cyclictest3163626-21kworker/u8:2+flush-259:007:40:202
3137801992824,3cyclictest3173917-21kworker/u8:1+flush-259:007:45:212
3137798992825,2cyclictest3437944-21kworker/u8:2+flush-259:012:10:301
3137798992825,2cyclictest3256878-21kworker/u8:4+events_unbound09:20:201
3137795992826,2cyclictest3334709-21kworker/u8:4+events_unbound10:25:180
3137795992826,2cyclictest3334709-21kworker/u8:4+events_unbound10:25:180
3137795992826,2cyclictest3184223-21kworker/u8:2+events_unbound08:00:260
3137795992825,2cyclictest3277215-21kworker/u8:0+events_unbound09:55:180
3137805992721,4cyclictest3137727-21latency_hist07:10:023
3137801992724,2cyclictest3184223-21kworker/u8:2+flush-259:008:00:262
3137801992720,5cyclictest3204820-21latency_hist08:15:002
3137798992724,2cyclictest3277215-21kworker/u8:0+events_unbound10:20:171
3137798992724,2cyclictest3226043-21kworker/u8:0+flush-259:009:10:231
3137795992725,2cyclictest3355831-21kworker/u8:3+events_unbound11:40:210
3137795992725,2cyclictest3288196-21kworker/u8:1+events_unbound10:45:140
3137805992620,4cyclictest3349129-21ntpq10:35:203
3137801992623,2cyclictest3226043-21kworker/u8:0+events_unbound08:55:202
3137798992623,2cyclictest3236126-21kworker/u8:1+events_unbound09:05:191
3137798992623,2cyclictest3199678-21kworker/u8:3+flush-259:008:40:231
3137798992623,2cyclictest3083703-21kworker/u8:4+events_unbound07:40:151
3137798992623,2cyclictest3083703-21kworker/u8:4+events_unbound07:15:181
3137795992624,2cyclictest3184430-21kworker/u8:3+events_unbound07:55:230
3137805992517,6cyclictest1117191-21systemd-journal07:29:593
3137798992522,2cyclictest3163626-21kworker/u8:2+events_unbound07:35:201
3137798992519,4cyclictest3470016-21latency_hist12:35:001
3137795992522,2cyclictest3184223-21kworker/u8:2+events_unbound09:02:200
3137805992417,5cyclictest3465096-21/usr/sbin/munin12:30:193
3137801992421,2cyclictest3423314-21kworker/u8:1+events_unbound12:05:232
3137798992422,2cyclictest3334709-21kworker/u8:4+flush-259:011:00:241
3137798992421,2cyclictest3449523-21kworker/u8:4+flush-259:012:25:181
3137798992421,2cyclictest3418196-21kworker/u8:0+flush-259:011:50:241
3137798992421,2cyclictest3397338-21kworker/u8:4+flush-259:011:40:251
3137798992421,2cyclictest3397338-21kworker/u8:4+events_unbound11:25:121
3137798992421,2cyclictest3132184-21kworker/u8:3+events_unbound07:20:211
3137798992418,2cyclictest3397338-21kworker/u8:4+events_unbound11:30:231
3137795992417,5cyclictest1117191-21systemd-journal08:35:010
3137795992416,6cyclictest3173896-21latency_hist07:45:000
3137795992416,5cyclictest3428505-21/usr/sbin/munin11:55:190
3137801992319,2cyclictest3288196-21kworker/u8:1+events_unbound10:24:192
3137801992319,2cyclictest3209960-21kworker/u8:1+flush-259:008:30:212
3137798992320,2cyclictest3256878-21kworker/u8:4+flush-259:009:30:011
3137798992319,3cyclictest1117191-21systemd-journal11:20:001
3137795992319,3cyclictest3271842-21kworker/u8:2+events_unbound09:39:480
3137795992317,4cyclictest3245448-21ntpq08:50:200
3137805992217,4cyclictest3277215-21kworker/u8:0+flush-259:009:55:253
3137801992220,2cyclictest3236126-21kworker/u8:1+events_unbound08:45:142
3137801992219,2cyclictest3397338-21kworker/u8:4+events_unbound11:26:192
3137801992219,2cyclictest3382038-21kworker/u8:2+events_unbound11:15:192
3137801992219,2cyclictest3355831-21kworker/u8:3+flush-259:011:35:212
3137801992219,2cyclictest3277215-21kworker/u8:0+flush-259:010:05:212
3137801992219,2cyclictest3163626-21kworker/u8:2+flush-259:007:39:592
3137801992219,2cyclictest3148172-21kworker/u8:0+events_unbound08:00:012
3137798992219,2cyclictest3277215-21kworker/u8:0+events_unbound10:00:201
3137798992219,2cyclictest3184223-21kworker/u8:2+flush-259:008:00:201
3137798992218,3cyclictest3184223-21kworker/u8:2+events_unbound08:10:211
3137798992217,2cyclictest3288196-21kworker/u8:1+flush-259:010:15:211
3137795992219,2cyclictest3418196-21kworker/u8:0+events_unbound11:50:200
3137795992219,2cyclictest3418196-21kworker/u8:0+events_unbound11:45:260
3137795992219,2cyclictest3288196-21kworker/u8:1+events_unbound10:13:190
3137801992118,2cyclictest3438774-21kworker/u8:3+flush-259:012:10:252
3137801992118,2cyclictest3236126-21kworker/u8:1+events_unbound09:10:122
3137801992118,2cyclictest3132184-21kworker/u8:3+flush-259:007:10:212
3137801992117,3cyclictest3236126-21kworker/u8:1+flush-259:009:20:242
3137798992120,1cyclictest3423314-21kworker/u8:1+flush-259:012:15:261
3137798992119,1cyclictest3225909-21cat08:35:011
3137798992118,2cyclictest3277215-21kworker/u8:0+events_unbound10:05:181
3137795992118,2cyclictest3355831-21kworker/u8:3+events_unbound11:35:010
3137795992118,2cyclictest3344850-21kworker/u8:0+events_unbound11:10:310
3137795992118,2cyclictest3271842-21kworker/u8:2+events_unbound09:30:210
3137795992118,2cyclictest3148172-21kworker/u8:0+events_unbound07:52:190
3137795992117,3cyclictest3256878-21kworker/u8:4+events_unbound09:15:150
3137795992117,3cyclictest3199678-21kworker/u8:3+events_unbound08:40:260
3137795992115,4cyclictest3203940-21ntpq08:10:210
3137795992113,6cyclictest3458837-21ntpq12:20:240
3137795992113,6cyclictest3350840-21diskstats10:40:140
3137805992017,2cyclictest3241234-21basename08:50:013
3137805992016,3cyclictest3334709-21kworker/u8:4+flush-259:010:25:153
3137805992016,3cyclictest3334709-21kworker/u8:4+flush-259:010:25:143
3137805992016,3cyclictest3163626-21kworker/u8:2+flush-259:007:35:213
3137805992013,5cyclictest3453568-21ntpq12:15:223
3137801992018,1cyclictest3148172-21kworker/u8:0+events_unbound07:50:132
3137801992017,2cyclictest3277215-21kworker/u8:0+events_unbound10:10:192
3137801992017,2cyclictest3209960-21kworker/u8:1+events_unbound08:20:202
3137801992016,3cyclictest3288196-21kworker/u8:1+events_unbound10:04:592
3137801992015,4cyclictest3438546-21latency_hist12:05:002
3137801992014,4cyclictest3382245-21diskstats11:10:202
3137798992018,2cyclictest3153541-21kworker/u8:1+flush-259:007:30:251
3137798992017,2cyclictest3344850-21kworker/u8:0+flush-259:010:50:181
3137798992016,3cyclictest3148172-21kworker/u8:0+events_unbound07:25:141
3137798992015,2cyclictest3397338-21kworker/u8:4+events_unbound11:55:201
3137795992017,2cyclictest3334709-21kworker/u8:4+events_unbound11:00:230
3137795992017,2cyclictest3288196-21kworker/u8:1+events_unbound09:40:240
3137795992017,2cyclictest3277215-21kworker/u8:0+events_unbound10:22:570
3137795992017,2cyclictest3184223-21kworker/u8:2+events_unbound08:09:210
3137795992017,2cyclictest3184223-21kworker/u8:2+events_unbound08:09:210
3137795992016,3cyclictest3334709-21kworker/u8:4+events_unbound10:52:200
3137795992014,4cyclictest1117191-21systemd-journal07:25:160
3137805991916,2cyclictest3261772-21cron09:10:013
3137805991915,3cyclictest3397338-21kworker/u8:4+flush-259:011:45:173
3137805991915,3cyclictest3184223-21kworker/u8:2+flush-259:008:05:273
3137805991915,3cyclictest3184223-21kworker/u8:2+flush-259:008:05:263
3137805991915,3cyclictest3132184-21kworker/u8:3+flush-259:007:10:263
3137805991915,2cyclictest3288196-21kworker/u8:1+events_unbound10:40:193
3137801991916,2cyclictest3449523-21kworker/u8:4+flush-259:012:20:202
3137801991916,2cyclictest3148172-21kworker/u8:0+flush-259:007:25:192
3137801991915,3cyclictest3334709-21kworker/u8:4+events_unbound10:30:142
3137801991915,3cyclictest3226043-21kworker/u8:0+flush-259:008:35:162
3137798991916,2cyclictest3355831-21kworker/u8:3+events_unbound11:07:201
3137798991916,2cyclictest3344850-21kworker/u8:0+flush-259:010:45:241
3137798991916,2cyclictest3236126-21kworker/u8:1+flush-259:009:20:011
3137798991916,2cyclictest3199678-21kworker/u8:3+flush-259:008:25:221
3137798991916,2cyclictest3083703-21kworker/u8:4+flush-259:007:50:151
3137795991916,2cyclictest3277215-21kworker/u8:0+events_unbound09:29:570
3137795991916,2cyclictest3226043-21kworker/u8:0+events_unbound08:47:210
3137805991815,2cyclictest3271842-21kworker/u8:2+flush-259:009:39:593
3137805991814,3cyclictest1117191-21systemd-journal12:25:003
3137805991812,5cyclictest3407640-21latency_hist11:35:013
3137801991816,2cyclictest3344850-21kworker/u8:0+flush-259:010:50:232
3137801991816,2cyclictest3132184-21kworker/u8:3+events_unbound07:20:192
3137801991815,2cyclictest3418196-21kworker/u8:0+flush-259:011:51:182
3137801991815,2cyclictest3209960-21kworker/u8:1+flush-259:008:25:312
3137801991812,4cyclictest3464847-21latency_hist12:30:012
3137798991816,2cyclictest3370508-21kworker/u8:1+events_unbound11:20:241
3137798991815,2cyclictest3173917-21kworker/u8:1+flush-259:007:45:161
3137798991814,3cyclictest3184223-21kworker/u8:2+events_unbound08:50:121
3137795991816,1cyclictest0-21swapper/007:10:000
3137795991815,2cyclictest3449523-21kworker/u8:4+events_unbound12:25:210
3137795991815,2cyclictest3382038-21kworker/u8:2+events_unbound11:18:210
3137805991714,2cyclictest0-21swapper/309:45:003
3137805991713,3cyclictest3355831-21kworker/u8:3+flush-259:011:05:183
3137805991712,3cyclictest1117191-21systemd-journal10:15:183
3137801991714,2cyclictest3370508-21kworker/u8:1+events_unbound11:24:202
3137801991713,3cyclictest3256878-21kworker/u8:4+flush-259:009:15:212
3137798991714,2cyclictest3454713-21kworker/u8:5+flush-259:012:20:241
3137798991714,2cyclictest3423314-21kworker/u8:1+events_unbound12:00:231
3137795991714,2cyclictest0-21swapper/011:10:000
3137795991713,3cyclictest3153541-21kworker/u8:1+events_unbound07:33:530
3137805991613,2cyclictest3162702-21ntp_kernel_err07:30:213
3137801991614,2cyclictest3288196-21kworker/u8:1+flush-259:009:40:212
3137801991613,2cyclictest3355831-21kworker/u8:3+events_unbound11:05:282
3137801991613,2cyclictest3334709-21kworker/u8:4+events_unbound11:00:182
3137801991612,3cyclictest3199678-21kworker/u8:3+events_unbound08:40:132
3137801991612,3cyclictest3153541-21kworker/u8:1+events_unbound07:31:212
3137798991614,1cyclictest0-21swapper/107:14:591
3137798991613,2cyclictest3288196-21kworker/u8:1+events_unbound09:40:161
3137798991613,2cyclictest3225410-21gpgv08:35:011
3137798991612,3cyclictest3277215-21kworker/u8:0+events_unbound10:10:201
3137798991611,4cyclictest3308810-21latency_hist10:00:001
3137795991613,2cyclictest3382038-21kworker/u8:2+events_unbound11:24:500
3137795991613,2cyclictest3226043-21kworker/u8:0+events_unbound08:38:200
3137805991512,2cyclictest3329605-21apt-get10:20:123
3137805991511,3cyclictest3355831-21kworker/u8:3+flush-259:011:35:243
3137805991511,3cyclictest3277215-21kworker/u8:0+flush-259:010:05:263
3137805991511,3cyclictest3199678-21kworker/u8:3+flush-259:008:40:143
3137805991511,2cyclictest0-21swapper/311:05:003
3137801991512,2cyclictest3304307-21irqcore09:55:172
3137801991512,2cyclictest3288196-21kworker/u8:1+flush-259:010:40:262
3137798991513,1cyclictest3189598-21kworker/u8:1+flush-259:008:05:161
3137798991513,1cyclictest3189598-21kworker/u8:1+flush-259:008:05:151
3137798991512,2cyclictest3277215-21kworker/u8:0+events_unbound09:35:221
3137798991512,2cyclictest3236126-21kworker/u8:1+events_unbound09:00:131
3137795991514,1cyclictest60650irq/133-enp0s29f1:rx-008:55:230
3137795991513,1cyclictest60650irq/133-enp0s29f1:rx-012:30:490
3137795991513,1cyclictest60650irq/133-enp0s29f1:rx-011:38:230
3137795991512,2cyclictest3148172-21kworker/u8:0+events_unbound08:19:200
3137795991511,3cyclictest3319056-21cron10:10:000
3137805991411,2cyclictest3323272-21ntp_kernel_err10:10:213
3137805991411,2cyclictest0-21swapper/312:15:003
3137805991410,3cyclictest3464789-21kworker/u8:1+events_unbound12:35:193
3137805991410,3cyclictest3225397-21cut08:35:003
313780599140,12cyclictest3443711-21awk12:10:003
3137801991412,1cyclictest0-21swapper/211:00:002
3137801991411,2cyclictest3397338-21kworker/u8:4+flush-259:011:45:202
3137801991411,2cyclictest3355831-21kworker/u8:3+events_unbound11:30:272
3137801991411,2cyclictest3184223-21kworker/u8:2+events_unbound08:50:252
3137801991410,3cyclictest3449523-21kworker/u8:4+flush-259:012:30:202
3137798991412,2cyclictest3418196-21kworker/u8:0+events_unbound12:08:211
3137798991412,2cyclictest3209960-21kworker/u8:1+events_unbound08:20:181
3137798991412,2cyclictest3148172-21kworker/u8:0+flush-259:008:15:221
3137798991410,3cyclictest3226043-21kworker/u8:0+events_unbound08:55:111
3137795991412,1cyclictest60650irq/133-enp0s29f1:rx-012:05:190
3137795991412,1cyclictest60650irq/133-enp0s29f1:rx-012:00:150
313780599139,3cyclictest3271842-21kworker/u8:2+flush-259:009:30:143
313780599138,4cyclictest3148172-21kworker/u8:0+flush-259:008:15:233
313780599137,5cyclictest1117191-21systemd-journal10:55:003
3137801991310,2cyclictest3464789-21kworker/u8:1+events_unbound12:38:192
3137801991310,2cyclictest3397338-21kworker/u8:4+events_unbound11:55:242
3137801991310,2cyclictest3359775-21needreboot10:45:192
3137801991310,2cyclictest3277215-21kworker/u8:0+flush-259:010:15:212
3137801991310,2cyclictest3271842-21kworker/u8:2+events_unbound09:30:202
313779899139,3cyclictest3464789-21kworker/u8:1+events_unbound12:39:011
313779899139,3cyclictest3355831-21kworker/u8:3+flush-259:011:10:241
3137798991310,2cyclictest3288196-21kworker/u8:1+flush-259:010:40:151
313780599128,3cyclictest3397338-21kworker/u8:4+flush-259:011:40:253
313780599125,5cyclictest509-21rs:main3
3137805991210,1cyclictest0-21swapper/311:24:593
313780199129,2cyclictest3355831-21kworker/u8:3+events_unbound11:41:142
313780199129,2cyclictest3298504-21kworker/u8:3+events_unbound09:50:292
313780199129,2cyclictest3083703-21kworker/u8:4+events_unbound07:15:122
3137801991210,2cyclictest3184223-21kworker/u8:2+events_unbound08:15:272
3137801991210,2cyclictest3184223-21kworker/u8:2+events_unbound08:05:292
3137801991210,2cyclictest3184223-21kworker/u8:2+events_unbound08:05:282
3137801991210,1cyclictest3297502-21needreboot09:45:202
3137801991210,1cyclictest0-21swapper/209:05:152
313779899129,2cyclictest3288196-21kworker/u8:1+events_unbound10:26:241
313779899129,2cyclictest3288196-21kworker/u8:1+events_unbound10:26:231
313779899128,3cyclictest3355831-21kworker/u8:3+events_unbound11:37:201
313780599118,2cyclictest3427314-21needreboot11:50:293
313780599118,2cyclictest3267303-21cpuspeed_turbos09:15:153
313780599110,9cyclictest3220254-21awk08:30:003
313780199118,2cyclictest3256878-21kworker/u8:4+flush-259:009:35:152
313779899117,3cyclictest3397338-21kworker/u8:4+events_unbound11:46:121
313780599108,1cyclictest0-21swapper/312:00:003
313780599107,2cyclictest3340941-21kthreadcore10:30:163
313780599107,1cyclictest0-21swapper/308:55:213
313780599104,4cyclictest3148698-21fw_forwarded_lo07:20:153
31378019996,2cyclictest3271842-21kworker/u8:2+events_unbound09:25:492
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional