You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-04-11 - 23:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot5s.osadl.org (updated Fri Apr 11, 2025 12:44:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3855947996751,11cyclictest231ktimers/107:10:141
3855951995543,8cyclictest3878139-21grep08:10:302
3855951995241,7cyclictest3866241-21grep07:35:272
3855942995038,8cyclictest3938604-21sh11:30:010
3855953994938,7cyclictest3908259-21grep09:40:323
3855942994633,10cyclictest121ktimers/009:10:170
3855947994537,5cyclictest3914633-21cron10:05:001
3855953994436,4cyclictest3894252-21munin-run09:00:013
3855947994330,8cyclictest3878147-21grep08:10:291
3855951994230,7cyclictest3925892-21grep10:40:252
3855947994233,5cyclictest3915275-21munin-plugin-st10:10:011
3855947994229,9cyclictest3881498-21grep08:20:261
3855953994028,7cyclictest3878121-21grep08:10:293
3855951994032,4cyclictest0-21swapper/209:10:002
3855942994032,4cyclictest3932028-21cron11:05:000
3855951993931,4cyclictest0-21swapper/210:15:002
3855947993931,4cyclictest0-21swapper/110:10:121
3855947993928,7cyclictest3931572-21grep11:00:261
3855947993914,7cyclictest131rcu_preempt10:20:111
3855942993928,6cyclictest3935872-21grep11:15:250
3855953993828,6cyclictest3953461-21munin-plugin-st12:19:593
3855953993828,5cyclictest0-21swapper/308:00:163
3855947993826,8cyclictest0-21swapper/110:00:001
3855942993827,7cyclictest3945596-21grep11:50:210
3855953993710,14cyclictest131rcu_preempt10:20:133
3855951993726,7cyclictest0-21swapper/209:20:002
3855947993729,4cyclictest0-21swapper/108:00:151
3855951993630,3cyclictest0-21swapper/212:00:002
3855947993627,5cyclictest3926295-21cron10:45:001
3855947993625,7cyclictest3918863-21sh10:20:001
3855953993525,7cyclictest3887052-21grep08:35:383
3855953993525,7cyclictest3887052-21grep08:35:383
3855951993527,4cyclictest0-21swapper/211:30:172
3855947993526,6cyclictest0-21swapper/110:35:001
3855947993526,4cyclictest0-21swapper/109:05:161
3855947993524,7cyclictest3902506-21grep09:20:261
3855947993523,6cyclictest0-21swapper/109:05:011
3855947993522,8cyclictest3867957-21grep07:40:261
3855947993517,5cyclictest131rcu_preempt10:35:161
3855947993517,5cyclictest131rcu_preempt10:35:161
385594799350,8cyclictest0-21swapper/107:45:121
3855942993526,6cyclictest3866656-21apt07:40:010
3855953993425,4cyclictest0-21swapper/312:10:353
3855951993426,4cyclictest0-21swapper/211:50:122
3855951993423,7cyclictest0-21swapper/209:55:242
3855951993422,8cyclictest0-21swapper/208:40:012
3855951993422,8cyclictest0-21swapper/208:40:012
3855947993426,4cyclictest0-21swapper/107:20:231
3855947993425,4cyclictest0-21swapper/108:30:001
3855953993326,3cyclictest0-21swapper/308:25:013
3855953993325,4cyclictest0-21swapper/307:45:253
3855953993324,5cyclictest0-21swapper/312:00:173
3855953993323,7cyclictest3866244-21unixbench_singl07:35:263
3855953993318,11cyclictest391ktimers/311:15:123
3855951993324,4cyclictest0-21swapper/208:15:252
3855947993326,5cyclictest3912417-21kworker/u8:1+events_unbound11:24:321
3855947993325,4cyclictest0-21swapper/109:00:011
3855947993325,4cyclictest0-21swapper/108:45:281
385594799330,7cyclictest24-21ksoftirqd/107:25:131
3855953993225,3cyclictest0-21swapper/310:50:213
3855953993225,3cyclictest0-21swapper/310:50:213
3855953993225,3cyclictest0-21swapper/310:00:003
3855953993224,4cyclictest0-21swapper/312:35:273
3855951993225,4cyclictest0-21swapper/212:10:012
3855951993224,5cyclictest0-21swapper/212:20:002
3855951993224,4cyclictest0-21swapper/210:50:012
3855951993224,4cyclictest0-21swapper/210:50:002
3855951993224,4cyclictest0-21swapper/209:00:252
3855951993222,6cyclictest3917593-21cut10:15:172
3855951993220,8cyclictest3857655-21munin-setwarn07:15:012
3855947993225,4cyclictest0-21swapper/112:00:001
3855947993221,6cyclictest0-21swapper/108:55:001
385594299320,29cyclictest0-21swapper/007:50:170
3855953993124,3cyclictest0-21swapper/309:05:013
3855953993122,6cyclictest0-21swapper/311:00:003
3855951993124,4cyclictest0-21swapper/208:25:262
3855951993123,4cyclictest0-21swapper/212:30:202
3855951993123,4cyclictest0-21swapper/211:00:172
3855947993121,5cyclictest3878992-21cut08:15:171
3855947993120,7cyclictest3928148-21grep10:50:221
3855947993120,7cyclictest3928148-21grep10:50:221
3855942993123,4cyclictest0-21swapper/011:40:250
3855942993123,4cyclictest0-21swapper/010:20:010
3855942993123,4cyclictest0-21swapper/007:15:040
3855942993122,6cyclictest3863275-21munin-plugin-st07:30:010
3855942993122,5cyclictest0-21swapper/007:40:250
3855942993120,8cyclictest3882098-21latency_hist08:25:010
3855953993024,3cyclictest0-21swapper/309:20:273
3855953993023,4cyclictest3859869-21latency_hist07:20:003
3855953993023,3cyclictest0-21swapper/308:05:163
3855953993022,5cyclictest3856245-21cut07:10:183
3855953993022,4cyclictest0-21swapper/308:25:273
3855953993022,3cyclictest0-21swapper/309:50:223
3855953993021,5cyclictest0-21swapper/311:09:593
3855951993024,4cyclictest3928839-21latency_hist10:55:002
3855951993022,4cyclictest0-21swapper/211:35:172
3855951993022,4cyclictest0-21swapper/211:20:262
3855951993022,4cyclictest0-21swapper/210:30:122
385594799302,3cyclictest0-21swapper/108:40:151
3855947993022,4cyclictest0-21swapper/107:55:171
3855942993024,3cyclictest3873463-21sendmail08:00:010
3855942993022,4cyclictest0-21swapper/010:10:220
3855953992918,6cyclictest0-21swapper/309:40:003
3855951992921,5cyclictest0-21swapper/211:15:152
3855951992921,4cyclictest0-21swapper/208:50:282
3855951992920,4cyclictest0-21swapper/209:30:262
385594799293,9cyclictest24-21ksoftirqd/108:30:161
3855947992922,4cyclictest0-21swapper/107:15:271
3855942992922,4cyclictest0-21swapper/011:35:250
3855942992922,4cyclictest0-21swapper/010:35:290
3855942992922,4cyclictest0-21swapper/010:35:280
3855942992922,3cyclictest0-21swapper/009:10:000
3855942992920,6cyclictest440-21cron11:14:590
3855953992821,4cyclictest0-21swapper/308:30:303
3855953992818,6cyclictest3931645-21head11:00:273
3855953992817,8cyclictest391ktimers/310:15:153
3855951992820,4cyclictest0-21swapper/207:20:222
3855947992820,4cyclictest3943267-21tail11:40:261
3855947992820,4cyclictest0-21swapper/109:20:001
3855942992820,4cyclictest0-21swapper/012:20:190
3855942992817,7cyclictest0-21swapper/012:35:180
3855942992815,9cyclictest121ktimers/010:55:130
385594299280,25cyclictest0-21swapper/012:15:110
3855953992720,4cyclictest3916562-21grep10:10:223
3855953992720,4cyclictest0-21swapper/307:30:293
3855953992720,3cyclictest0-21swapper/307:45:013
3855951992718,6cyclictest3944332-21sh11:50:002
3855951992717,6cyclictest3898078-21grep09:10:202
3855951992716,7cyclictest3928157-21grep10:50:222
3855947992720,5cyclictest3957471-21kworker/u8:0+events_unbound12:35:201
3855947992719,5cyclictest0-21swapper/107:50:291
3855947992719,4cyclictest0-21swapper/112:30:211
3855947992717,7cyclictest0-21swapper/109:45:001
385594799270,3cyclictest131rcu_preempt11:15:131
3855942992720,3cyclictest0-21swapper/007:25:000
3855953992619,4cyclictest0-21swapper/310:05:003
3855953992618,3cyclictest0-21swapper/309:10:203
3855953992617,6cyclictest0-21swapper/311:40:003
3855953992616,8cyclictest3956022-21apt12:30:063
3855953992616,6cyclictest0-21swapper/307:55:183
3855951992620,3cyclictest0-21swapper/208:25:012
3855951992619,4cyclictest0-21swapper/210:20:252
3855947992620,4cyclictest3939940-21kworker/u8:1+events_unbound12:02:001
3855947992618,6cyclictest3912417-21kworker/u8:1+events_unbound10:55:151
3855947992617,5cyclictest3953466-21cat12:19:591
3855947992617,5cyclictest0-21swapper/107:35:011
3855942992620,3cyclictest0-21swapper/008:15:250
3855953992519,3cyclictest0-21swapper/308:45:283
3855953992518,3cyclictest0-21swapper/308:50:283
3855953992517,4cyclictest0-21swapper/311:30:263
3855953992514,8cyclictest3888315-21pluginstate08:40:243
3855951992517,4cyclictest0-21swapper/212:30:002
3855951992517,4cyclictest0-21swapper/212:30:002
3855951992516,5cyclictest0-21swapper/212:15:002
3855951992514,7cyclictest0-21swapper/207:15:272
385594799258,8cyclictest131rcu_preempt08:35:371
385594799258,8cyclictest131rcu_preempt08:35:371
3855947992519,4cyclictest3939940-21kworker/u8:1+events_unbound11:47:011
3855947992519,4cyclictest3912417-21kworker/u8:1+events_unbound11:10:531
3855947992519,4cyclictest3908969-21kworker/u8:1+events_unbound09:49:421
3855947992519,4cyclictest3903482-21kworker/u8:0+events_unbound09:29:551
3855947992518,4cyclictest3953310-21kworker/u8:0+events_unbound12:22:331
3855947992518,4cyclictest0-21swapper/110:30:001
3855947992517,4cyclictest0-21swapper/109:50:121
385594799251,13cyclictest0-21swapper/111:54:181
385594799250,11cyclictest0-21swapper/110:46:301
385594799250,11cyclictest0-21swapper/110:46:301
3855942992521,2cyclictest13650irq/42-30be0000.ethernet11:05:020
3855942992520,3cyclictest3884207-21runrttasks08:30:010
3855942992518,3cyclictest0-21swapper/009:00:010
3855942992517,4cyclictest0-21swapper/007:15:000
385594299251,6cyclictest3877949-21cat08:10:280
3855942992516,5cyclictest0-21swapper/009:44:150
3855942992516,4cyclictest0-21swapper/012:10:260
385594299251,20cyclictest0-21swapper/010:29:110
3855953992418,3cyclictest0-21swapper/310:30:103
3855953992417,4cyclictest0-21swapper/312:20:193
3855953992417,3cyclictest0-21swapper/308:15:173
3855953992417,3cyclictest0-21swapper/307:30:003
3855953992414,7cyclictest3860587-21sed07:20:173
3855953992412,9cyclictest3938632-21latency_hist11:30:013
385595399241,12cyclictest0-21swapper/311:24:123
3855947992417,5cyclictest3951591-21kworker/u8:3+events_unbound12:29:321
3855947992417,5cyclictest3951591-21kworker/u8:3+events_unbound12:29:321
3855947992417,4cyclictest3875940-21ntpq08:05:211
3855947992416,4cyclictest0-21swapper/112:10:331
385594799241,12cyclictest0-21swapper/112:06:001
385594799241,12cyclictest0-21swapper/111:06:131
385594799241,12cyclictest0-21swapper/109:35:151
385594799241,11cyclictest0-21swapper/111:37:441
3855942992418,4cyclictest0-21swapper/008:45:160
3855942992415,5cyclictest0-21swapper/010:53:230
3855942992415,5cyclictest0-21swapper/010:53:230
3855942992415,5cyclictest0-21swapper/010:30:210
3855942992415,5cyclictest0-21swapper/009:56:110
385594299241,19cyclictest0-21swapper/010:49:410
385594299241,19cyclictest0-21swapper/010:49:410
385594299241,19cyclictest0-21swapper/009:04:040
385594299241,19cyclictest0-21swapper/008:01:350
3855953992317,3cyclictest0-21swapper/311:55:013
3855953992317,3cyclictest0-21swapper/311:10:283
3855953992315,5cyclictest3920864-21seq10:25:553
3855953992315,5cyclictest0-21swapper/310:10:003
3855953992315,4cyclictest440-21cron10:50:013
3855953992315,4cyclictest440-21cron10:50:003
3855953992315,4cyclictest0-21swapper/311:40:163
3855953992312,8cyclictest3924727-21date10:40:003
3855953992312,8cyclictest3924727-21date10:40:003
3855951992318,3cyclictest382-21ntpd12:20:162
3855951992317,3cyclictest0-21swapper/211:40:252
3855951992317,3cyclictest0-21swapper/210:00:222
3855951992316,3cyclictest0-21swapper/208:40:182
3855951992316,3cyclictest0-21swapper/207:50:282
3855951992316,3cyclictest0-21swapper/207:45:152
3855951992315,5cyclictest3921208-21sh10:30:012
3855951992315,5cyclictest0-21swapper/209:40:002
3855951992312,8cyclictest3924616-21sendmail10:40:002
3855951992312,8cyclictest3924616-21sendmail10:40:002
385594799237,9cyclictest24-21ksoftirqd/111:30:141
3855947992316,5cyclictest3899067-21kworker/u8:2+events_unbound09:33:421
3855947992316,5cyclictest3860446-21kworker/u8:1+events_unbound07:35:411
3855942992317,3cyclictest0-21swapper/012:00:260
3855942992316,3cyclictest0-21swapper/011:31:120
3855942992316,3cyclictest0-21swapper/009:54:380
3855942992316,3cyclictest0-21swapper/009:50:010
3855942992316,3cyclictest0-21swapper/008:54:070
3855942992315,5cyclictest121ktimers/011:25:010
385594299231,20cyclictest0-21swapper/010:40:150
385594299231,20cyclictest0-21swapper/009:26:170
385594299231,19cyclictest0-21swapper/008:43:070
385594299231,18cyclictest0-21swapper/012:31:580
385594299231,18cyclictest0-21swapper/009:33:310
385594299231,18cyclictest0-21swapper/007:31:480
385594299230,19cyclictest0-21swapper/010:06:470
385595399228,10cyclictest3901289-21idleruntime-cro09:20:013
3855953992216,3cyclictest0-21swapper/309:30:253
3855953992216,3cyclictest0-21swapper/309:05:233
3855953992215,5cyclictest0-21swapper/307:50:283
3855953992214,5cyclictest0-21swapper/312:30:003
3855953992214,5cyclictest0-21swapper/312:29:593
3855953992213,6cyclictest3926129-21seq10:42:593
3855951992216,4cyclictest440-21cron09:45:002
3855951992216,3cyclictest0-21swapper/212:00:182
3855951992216,3cyclictest0-21swapper/207:40:272
3855951992212,7cyclictest3862370-21ntpq07:25:212
385594299222,16cyclictest3882404-21sshd08:25:140
3855942992216,3cyclictest3906588-21head09:35:270
3855942992214,5cyclictest0-21swapper/008:05:250
3855942992212,7cyclictest3913396-21cut10:00:150
3855942992212,6cyclictest0-21swapper/007:50:010
385594299221,19cyclictest0-21swapper/010:24:230
385594299220,18cyclictest0-21swapper/011:45:530
3855953992114,4cyclictest391ktimers/312:09:103
385595199219,9cyclictest3864207-21cat07:30:272
3855951992115,3cyclictest0-21swapper/208:45:272
3855951992114,4cyclictest3892965-21fschecks_count08:55:162
3855951992112,6cyclictest3872134-21cut07:55:162
3855951992111,7cyclictest3873933-21fw_packets08:00:162
3855951992111,6cyclictest3902523-21unixbench_multi09:20:262
385595199211,11cyclictest637-21runrttasks12:36:452
3855942992114,3cyclictest0-21swapper/011:58:320
3855942992114,3cyclictest0-21swapper/008:37:320
3855942992114,3cyclictest0-21swapper/008:37:320
385594299211,18cyclictest0-21swapper/012:26:180
385594299211,18cyclictest0-21swapper/012:26:180
385594299211,18cyclictest0-21swapper/012:07:140
385594299211,18cyclictest0-21swapper/009:15:160
385594299210,17cyclictest0-21swapper/009:24:360
3855953992014,3cyclictest0-21swapper/309:30:013
3855953992013,5cyclictest391ktimers/311:55:143
3855951992014,3cyclictest0-21swapper/210:55:252
3855951992014,3cyclictest0-21swapper/209:50:002
3855951992013,4cyclictest0-21swapper/209:50:142
3855951992010,7cyclictest3933678-21ntp_states11:10:252
3855953991914,2cyclictest0-21swapper/309:50:023
3855951991913,4cyclictest311ktimers/208:30:252
3855953991812,3cyclictest0-21swapper/311:50:013
385595199182,11cyclictest3903594-21cron09:30:012
3855951991812,4cyclictest3875498-21sh08:05:152
385595199172,12cyclictest3932034-21apt-get11:05:062
385595199171,12cyclictest3915259-21cron10:10:002
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional