You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-16 - 08:32
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot4.osadl.org (updated Mon Jul 15, 2024 12:43:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
490607995856,1cyclictest613222-21lspci09:02:462
49060799266,8cyclictest2689259-21systemd-journal11:34:592
490612992418,4cyclictest682522-21grep09:50:193
490607992319,2cyclictest0-21swapper/208:49:592
49060599236,9cyclictest776520-21munin-run10:50:001
490612992218,3cyclictest509-21systemd-logind12:19:593
490612992215,5cyclictest0-21swapper/310:45:013
490612992117,2cyclictest0-21swapper/309:00:003
490612992116,3cyclictest0-21swapper/310:20:003
490607992118,2cyclictest832000-21irqcore11:25:212
490607992017,2cyclictest936369-21kthreadcore12:30:192
490607992017,2cyclictest936369-21kthreadcore12:30:192
490607992017,2cyclictest0-21swapper/211:45:002
490607992014,1cyclictest191rcu_preempt12:01:032
490612991915,3cyclictest925615-21latency_hist12:25:013
490612991915,3cyclictest925615-21latency_hist12:25:013
490612991915,2cyclictest0-21swapper/309:35:313
490607991916,2cyclictest909353-21latency_hist12:15:012
490607991916,2cyclictest668195-21runrttasks09:40:222
490607991916,2cyclictest668195-21runrttasks09:40:212
490607991915,3cyclictest749328-21ntp_kernel_err10:30:312
490607991913,2cyclictest191rcu_preempt11:47:182
49060799190,13cyclictest768246-21apt-get10:45:012
490602991911,6cyclictest0-21swapper/011:39:590
490612991814,2cyclictest0-21swapper/308:20:003
490612991814,2cyclictest0-21swapper/308:05:003
49060799186,5cyclictest0-21swapper/209:05:142
490607991814,2cyclictest0-21swapper/210:40:012
490607991812,4cyclictest514-21in:imuxsock07:15:002
490607991812,1cyclictest191rcu_preempt07:20:212
49060799180,6cyclictest792089-21awk11:00:012
490605991815,2cyclictest516-21rs:main1
490605991814,3cyclictest789021-21ntp_kernel_pll_10:55:331
490602991815,2cyclictest799916-21systemd-run11:05:000
490602991815,2cyclictest544645-21irqcore08:00:180
490602991815,2cyclictest514-21in:imuxsock10:38:550
490602991814,3cyclictest60650irq/128-enp0s29f1:rx-011:53:170
490602991814,2cyclictest533331-21sh07:50:000
490602991813,3cyclictest0-21swapper/011:45:200
490612991714,2cyclictest514-21in:imuxsock09:03:223
490612991712,3cyclictest870211-21latency_hist11:49:593
490612991711,4cyclictest796998-21/usr/sbin/munin11:00:363
490612991711,4cyclictest554416-21cron08:10:003
49061299170,6cyclictest832010-21irqcore11:25:223
49060799178,2cyclictest191rcu_preempt07:25:222
49060799178,1cyclictest191rcu_preempt10:01:352
49060799173,8cyclictest1-21systemd08:55:002
490607991715,1cyclictest799918-21ssh11:05:002
490607991714,2cyclictest913671-21kthreadcore12:15:212
490607991714,2cyclictest401ktimers/209:33:442
490607991712,4cyclictest930880-21unixbench_singl12:25:342
490607991712,1cyclictest191rcu_preempt10:55:012
490607991712,1cyclictest191rcu_preempt09:25:292
490605991714,2cyclictest666995-21irqcore09:40:211
490605991714,2cyclictest666995-21irqcore09:40:201
490602991714,2cyclictest60650irq/128-enp0s29f1:rx-012:34:120
490602991714,2cyclictest60650irq/128-enp0s29f1:rx-012:34:110
490602991714,2cyclictest60650irq/128-enp0s29f1:rx-012:08:180
490602991714,2cyclictest60650irq/128-enp0s29f1:rx-011:20:090
490602991714,2cyclictest60650irq/128-enp0s29f1:rx-010:40:270
490602991714,2cyclictest60650irq/128-enp0s29f1:rx-010:35:000
490602991714,2cyclictest60650irq/128-enp0s29f1:rx-010:14:140
490602991714,2cyclictest60650irq/128-enp0s29f1:rx-009:55:340
490602991714,2cyclictest60650irq/128-enp0s29f1:rx-009:31:140
490602991713,3cyclictest60650irq/128-enp0s29f1:rx-012:00:170
490602991713,2cyclictest0-21swapper/010:00:240
490602991712,2cyclictest60650irq/128-enp0s29f1:rx-009:54:230
490612991613,2cyclictest0-21swapper/312:35:163
490612991612,3cyclictest844040-21unixbench_multi11:30:323
490612991612,3cyclictest815525-21latency_hist11:15:013
490612991612,2cyclictest0-21swapper/312:29:593
490612991612,2cyclictest0-21swapper/310:25:293
49060799169,2cyclictest191rcu_preempt11:10:372
49060799163,4cyclictest41-21ksoftirqd/208:05:002
490607991614,1cyclictest355-21hwrng10:11:372
490607991613,2cyclictest517933-21fschecks_count07:35:152
490607991612,2cyclictest0-21swapper/211:55:002
490607991612,1cyclictest191rcu_preempt08:45:012
490607991611,3cyclictest0-21swapper/209:20:222
490607991610,1cyclictest191rcu_preempt09:58:252
49060799160,4cyclictest620244-21cut09:10:242
49060799160,3cyclictest0-21swapper/212:05:282
49060599164,3cyclictest0-21swapper/109:10:261
490605991613,2cyclictest736846-21kworker/u8:4-rpciod10:41:561
490605991613,2cyclictest651160-21gltestperf09:30:191
490605991613,2cyclictest517465-21sh07:35:001
490605991613,2cyclictest355-21hwrng11:30:271
490605991613,2cyclictest1-21systemd09:04:261
490605991613,1cyclictest0-21swapper/110:55:001
490605991612,3cyclictest894322-21gltestperf12:05:191
490605991612,3cyclictest517987-21fschecks_time07:35:151
490605991612,3cyclictest311ktimers/108:28:361
49060299167,8cyclictest0-21swapper/012:20:250
49060299167,8cyclictest0-21swapper/012:20:240
490602991614,1cyclictest60650irq/128-enp0s29f1:rx-011:41:290
490602991614,1cyclictest60650irq/128-enp0s29f1:rx-011:10:040
490602991614,1cyclictest60650irq/128-enp0s29f1:rx-009:26:280
490602991614,1cyclictest60650irq/128-enp0s29f1:rx-008:59:120
490602991614,1cyclictest60650irq/128-enp0s29f1:rx-007:42:490
490602991613,2cyclictest61450irq/129-enp0s29f1:tx-009:10:400
490602991613,2cyclictest60650irq/128-enp0s29f1:rx-012:39:170
490602991613,2cyclictest60650irq/128-enp0s29f1:rx-012:10:030
490602991613,2cyclictest60650irq/128-enp0s29f1:rx-011:59:140
490602991613,2cyclictest60650irq/128-enp0s29f1:rx-011:28:040
490602991613,2cyclictest60650irq/128-enp0s29f1:rx-011:05:130
490602991613,2cyclictest60650irq/128-enp0s29f1:rx-010:58:050
490602991613,2cyclictest60650irq/128-enp0s29f1:rx-010:16:370
490602991613,2cyclictest60650irq/128-enp0s29f1:rx-010:05:290
490602991613,2cyclictest60650irq/128-enp0s29f1:rx-009:40:270
490602991613,2cyclictest60650irq/128-enp0s29f1:rx-009:40:260
490602991613,2cyclictest60650irq/128-enp0s29f1:rx-008:54:100
490602991613,2cyclictest60650irq/128-enp0s29f1:rx-008:46:210
490602991613,2cyclictest60650irq/128-enp0s29f1:rx-008:37:070
490602991613,2cyclictest60650irq/128-enp0s29f1:rx-007:18:120
490602991612,3cyclictest60650irq/128-enp0s29f1:rx-010:50:240
490602991612,3cyclictest60650irq/128-enp0s29f1:rx-010:25:110
49061299159,5cyclictest735822-21perl10:23:213
49061299159,4cyclictest522472-21sshd07:36:473
490612991512,2cyclictest491ktimers/312:10:263
490612991512,2cyclictest491ktimers/310:35:193
490612991512,2cyclictest0-21swapper/308:39:593
490612991511,3cyclictest769429-21gltestperf10:45:213
490612991511,2cyclictest8776752sleep311:54:303
490612991511,2cyclictest827065-21kthreadcore11:20:193
490612991511,2cyclictest0-21swapper/310:00:223
490612991510,4cyclictest538228-21sshd07:50:463
490612991510,4cyclictest0-21swapper/310:15:003
49060799158,1cyclictest191rcu_preempt11:20:242
49060799152,3cyclictest41-21ksoftirqd/211:15:202
49060799151,4cyclictest41-21ksoftirqd/211:05:192
490607991512,2cyclictest882778-21ntp_offset11:55:322
490607991512,2cyclictest722644-21ssh10:15:232
490607991512,2cyclictest565743-21irqcore08:20:212
490607991511,3cyclictest941946-21fschecks_count12:35:162
490607991511,3cyclictest729879-21irqcore10:20:242
490607991511,3cyclictest524114-21kthreadcore07:40:222
490607991511,2cyclictest681610-21sh09:50:002
490607991511,1cyclictest191rcu_preempt09:50:162
490607991510,1cyclictest191rcu_preempt09:18:192
490607991510,1cyclictest191rcu_preempt08:25:222
490607991510,1cyclictest191rcu_preempt07:50:282
490607991510,1cyclictest191rcu_preempt07:45:202
49060799150,5cyclictest512844-21sed07:30:152
49060799150,4cyclictest918186-21gltestperf12:20:152
49060799150,4cyclictest918186-21gltestperf12:20:152
49060799150,3cyclictest580849-21idleruntime-cro08:34:592
490605991513,1cyclictest628555-21ssh09:15:231
490605991512,2cyclictest752459-21cron10:35:001
490605991512,2cyclictest720559-21ssh10:14:061
490605991512,2cyclictest311ktimers/109:25:001
490605991511,3cyclictest729605-21cut10:20:181
490605991511,3cyclictest643390-21gltestperf09:25:181
490605991511,3cyclictest585648-21unixbench_multi08:35:351
49060599150,5cyclictest878854-21if_enp0s29f111:55:201
49060599150,11cyclictest0-21swapper/110:07:581
490602991513,2cyclictest60650irq/128-enp0s29f1:rx-009:09:520
490602991513,2cyclictest60650irq/128-enp0s29f1:rx-008:44:200
490602991512,2cyclictest60650irq/128-enp0s29f1:rx-012:25:180
490602991512,2cyclictest60650irq/128-enp0s29f1:rx-012:18:430
490602991512,2cyclictest60650irq/128-enp0s29f1:rx-011:16:100
490602991512,2cyclictest60650irq/128-enp0s29f1:rx-010:20:160
490602991512,2cyclictest60650irq/128-enp0s29f1:rx-009:48:230
490602991512,2cyclictest60650irq/128-enp0s29f1:rx-009:23:040
490602991512,2cyclictest60650irq/128-enp0s29f1:rx-008:08:220
490602991511,3cyclictest60650irq/128-enp0s29f1:rx-009:35:410
49061299147,5cyclictest523-21gdbus09:30:013
49061299147,5cyclictest2689259-21systemd-journal08:45:013
490612991411,2cyclictest848281-21kthreadcore11:35:223
490612991411,2cyclictest597111-21fschecks_count08:50:133
490612991410,2cyclictest0-21swapper/310:05:413
490612991410,2cyclictest0-21swapper/307:20:203
49061299140,4cyclictest0-21swapper/310:59:493
49060799149,1cyclictest191rcu_preempt08:55:122
49060799149,1cyclictest191rcu_preempt07:15:322
49060799147,2cyclictest191rcu_preempt08:20:002
49060799143,4cyclictest0-21swapper/210:45:282
49060799141,2cyclictest5556341irqcore08:10:232
490607991412,1cyclictest0-21swapper/211:35:232
490607991411,2cyclictest581361-21fschecks_time08:35:152
49060799140,4cyclictest0-21swapper/207:55:302
49060799140,3cyclictest659786-21irqcore09:35:262
49060799140,3cyclictest0-21swapper/208:05:112
49060599149,4cyclictest0-21swapper/107:40:231
49060599148,4cyclictest934171-21cut12:30:131
49060599148,4cyclictest934171-21cut12:30:121
49060599143,2cyclictest191rcu_preempt11:25:211
490605991411,2cyclictest871118-21sed11:50:211
490605991411,2cyclictest823662-21cpuspeed_turbos11:20:111
490605991411,2cyclictest355-21hwrng09:46:011
490605991411,2cyclictest311ktimers/112:35:231
490605991411,2cyclictest311ktimers/110:25:261
490605991411,2cyclictest0-21swapper/109:40:001
490605991410,2cyclictest0-21swapper/108:20:001
490605991410,2cyclictest0-21swapper/107:50:001
49060599140,5cyclictest704371-21ssh10:03:061
49060599140,4cyclictest722054-21irqcore10:15:211
490602991412,1cyclictest0-21swapper/009:04:550
490602991411,2cyclictest60650irq/128-enp0s29f1:rx-007:53:140
490602991410,3cyclictest60650irq/128-enp0s29f1:rx-008:15:090
49061299139,3cyclictest938164-21ntp_kernel_pll_12:30:233
49061299139,3cyclictest938164-21ntp_kernel_pll_12:30:233
49061299139,3cyclictest0-21swapper/307:15:303
49061299139,2cyclictest0-21swapper/311:15:173
49061299138,4cyclictest512194-21cron07:30:003
49061299137,4cyclictest800503-21fschecks_time11:05:173
49061299137,4cyclictest693046-21cut09:55:213
49061299130,4cyclictest671257-21users09:40:353
49061299130,4cyclictest671257-21users09:40:343
49060599139,3cyclictest752903-21cpuspeed_turbos10:35:121
49060599137,5cyclictest2689259-21systemd-journal07:15:001
49060599137,4cyclictest867341-21sed11:45:321
49060599137,4cyclictest1-21systemd08:00:001
49060599132,2cyclictest537710-21ld07:50:231
49060599131,2cyclictest191rcu_preempt09:55:001
490605991310,2cyclictest691354-21kthreadcore09:55:211
490605991310,2cyclictest311ktimers/111:10:131
49060599130,4cyclictest512318-21latency_hist07:30:001
490602991311,2cyclictest61450irq/129-enp0s29f1:tx-007:55:210
490602991311,1cyclictest60650irq/128-enp0s29f1:rx-007:10:140
49061299129,2cyclictest898158-21needreboot12:05:263
49061299129,2cyclictest674599-21gltestperf09:45:203
49061299129,2cyclictest0-21swapper/308:10:143
49061299128,3cyclictest491ktimers/312:00:103
49061299128,2cyclictest0-21swapper/310:50:303
49061299128,2cyclictest0-21swapper/309:15:233
49061299128,2cyclictest0-21swapper/309:10:233
49061299126,4cyclictest2689259-21systemd-journal08:30:003
49060599129,2cyclictest0-21swapper/111:00:221
49060599125,1cyclictest191rcu_preempt08:34:591
49060599124,3cyclictest554414-21cron08:10:001
49060599122,1cyclictest191rcu_preempt11:15:321
490605991210,1cyclictest0-21swapper/108:45:201
49060299129,2cyclictest60650irq/128-enp0s29f1:rx-008:10:250
49060299129,2cyclictest60650irq/128-enp0s29f1:rx-007:20:170
49060299127,3cyclictest512696-21sort07:30:140
49061299118,2cyclictest1810972-21kworker/3:3+events_power_efficient08:20:133
49061299118,2cyclictest0-21swapper/307:40:163
49061299118,2cyclictest0-21swapper/307:15:003
49060599119,1cyclictest603714-21kthreadcore08:55:211
49060599118,2cyclictest559283-21unixbench_singl08:10:371
49060599113,2cyclictest191rcu_preempt11:40:121
49060599112,2cyclictest191rcu_preempt09:05:141
49060599111,2cyclictest191rcu_preempt08:00:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional