You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-16 - 08:50
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7.osadl.org (updated Tue Jul 16, 2024 00:43:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
338129599415,35cyclictest0-21swapper/023:02:190
338129599414,23cyclictest3604412-21ntpq00:37:310
3381295994132,1cyclictest3501720-21ssh22:42:300
338129599411,4cyclictest3452131-21ntpq21:47:260
338129599381,31cyclictest3469642-21cut22:07:210
3381295993716,4cyclictest3530373-21ssh23:13:070
338129599361,26cyclictest0-21swapper/021:27:270
3381297993425,4cyclictest0-21swapper/222:02:312
338129599321,25cyclictest3539007-21switchtime23:22:340
338129599321,25cyclictest3539007-21switchtime23:22:340
338129599312,21cyclictest3399907-21/usr/sbin/munin20:12:150
3381295993121,1cyclictest0-21swapper/021:41:470
3381295993024,5cyclictest0-21swapper/023:12:150
3381295993022,1cyclictest0-21swapper/022:08:080
3381295993016,3cyclictest0-21swapper/023:57:230
338129599301,25cyclictest0-21swapper/022:52:180
3381295992913,2cyclictest3566085-21ntpq23:52:260
338129599281,2cyclictest0-21swapper/000:13:520
338129599280,18cyclictest0-21swapper/023:42:320
338129599272,13cyclictest3514330-21/usr/sbin/munin22:57:220
3381295992717,1cyclictest0-21swapper/022:29:210
3381295992717,1cyclictest0-21swapper/022:29:210
338129599270,21cyclictest0-21swapper/000:22:170
338129799263,19cyclictest2008528-21snmpd23:32:272
3381295992614,4cyclictest3551342-21/usr/sbin/munin23:37:260
338129599250,0cyclictest0-21swapper/000:05:550
3381297992418,3cyclictest0-21swapper/200:27:212
338129599242,11cyclictest0-21swapper/022:42:350
3381295992417,3cyclictest3455777-21aten_r2power_cu21:52:140
338129599240,19cyclictest0-21swapper/022:33:580
338129799237,13cyclictest1000-21mta-sts-daemon23:02:192
338129799232,5cyclictest3529554-21ntp_states23:12:342
338129599231,22cyclictest0-21swapper/000:38:520
338129599231,21cyclictest0-21swapper/023:32:180
338129599231,17cyclictest0-21swapper/022:02:320
338129599231,17cyclictest0-21swapper/000:08:360
338129599231,14cyclictest0-21swapper/000:32:080
3381295992311,2cyclictest0-21swapper/022:26:570
3381295992310,3cyclictest3428726-21sort21:22:160
338129599230,20cyclictest0-21swapper/020:32:340
338129799224,13cyclictest3537509-21ssh23:22:152
3381297992217,3cyclictest0-21swapper/222:17:342
338129699226,4cyclictest11050irq/107-eth%d23:02:341
338129699225,16cyclictest3401190-21munin-run20:12:331
338129599221,21cyclictest0-21swapper/022:22:170
338129599221,11cyclictest0-21swapper/023:22:300
112299220,1rtkit-daemon0-21swapper/119:23:531
3381296992112,6cyclictest0-21swapper/100:37:191
338129599213,11cyclictest3478905-21sh22:17:260
3381295992113,4cyclictest0-21swapper/021:57:240
3381297992011,6cyclictest0-21swapper/222:37:342
3381297992011,4cyclictest3492025-21fschecks_time22:32:232
3381297992011,4cyclictest3492025-21fschecks_time22:32:232
338129799200,13cyclictest3483961-21systemctl22:22:342
338129699208,8cyclictest3561591-21ssh23:47:291
338129699207,5cyclictest171rcu_preempt23:52:231
3381296992011,8cyclictest3490868-21kworker/u8:1+events_unbound23:22:291
3381295992013,2cyclictest0-21swapper/021:37:290
338129799196,11cyclictest3469263-21/usr/sbin/munin22:07:162
338129799195,10cyclictest3487184-21ssh22:27:122
3381297991910,2cyclictest3452353-21mailstats21:47:292
338129799190,11cyclictest0-21swapper/200:17:462
3381296991916,2cyclictest3479823-21unixbench-2d22:17:361
3381296991915,2cyclictest0-21swapper/123:27:311
3381296991915,2cyclictest0-21swapper/123:27:311
3381296991914,4cyclictest1000-21mta-sts-daemon22:47:251
3381296991913,4cyclictest0-21swapper/119:47:341
3381296991912,6cyclictest3511083-21ssh22:52:331
338129599199,4cyclictest0-21swapper/021:12:380
338129599197,3cyclictest3595701-21/usr/sbin/munin00:27:170
338129599192,10cyclictest3381257-21munin-run19:12:340
3381295991911,6cyclictest3396539-21grep19:57:350
338129599191,12cyclictest3415917-21latency_hist20:57:340
3381297991812,4cyclictest36-21ksoftirqd/223:27:342
338129699187,6cyclictest3515826-21munin-run22:57:341
338129799178,7cyclictest3442674-21iwlist21:37:192
338129799177,9cyclictest0-21swapper/221:32:252
338129799174,9cyclictest3542223-21aten_r2power_fr23:27:152
338129799173,13cyclictest587-21mta-sts-daemon22:57:342
338129799172,4cyclictest0-21swapper/223:42:242
338129799171,5cyclictest0-21swapper/221:42:272
3381297991714,2cyclictest3388702-21fschecks_count19:37:172
3381297991711,5cyclictest3505670-21grep22:47:192
338129799171,13cyclictest3470992-21/usr/sbin/munin22:07:352
338129799171,12cyclictest3601102-21cat00:32:342
338129699179,4cyclictest0-21swapper/121:37:291
338129699173,10cyclictest3452140-21/usr/sbin/munin21:47:261
3381296991713,3cyclictest3605115-21grep00:37:361
3381296991712,2cyclictest3425740-21unixbench_multi21:17:371
338129699171,11cyclictest3569970-21ssh23:57:171
338129599179,5cyclictest3524673-21ntpq23:07:320
338129599172,11cyclictest3383829-21fschecks_time19:22:180
3381295991712,4cyclictest3399101-21ntp_kernel_pll_20:07:250
338129599171,16cyclictest0-21swapper/023:59:070
112299170,3rtkit-daemon1121-21rtkit-daemon00:26:501
112299170,3rtkit-daemon1002-21mta-sts-daemon22:31:541
112299170,3rtkit-daemon1002-21mta-sts-daemon22:31:541
338129799167,3cyclictest3560876-21ssh23:47:212
338129799163,10cyclictest3608661-21/usr/sbin/munin00:42:292
338129799162,9cyclictest3570303-21sh23:57:202
338129799162,10cyclictest3391396-21unixbench_multi19:42:342
3381297991612,2cyclictest0-21swapper/221:12:342
3381297991610,4cyclictest36-21ksoftirqd/221:07:272
338129699165,5cyclictest3487210-21/usr/sbin/munin22:27:131
338129699164,7cyclictest3469708-21grep22:07:211
338129699163,8cyclictest3557069-21/usr/sbin/munin23:42:291
338129699163,10cyclictest3524619-21ntpq23:07:311
338129699162,11cyclictest3500846-21/usr/sbin/munin22:42:171
338129699161,9cyclictest3465692-21/usr/sbin/munin22:02:311
3381296991611,2cyclictest0-21swapper/100:02:321
3381296991610,5cyclictest0-21swapper/123:32:261
3381295991611,1cyclictest3392920-21ls19:47:340
338129899155,5cyclictest0-21swapper/323:12:343
338129899153,6cyclictest0-21swapper/322:17:373
338129899152,7cyclictest0-21swapper/323:17:343
338129899151,8cyclictest0-21swapper/300:37:193
338129799159,2cyclictest36-21ksoftirqd/219:57:212
338129799159,2cyclictest3501171-21cut22:42:222
338129799156,2cyclictest11050irq/107-eth%d21:52:142
338129799154,7cyclictest3510919-21ssh22:52:312
338129799153,9cyclictest3586821-21/usr/sbin/munin00:17:212
338129799152,9cyclictest3574688-21fschecks_time00:02:222
338129799152,5cyclictest3552469-21ssh23:37:332
338129799152,12cyclictest3428909-21cut21:22:192
338129799151,9cyclictest3565955-21/usr/sbin/munin23:52:232
3381297991511,3cyclictest3417642-21grep21:02:322
338129799151,12cyclictest3400276-21fschecks_time20:12:182
338129799150,9cyclictest3399658-21munin-plugin-st20:07:342
338129799150,11cyclictest3409604-21sed20:37:352
338129699156,8cyclictest3490868-21kworker/u8:1+events_unbound22:37:271
338129699153,9cyclictest3529456-21latency_hist23:12:341
338129699153,8cyclictest3456522-21grep21:52:221
338129699153,10cyclictest3447539-21/usr/sbin/munin21:42:271
338129699152,9cyclictest3583808-21/usr/sbin/munin00:12:271
338129699152,10cyclictest3587701-21/usr/sbin/munin00:17:281
338129699151,4cyclictest11050irq/107-eth%d22:12:181
338129599155,3cyclictest0-21swapper/021:28:160
338129599152,8cyclictest0-21swapper/023:47:230
3381295991512,2cyclictest3417601-21grep21:02:320
3381295991511,2cyclictest3381735-21unixbench_multi19:12:370
112299150,3rtkit-daemon1121-21rtkit-daemon00:08:262
112299150,2rtkit-daemon1121-21rtkit-daemon20:01:472
338129899142,7cyclictest0-21swapper/323:47:223
338129899142,7cyclictest0-21swapper/322:57:343
338129899141,7cyclictest0-21swapper/321:37:193
338129899141,6cyclictest0-21swapper/300:27:193
338129799146,7cyclictest351ktimers/223:07:402
338129799144,8cyclictest1-21systemd19:27:332
338129799142,9cyclictest3576079-21ssh00:02:372
338129799142,9cyclictest3460826-21ssh21:57:192
338129799141,3cyclictest0-21swapper/220:17:242
338129799141,1cyclictest0-21swapper/200:37:262
338129799141,12cyclictest3421133-21grep21:12:372
3381297991411,2cyclictest0-21swapper/223:07:312
338129799140,4cyclictest0-21swapper/220:57:282
338129699148,2cyclictest0-21swapper/120:52:341
338129699145,6cyclictest3415920-21/usr/sbin/munin20:57:341
338129699143,7cyclictest3387842-21/usr/sbin/munin19:32:311
338129699142,9cyclictest3599864-21fschecks_time00:32:181
338129699142,8cyclictest3461726-21/usr/sbin/munin21:57:321
338129699142,11cyclictest3533854-21ntpq23:17:281
338129699142,10cyclictest3389286-21/usr/sbin/munin19:37:261
3381296991412,1cyclictest1002-21mta-sts-daemon00:07:191
338129699141,10cyclictest3591052-21/usr/sbin/munin00:22:131
3381296991410,3cyclictest3383432-21grep19:17:381
3381296991410,1cyclictest0-21swapper/120:27:341
338129599149,4cyclictest3420377-21ntp_kernel_err21:12:280
338129899133,5cyclictest0-21swapper/323:52:183
338129899133,5cyclictest0-21swapper/323:32:143
338129899133,4cyclictest0-21swapper/322:37:143
338129899132,7cyclictest0-21swapper/323:27:213
338129899132,7cyclictest0-21swapper/323:27:213
338129899132,6cyclictest0-21swapper/322:27:353
338129899132,6cyclictest0-21swapper/322:27:353
338129899131,7cyclictest0-21swapper/319:42:343
338129899131,6cyclictest0-21swapper/321:42:283
338129799136,4cyclictest0-21swapper/220:32:132
338129799134,7cyclictest3404837-21/usr/sbin/munin20:27:122
338129799132,9cyclictest3393319-21/usr/sbin/munin19:47:402
338129799132,6cyclictest3404096-21/usr/sbin/munin20:22:282
3381297991311,1cyclictest0-21swapper/221:27:182
338129699133,7cyclictest3478570-21cut22:17:231
338129699132,9cyclictest3410712-21/usr/sbin/munin20:42:331
338129699132,8cyclictest3424365-21ssh21:17:211
338129699131,8cyclictest3437865-21/usr/sbin/munin21:32:181
338129699131,8cyclictest3403489-21fschecks_count20:22:181
338129599137,3cyclictest0-21swapper/020:22:340
338129599133,6cyclictest3404836-21/usr/sbin/munin20:27:330
338129599132,8cyclictest3390613-21/usr/sbin/munin19:42:210
338129599131,8cyclictest3411666-21/usr/sbin/munin20:47:180
3381295991311,1cyclictest3409741-21/usr/sbin/munin20:42:330
338129599131,10cyclictest579-21dbus-daemon19:27:330
3381295991310,2cyclictest3402881-21unixbench_singl20:17:310
338129599130,8cyclictest3386783-21/usr/sbin/munin19:32:320
338129899124,3cyclictest0-21swapper/321:42:363
338129899123,4cyclictest0-21swapper/300:17:203
338129899123,3cyclictest0-21swapper/300:17:363
338129899122,7cyclictest0-21swapper/321:57:343
338129899122,6cyclictest0-21swapper/323:07:223
338129899122,6cyclictest0-21swapper/322:47:133
338129899122,5cyclictest0-21swapper/323:17:573
338129899122,5cyclictest0-21swapper/321:57:133
338129899122,4cyclictest0-21swapper/323:37:173
338129899121,8cyclictest0-21swapper/320:12:333
338129899121,5cyclictest0-21swapper/321:32:183
338129799121,9cyclictest3411436-21tail20:47:152
338129799121,9cyclictest3408232-21/usr/sbin/munin20:37:162
3381297991210,1cyclictest11050irq/107-eth%d19:22:282
3381297991210,1cyclictest0-21swapper/220:52:222
338129699129,3cyclictest3418765-21ntp_kernel_pll_21:07:271
338129699129,2cyclictest3401460-21unixbench_multi20:12:341
338129699129,2cyclictest3394701-21unixbench_singl19:52:331
338129699124,5cyclictest3395232-21/usr/sbin/munin19:57:181
338129699122,8cyclictest3399248-21/usr/sbin/munin20:07:281
338129699122,5cyclictest3420783-21/usr/sbin/munin21:12:341
338129699121,8cyclictest3416297-21/usr/sbin/munin21:02:161
338129699121,7cyclictest3408106-21/usr/sbin/munin20:37:321
338129699121,6cyclictest3433155-21ssh21:27:181
338129699120,4cyclictest3548235-21/usr/sbin/munin23:32:341
338129599125,4cyclictest3393401-21/usr/sbin/munin19:52:150
338129599121,9cyclictest3394991-21aten_r2power_cu19:57:160
338129599121,7cyclictest3419124-21/usr/sbin/munin21:07:340
338129599121,7cyclictest3388699-21fschecks_count19:37:170
338129899113,4cyclictest0-21swapper/323:02:263
338129899112,6cyclictest0-21swapper/320:42:193
338129899112,5cyclictest0-21swapper/322:12:353
338129899112,5cyclictest0-21swapper/321:12:223
338129899112,5cyclictest0-21swapper/300:42:213
338129899112,5cyclictest0-21swapper/300:32:263
338129899111,6cyclictest0-21swapper/323:57:203
338129899110,5cyclictest0-21swapper/321:52:273
338129799117,3cyclictest3386749-21grep19:27:402
338129799114,6cyclictest869998-21munin-node19:12:342
338129799114,2cyclictest171rcu_preempt19:47:282
338129799113,6cyclictest3382902-21unin-run19:17:342
338129699118,2cyclictest0-21swapper/120:32:211
338129699113,5cyclictest3381777-21/usr/sbin/munin19:12:371
338129699112,7cyclictest3396737-21aten_r2power_po20:02:181
338129699111,8cyclictest3390051-21/usr/sbin/munin19:42:181
338129599117,3cyclictest3414158-21latency_hist20:52:340
338129599113,5cyclictest3408106-21/usr/sbin/munin20:37:330
112299110,1rtkit-daemon0-21swapper/119:09:071
338129899104,3cyclictest0-21swapper/322:52:313
338129899103,5cyclictest0-21swapper/320:32:303
338129899103,4cyclictest0-21swapper/320:27:343
338129899103,3cyclictest0-21swapper/320:47:203
338129899103,3cyclictest0-21swapper/320:02:373
338129899102,6cyclictest0-21swapper/322:12:243
338129899102,5cyclictest0-21swapper/322:07:163
338129899102,5cyclictest0-21swapper/319:37:143
338129899102,4cyclictest0-21swapper/320:52:363
338129899101,6cyclictest0-21swapper/322:42:343
338129899101,5cyclictest0-21swapper/319:52:263
338129899101,4cyclictest0-21swapper/320:57:383
338129899100,6cyclictest0-21swapper/322:22:403
338129899100,5cyclictest0-21swapper/323:37:363
338129899100,5cyclictest0-21swapper/321:17:353
338129699102,6cyclictest3411374-21/usr/sbin/munin20:42:461
33812989993,4cyclictest0-21swapper/300:02:353
33812989993,3cyclictest0-21swapper/321:27:183
33812989993,3cyclictest0-21swapper/321:17:253
33812989993,3cyclictest0-21swapper/319:17:153
33812989992,5cyclictest0-21swapper/300:07:383
33812989992,4cyclictest0-21swapper/321:07:153
33812989992,4cyclictest0-21swapper/320:37:223
33812989992,4cyclictest0-21swapper/320:22:213
33812989992,4cyclictest0-21swapper/320:02:333
33812989992,4cyclictest0-21swapper/319:47:343
33812989992,4cyclictest0-21swapper/319:22:193
33812989992,3cyclictest0-21swapper/320:52:173
33812989992,3cyclictest0-21swapper/319:57:163
33812989992,3cyclictest0-21swapper/319:27:213
33812989991,5cyclictest0-21swapper/300:07:203
33812989991,4cyclictest0-21swapper/319:27:353
33812989982,4cyclictest0-21swapper/320:17:233
33812989961,3cyclictest0-21swapper/319:12:343
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional