You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-16 - 08:36
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackcslot4.osadl.org (updated Mon Jul 15, 2024 12:44:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
26347182267187,28sleep00-21swapper/007:06:180
26349592244201,28sleep10-21swapper/107:08:531
27761862700,3chrt2776172-40apt-check11:10:050
27695252680,3sleep12769521-21ntp_states11:00:331
159199680,4rtkit-daemon1590-21rtkit-daemon12:33:590
263517699587,10cyclictest2687094-21diskmemload11:20:001
263517699575,21cyclictest2660961-21apt-get08:05:131
159199560,3rtkit-daemon0-21swapper/108:43:321
159199550,4rtkit-daemon1590-21rtkit-daemon10:50:280
159199550,4rtkit-daemon1590-21rtkit-daemon07:30:291
159199550,4rtkit-daemon1590-21rtkit-daemon07:30:291
159199550,1rtkit-daemon1590-21rtkit-daemon11:47:331
263517699536,14cyclictest2783650-21cat11:20:061
263517699536,11cyclictest2731552-21grep10:10:021
263517699529,12cyclictest2716731-21apt-get09:50:121
263517699527,12cyclictest2659354-21lsb_release08:03:451
263517699526,11cyclictest2687094-21diskmemload09:30:001
263517699526,10cyclictest2751037-21/usr/sbin/munin10:35:271
263517699516,9cyclictest2698410-21sed09:25:011
263517699516,12cyclictest2727923-21date10:05:011
263517699516,12cyclictest2691076-21latency_hist09:15:011
263517699516,12cyclictest2691076-21latency_hist09:15:001
263517699514,9cyclictest2700778-21kworker/u8:009:45:001
263517699505,9cyclictest2694685-21latency_hist09:20:001
28003482490,4sleep00-21swapper/011:42:290
263517699498,12cyclictest2776172-40apt-check11:10:131
263517699496,13cyclictest2742540-21sed10:25:011
263517699496,11cyclictest2687173-21sed09:10:001
159199490,3rtkit-daemon1590-21rtkit-daemon08:20:351
159199490,3rtkit-daemon0-21swapper/107:12:271
159199490,19rtkit-daemon1590-21rtkit-daemon09:31:571
28226572480,3sleep00-21swapper/012:13:260
263517699487,11cyclictest2765047-21apt-get10:55:151
263517699486,11cyclictest2735363-21date10:15:001
263517699486,10cyclictest2647895-21date07:40:011
159199480,3rtkit-daemon0-21swapper/112:21:181
159199480,3rtkit-daemon0-21swapper/110:15:051
159199480,3rtkit-daemon0-21swapper/108:55:531
159199480,3rtkit-daemon0-21swapper/108:31:071
159199480,3rtkit-daemon0-21swapper/107:41:031
263517699477,14cyclictest2743541-21/usr/sbin/munin10:25:221
263517699477,13cyclictest2841697-21sed12:40:011
263517699476,12cyclictest2757523-21sed10:45:001
263517699475,10cyclictest2641649-21latency_hist07:25:001
2635176994710,12cyclictest2822143-21ssh12:12:191
159199470,4rtkit-daemon1590-21rtkit-daemon12:29:111
159199470,4rtkit-daemon1590-21rtkit-daemon10:52:531
159199470,3rtkit-daemon0-21swapper/109:55:491
159199470,3rtkit-daemon0-21swapper/108:45:241
159199470,3rtkit-daemon0-21swapper/108:35:501
263517699469,13cyclictest2639493-21taskset07:19:031
263517699467,14cyclictest2713437-21/usr/sbin/munin09:45:211
263517699466,12cyclictest2790613-21awk11:30:001
263517699465,14cyclictest2795685-21plymouth11:35:431
263517699465,10cyclictest2651773-21unin-run07:50:011
2635176994613,13cyclictest2835905-21cat12:30:341
159199460,3rtkit-daemon0-21swapper/112:08:491
159199460,3rtkit-daemon0-21swapper/112:03:151
159199460,3rtkit-daemon0-21swapper/111:58:471
263517699456,11cyclictest2790844-21apt-get11:30:101
263517699455,11cyclictest2651945-21apt-get07:50:101
159199450,3rtkit-daemon1590-21rtkit-daemon08:25:331
263517699449,12cyclictest2826200-21ssh12:18:181
263517699448,11cyclictest2665076-21apt-get08:15:091
263517699447,21cyclictest26433562sleep107:28:271
263517699445,10cyclictest2664962-21cat08:15:011
263517399440,12cyclictest141rcu_preempt08:45:000
159199440,3rtkit-daemon1590-21rtkit-daemon09:02:261
159199440,15rtkit-daemon1590-21rtkit-daemon11:50:061
263517699436,12cyclictest2799395-21grep11:40:321
263517699434,13cyclictest2653892-21apt-get07:55:111
2635173994312,3cyclictest13-21ksoftirqd/008:30:010
159199430,4rtkit-daemon2706726-21ntp_states09:35:321
159199430,4rtkit-daemon1590-21rtkit-daemon10:46:471
263517699428,10cyclictest2748871-21ssh10:33:211
159199420,5rtkit-daemon1590-21rtkit-daemon11:19:370
159199420,3rtkit-daemon0-21swapper/008:00:290
159199420,16rtkit-daemon1590-21rtkit-daemon08:51:251
159199420,15rtkit-daemon1590-21rtkit-daemon11:06:531
159199410,2rtkit-daemon1590-21rtkit-daemon08:14:440
159199400,5rtkit-daemon2730598-21ssh10:08:030
159199390,5rtkit-daemon2687094-21diskmemload09:34:440
159199390,4rtkit-daemon1590-21rtkit-daemon09:18:580
159199390,3rtkit-daemon0-21swapper/011:37:060
263517399386,4cyclictest13-21ksoftirqd/009:00:000
263517399382,8cyclictest13-21ksoftirqd/011:05:010
263517399371,8cyclictest13-21ksoftirqd/010:35:270
263517399363,6cyclictest13-21ksoftirqd/012:15:120
159199360,3rtkit-daemon0-21swapper/109:12:280
159199360,3rtkit-daemon0-21swapper/109:12:270
263517399355,16cyclictest13-21ksoftirqd/011:05:370
159199350,3rtkit-daemon0-21swapper/112:01:480
159199350,3rtkit-daemon0-21swapper/011:51:490
159199350,3rtkit-daemon0-21swapper/009:09:270
159199350,3rtkit-daemon0-21swapper/007:52:480
159199350,3rtkit-daemon0-21swapper/007:21:110
159199340,3rtkit-daemon0-21swapper/112:21:320
263517399339,4cyclictest13-21ksoftirqd/008:15:310
263517399333,8cyclictest13-21ksoftirqd/010:56:200
159199330,3rtkit-daemon0-21swapper/110:30:350
159199330,3rtkit-daemon0-21swapper/110:01:560
263517399328,14cyclictest13-21ksoftirqd/011:59:530
263517399326,7cyclictest13-21ksoftirqd/012:05:210
263517399325,7cyclictest13-21ksoftirqd/010:17:330
263517399324,9cyclictest13-21ksoftirqd/012:28:350
263517399324,7cyclictest13-21ksoftirqd/010:14:100
263517399323,7cyclictest13-21ksoftirqd/010:45:360
263517399320,4cyclictest13-21ksoftirqd/011:30:000
159199320,3rtkit-daemon0-21swapper/109:56:310
159199320,3rtkit-daemon0-21swapper/108:45:320
263517399318,3cyclictest13-21ksoftirqd/011:32:270
263517399312,6cyclictest13-21ksoftirqd/008:05:180
263517399311,6cyclictest13-21ksoftirqd/009:45:130
2635173993111,5cyclictest13-21ksoftirqd/009:45:010
263517399310,9cyclictest673-21dbus-daemon07:30:290
263517399310,9cyclictest673-21dbus-daemon07:30:290
263517399310,10cyclictest13-21ksoftirqd/009:30:010
263517399305,9cyclictest13-21ksoftirqd/011:25:000
263517399301,10cyclictest13-21ksoftirqd/009:53:470
263517399300,4cyclictest13-21ksoftirqd/007:20:000
263517399300,10cyclictest2695638-21taskset09:20:220
159199300,3rtkit-daemon0-21swapper/109:35:380
263517399294,3cyclictest13-21ksoftirqd/010:41:020
263517399293,5cyclictest13-21ksoftirqd/008:55:000
263517399291,14cyclictest2687094-21diskmemload10:25:270
263517399290,6cyclictest2739176-21apt-get10:20:160
159199290,3rtkit-daemon0-21swapper/107:42:360
263517399289,3cyclictest141rcu_preempt08:35:130
263517399288,9cyclictest13-21ksoftirqd/011:47:390
263517399288,9cyclictest13-21ksoftirqd/007:47:140
263517399287,4cyclictest13-21ksoftirqd/012:35:310
263517399282,2cyclictest141rcu_preempt08:30:370
159199280,3rtkit-daemon0-21swapper/107:11:530
263517399277,7cyclictest13-21ksoftirqd/007:25:350
263517399277,6cyclictest2647849-21perf07:40:000
263517399276,10cyclictest13-21ksoftirqd/007:57:170
263517399274,7cyclictest13-21ksoftirqd/008:20:200
263517399270,9cyclictest2683289-21chrt09:00:220
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional