You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-11-22 - 08:19
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackcslot4.osadl.org (updated Fri Nov 22, 2024 00:44:57)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
28424982293251,28sleep10-21swapper/119:06:061
28427452289247,28sleep00-21swapper/019:08:460
30071462510,4sleep10-21swapper/123:34:201
29901052470,7sleep00-21swapper/023:11:440
28759162450,2sleep00-21swapper/020:30:170
113399440,3rtkit-daemon0-21swapper/119:38:331
113399420,3rtkit-daemon0-21swapper/119:40:381
113399390,3rtkit-daemon0-21swapper/122:16:301
113399390,3rtkit-daemon0-21swapper/119:46:501
113399380,3rtkit-daemon0-21swapper/123:12:391
113399370,3rtkit-daemon0-21swapper/121:31:031
113399370,3rtkit-daemon0-21swapper/121:31:021
113399340,6rtkit-daemon2999236-21rm23:24:210
2842973993330,2cyclictest65950irq/132-enp2s023:21:101
2842969993227,3cyclictest888-21thermald19:26:530
284297399311,24cyclictest2867609-21apt-get20:10:191
113399310,4rtkit-daemon2911655-21apt-get21:35:101
284297399302,21cyclictest3054624-21apt-get00:35:141
2842969993012,11cyclictest2851522-21apt-get19:30:120
2842973992925,2cyclictest65950irq/132-enp2s023:58:151
2842969992912,10cyclictest2877458-21apt-get20:35:120
113399290,6rtkit-daemon2995826-21dump-pmu-power23:20:001
2842973992820,6cyclictest2863031-21cron20:00:001
284297399281,4cyclictest2924359-21kworker/1:022:05:141
2842969992813,10cyclictest2855451-21apt-get19:40:160
113399280,5rtkit-daemon2934794-21ssh22:03:011
2842973992724,2cyclictest65950irq/132-enp2s021:57:511
2842973992712,4cyclictest2890952-21diskmemload22:52:141
284296999272,17cyclictest2928027-21apt-get21:55:120
284296999272,16cyclictest2932144-21apt-get22:00:120
113399270,3rtkit-daemon0-21swapper/122:24:131
113399270,3rtkit-daemon0-21swapper/020:03:500
284297399266,18cyclictest3041835-21apt-config00:20:011
2842973992621,3cyclictest3050259-21munin-plugin-st00:30:001
2842973992613,7cyclictest65950irq/132-enp2s000:10:191
2842973992612,12cyclictest3033611-21unin-run00:10:001
284296999262,17cyclictest2883333-21apt-get20:50:140
284296999261,6cyclictest0-21swapper/023:45:560
2842969992615,9cyclictest892-21snmpd22:30:320
2842969992612,9cyclictest2970628-1kworker/u9:023:30:160
113399260,4rtkit-daemon2904386-21strings21:25:220
284297399252,18cyclictest3046058-21kworker/u8:400:30:151
284297399252,16cyclictest3011818-21apt-get23:40:141
2842973992517,4cyclictest2890952-21diskmemload21:11:451
2842973992511,8cyclictest65950irq/132-enp2s021:50:151
2842973992510,2cyclictest141rcu_preempt23:05:221
284296999256,3cyclictest141rcu_preempt23:54:590
284296999256,3cyclictest141rcu_preempt23:40:250
284296999256,2cyclictest141rcu_preempt21:50:000
284296999252,16cyclictest3042281-21apt-get00:20:140
284296999252,16cyclictest2871608-21apt-get20:20:130
284296999251,7cyclictest2972674-21needreboot22:50:230
284296999251,4cyclictest3050260-21munin-run00:30:010
2842969992511,9cyclictest2930699-1kworker/u9:222:35:110
2842969992510,9cyclictest2964264-21apt-get22:40:120
2842969992510,9cyclictest2964264-21apt-get22:40:120
284296999250,5cyclictest2887021-21cron21:00:000
113399250,3rtkit-daemon0-21swapper/122:10:541
30280882240,2sleep00-21swapper/000:01:190
284297399246,5cyclictest26-21ksoftirqd/121:19:351
284297399246,4cyclictest0-21swapper/100:01:041
284297399246,3cyclictest141rcu_preempt23:00:211
284297399243,12cyclictest3018278-21apt-get23:50:121
2842973992417,3cyclictest2890952-21diskmemload21:10:001
2842973992413,6cyclictest65950irq/132-enp2s022:45:131
2842973992411,8cyclictest3007795-21apt-get23:35:141
284296999249,10cyclictest2845647-21apt-get19:15:150
284296999249,10cyclictest2845647-21apt-get19:15:140
284296999245,2cyclictest141rcu_preempt23:30:000
284296999244,3cyclictest141rcu_preempt19:14:590
284296999243,12cyclictest2891237-21apt-get21:10:140
284296999242,3cyclictest2890952-21diskmemload22:57:340
284296999242,15cyclictest3022301-21apt-get23:55:130
284296999242,15cyclictest2944373-21apt-get22:15:110
2842969992410,8cyclictest2930699-1kworker/u9:222:25:120
2842969992410,8cyclictest2865215-21apt-get20:05:110
113399240,4rtkit-daemon1132-21rtkit-daemon19:51:001
113399240,3rtkit-daemon0-21swapper/122:59:181
113399240,3rtkit-daemon0-21swapper/122:42:251
113399240,3rtkit-daemon0-21swapper/122:42:251
113399240,3rtkit-daemon0-21swapper/121:49:171
113399240,3rtkit-daemon0-21swapper/020:17:170
284297399234,2cyclictest141rcu_preempt19:30:191
284297399233,3cyclictest141rcu_preempt20:50:241
2842973992317,3cyclictest2890952-21diskmemload23:48:191
2842973992315,7cyclictest2905124-21taskset21:25:381
2842973992312,8cyclictest2887569-21perl21:00:161
2842973992311,7cyclictest65950irq/132-enp2s000:20:211
284297399230,21cyclictest2844539-21seq19:11:381
284296999236,10cyclictest2861294-21apt-get19:55:120
284296999235,3cyclictest141rcu_preempt23:18:110
284296999235,12cyclictest2889204-21apt-get21:05:130
284296999232,14cyclictest2979987-21apt-get23:00:100
284296999232,14cyclictest2895399-21apt-get21:15:140
284296999232,14cyclictest2873555-21apt-get20:25:120
284296999232,14cyclictest2857397-21apt-get19:45:140
113399230,3rtkit-daemon0-21swapper/119:29:381
113399230,3rtkit-daemon0-21swapper/119:23:011
113399230,3rtkit-daemon0-21swapper/119:19:281
113399230,3rtkit-daemon0-21swapper/119:19:281
284297399223,17cyclictest2885588-21tune2fs20:55:141
284297399222,15cyclictest2869587-21apt-get20:15:141
284297399222,14cyclictest2879431-21apt-get20:40:131
2842973992215,3cyclictest2890952-21diskmemload23:28:421
284296999222,14cyclictest2940352-21apt-get22:10:150
284296999222,13cyclictest2881380-21apt-get20:45:130
284296999221,4cyclictest2890952-21diskmemload22:45:230
284296999221,18cyclictest3041686-21python300:20:010
113399220,3rtkit-daemon0-21swapper/000:14:040
284297399214,15cyclictest26-21ksoftirqd/120:05:221
2842973992113,4cyclictest2890952-21diskmemload21:40:201
284296999217,8cyclictest2936386-21apt-get22:05:150
284296999213,10cyclictest2853472-21apt-get19:35:110
284296999212,8cyclictest2916320-21apt-get21:40:200
284296999212,13cyclictest2983741-21apt-get23:05:140
284296999212,13cyclictest2899547-21apt-get21:20:130
2842969992112,5cyclictest2890952-21diskmemload21:31:460
2842969992112,5cyclictest2890952-21diskmemload21:31:450
284296999210,4cyclictest3030940-21ssh00:05:230
284296999210,4cyclictest2912930-21sed21:35:220
113399210,3rtkit-daemon0-21swapper/000:37:260
284297399206,13cyclictest26-21ksoftirqd/122:38:331
2842973992012,6cyclictest2877284-21systemd-run20:35:001
2842973992012,6cyclictest2864428-21sed20:00:261
2842973992011,7cyclictest2882446-21find20:45:221
2842973992011,7cyclictest2877882-21expr20:35:161
284297399200,3cyclictest2895180-1kworker/1:2H21:20:161
284297399200,17cyclictest2960015-21latency_hist22:35:011
284296999204,9cyclictest2948490-21apt-get22:20:140
2842969992015,3cyclictest861-21runrttasks20:10:160
2842969992011,5cyclictest2890952-21diskmemload00:31:120
284296999201,14cyclictest2859345-21apt-get19:50:120
284296999201,13cyclictest2887254-21apt-get21:00:130
113399200,9rtkit-daemon2954802-21ssh22:27:511
113399200,3rtkit-daemon0-21swapper/023:35:480
284297399192,2cyclictest141rcu_preempt20:20:181
284296999193,14cyclictest2880295-21proc_pri20:40:220
284296999192,10cyclictest2847621-21apt-get19:20:120
2842969991914,3cyclictest2923981-21/usr/sbin/munin21:50:210
2842973991813,3cyclictest2875318-21idleruntime-cro20:30:001
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional