You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-04-02 - 04:08

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Wed Apr 02, 2025 00:44:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3942397995120,27cyclictest0-21swapper/122:50:211
3942397995042,5cyclictest3946326-21sh19:20:011
3942393994941,4cyclictest3949723-21idleruntime-cro19:30:010
3942393994938,7cyclictest4030356-21grep23:50:200
3942393994934,12cyclictest121ktimers/000:00:130
3942402994737,6cyclictest4041818-21grep00:30:262
394239799441,12cyclictest4024604-21grep23:30:201
3942393994337,4cyclictest3982408-21diskmemload21:10:000
3942402994235,4cyclictest4001714-21munin-plugin-st22:15:012
3942402994229,8cyclictest3947634-21grep19:20:272
3942397994220,18cyclictest0-21swapper/120:15:271
3942393994236,4cyclictest4009357-21sendmail22:40:000
3942402994128,8cyclictest440-21cron00:40:002
3942397994111,3cyclictest0-21swapper/123:05:011
3942406994026,11cyclictest391ktimers/321:40:133
3942397993914,3cyclictest0-21swapper/119:45:011
3942397993912,3cyclictest3951791-21fschecks_count19:35:171
3942393993928,7cyclictest3999177-21awk22:05:000
3942402993829,5cyclictest3979009-21idleruntime-cro21:00:002
394239799389,6cyclictest3950175-21cut19:30:201
3942397993813,4cyclictest3962974-21if_eth020:10:161
3942397993812,4cyclictest231ktimers/123:10:201
3942393993831,4cyclictest3991742-21munin-run21:40:010
3942406993731,4cyclictest4042215-21cron00:35:003
3942402993729,6cyclictest311ktimers/222:40:142
3942397993713,3cyclictest4010663-21uptime22:40:261
3942393993727,6cyclictest3954419-21grep19:40:270
3942402993625,7cyclictest3997481-21sendmail22:00:002
3942402993625,5cyclictest0-21swapper/223:55:172
3942397993610,6cyclictest3966636-21/usr/sbin/munin20:20:181
3942393993628,4cyclictest0-21swapper/019:15:010
3942406993528,4cyclictest0-21swapper/323:30:003
3942406993527,4cyclictest0-21swapper/321:25:013
3942406993527,4cyclictest0-21swapper/300:30:003
3942406993527,4cyclictest0-21swapper/300:30:003
3942406993523,5cyclictest131rcu_preempt19:35:173
3942402993528,3cyclictest0-21swapper/219:50:232
3942402993524,7cyclictest4016791-21cut23:05:002
3942397993525,6cyclictest4042215-21cron00:35:001
3942397993513,4cyclictest231ktimers/100:35:151
3942393993529,4cyclictest3975612-21munin-run20:50:000
3942393993526,6cyclictest0-21swapper/020:40:010
3942402993425,7cyclictest311ktimers/221:40:122
3942397993426,4cyclictest0-21swapper/119:25:171
3942397993425,5cyclictest4001732-21grep22:15:011
3942397993423,8cyclictest3988349-21idleruntime-cro21:30:011
3942397993413,4cyclictest231ktimers/123:40:051
3942393993428,3cyclictest4020799-21kthreadd23:20:000
3942393993427,4cyclictest4026751-21idleruntime-cro23:40:010
3942393993423,5cyclictest0-21swapper/021:40:160
3942406993321,6cyclictest131rcu_preempt22:02:013
3942406993318,10cyclictest3965873-21basename20:20:013
3942406993311,9cyclictest131rcu_preempt19:25:213
3942397993317,4cyclictest4007555-21cron22:34:001
3942393993326,4cyclictest3965858-21basename20:20:010
3942393993326,4cyclictest3953117-21sendmail19:40:010
3942393993323,7cyclictest3964138-21cron20:15:010
3942406993225,4cyclictest3964139-21sh20:15:013
3942406993224,4cyclictest0-21swapper/319:45:263
3942406993222,6cyclictest3973696-21sh20:45:013
3942406993222,4cyclictest131rcu_preempt22:26:023
3942406993222,4cyclictest131rcu_preempt22:26:023
3942406993221,7cyclictest4014654-21grep22:55:263
3942406993221,6cyclictest0-21swapper/323:35:273
3942406993219,10cyclictest391ktimers/300:00:133
3942406993217,3cyclictest131rcu_preempt23:50:203
3942402993225,3cyclictest0-21swapper/200:00:172
3942402993224,4cyclictest0-21swapper/220:10:232
3942402993223,4cyclictest0-21swapper/220:50:002
3942402993221,7cyclictest0-21swapper/219:15:022
3942397993224,4cyclictest0-21swapper/120:00:271
3942397993222,7cyclictest4031988-21grep23:55:271
3942397993221,8cyclictest4023338-21cron23:30:001
3942393993227,3cyclictest0-21swapper/023:10:080
3942393993224,4cyclictest0-21swapper/023:35:010
3942393993222,6cyclictest0-21swapper/021:15:250
3942406993123,6cyclictest3993758-21kworker/u8:0+events_unbound22:07:433
3942406993123,4cyclictest0-21swapper/300:20:163
3942406993122,7cyclictest4026376-21kworker/u8:0+events_unbound23:45:333
3942406993119,5cyclictest4007412-21kworker/u8:1+events_unbound22:42:543
3942406993119,3cyclictest131rcu_preempt23:19:473
3942406993118,6cyclictest131rcu_preempt23:13:313
3942406993117,8cyclictest131rcu_preempt23:02:263
3942406993117,3cyclictest131rcu_preempt23:40:223
3942406993116,9cyclictest131rcu_preempt20:27:273
3942406993116,9cyclictest131rcu_preempt19:43:093
3942406993114,9cyclictest131rcu_preempt20:45:143
3942406993114,9cyclictest131rcu_preempt19:20:133
3942406993112,12cyclictest131rcu_preempt00:35:293
3942406993111,5cyclictest131rcu_preempt21:10:013
3942406993110,8cyclictest40-21ksoftirqd/319:55:243
3942402993124,3cyclictest0-21swapper/222:05:002
3942402993122,5cyclictest0-21swapper/222:35:002
3942402993117,11cyclictest3942387-21cyclictest20:20:132
3942397993121,7cyclictest3982407-21cut21:10:001
394240699309,5cyclictest131rcu_preempt23:55:123
3942406993025,3cyclictest391ktimers/322:13:433
3942406993023,4cyclictest0-21swapper/321:05:263
3942406993020,4cyclictest131rcu_preempt22:34:263
3942406993017,4cyclictest131rcu_preempt23:34:503
3942406993010,14cyclictest381rcuc/322:20:143
3942402993022,6cyclictest3995797-21latency_hist21:55:012
3942402993021,4cyclictest4011682-21apt22:50:012
3942402993021,4cyclictest0-21swapper/222:35:252
3942402993021,4cyclictest0-21swapper/220:35:162
3942393993022,4cyclictest0-21swapper/020:50:320
394240699294,6cyclictest40-21ksoftirqd/320:30:133
394240699293,8cyclictest40-21ksoftirqd/322:50:013
3942406992921,4cyclictest0-21swapper/319:50:323
3942406992920,4cyclictest131rcu_preempt23:23:153
3942406992919,5cyclictest391ktimers/320:09:383
3942406992919,4cyclictest131rcu_preempt00:08:223
3942406992918,9cyclictest391ktimers/320:20:133
3942406992918,3cyclictest131rcu_preempt21:30:013
3942406992916,5cyclictest131rcu_preempt22:15:223
3942406992915,8cyclictest131rcu_preempt21:58:273
3942406992915,10cyclictest391ktimers/320:50:183
3942406992910,5cyclictest3942387-21cyclictest22:37:213
3942402992922,3cyclictest0-21swapper/221:15:212
3942402992921,4cyclictest0-21swapper/222:20:002
3942397992923,3cyclictest0-21swapper/122:05:001
3942397992922,4cyclictest0-21swapper/119:55:001
3942393992921,4cyclictest4007242-21sed22:30:210
3942393992921,4cyclictest0-21swapper/020:25:000
3942393992919,6cyclictest4043914-21cron00:40:000
3942393992918,7cyclictest0-21swapper/000:30:260
394240699287,4cyclictest391ktimers/319:10:153
394240699282,6cyclictest391ktimers/319:30:183
3942406992819,6cyclictest0-21swapper/321:50:003
394240699281,8cyclictest40-21ksoftirqd/319:15:043
3942406992818,7cyclictest391ktimers/321:55:013
3942406992818,7cyclictest391ktimers/321:35:403
3942406992814,9cyclictest131rcu_preempt00:13:533
3942406992813,9cyclictest4017133-21kworker/u8:1-events_freezable_power_23:07:063
3942406992813,4cyclictest131rcu_preempt21:15:193
3942406992812,9cyclictest53-21kcompactd022:50:053
3942406992812,10cyclictest0-21swapper/320:02:403
3942402992820,4cyclictest0-21swapper/221:40:012
3942402992818,7cyclictest4017405-21sh23:10:002
394240299281,5cyclictest131rcu_preempt21:30:132
3942397992820,4cyclictest0-21swapper/121:50:201
3942393992824,2cyclictest13650irq/42-30be0000.ethernet00:20:180
3942393992821,4cyclictest0-21swapper/000:10:210
394240699271,8cyclictest40-21ksoftirqd/320:55:173
3942406992716,6cyclictest131rcu_preempt21:30:103
3942406992710,5cyclictest131rcu_preempt21:00:163
3942406992710,5cyclictest131rcu_preempt21:00:163
3942402992719,4cyclictest0-21swapper/221:00:172
3942402992719,4cyclictest0-21swapper/221:00:172
3942402992716,7cyclictest3983909-21grep21:10:282
3942402992715,9cyclictest440-21cron23:15:002
3942397992719,4cyclictest0-21swapper/119:50:001
3942397992718,6cyclictest4026731-21sh23:40:011
3942397992718,6cyclictest0-21swapper/121:20:171
3942406992611,8cyclictest131rcu_preempt20:37:373
3942406992611,4cyclictest131rcu_preempt00:18:453
3942402992620,3cyclictest0-21swapper/222:55:192
3942402992619,4cyclictest4039443-21unixbench_multi00:20:262
3942402992618,4cyclictest0-21swapper/223:25:012
3942402992617,4cyclictest0-21swapper/222:20:262
3942393992617,6cyclictest4012880-21ls22:50:210
3942393992617,6cyclictest3978587-21unixbench_singl20:55:260
3942393992613,10cyclictest4022528-21basename23:25:000
394240299253,7cyclictest3987726-21munin-run21:25:012
3942402992519,3cyclictest0-21swapper/221:05:242
3942402992519,3cyclictest0-21swapper/219:55:212
3942402992518,5cyclictest4022969-21kworker/u8:0+events_unbound23:27:422
3942402992518,4cyclictest3961807-21kworker/u8:0+events_unbound20:05:022
3942402992518,3cyclictest0-21swapper/220:15:232
3942402992518,3cyclictest0-21swapper/200:10:212
3942402992517,6cyclictest311ktimers/200:15:152
3942402992517,4cyclictest4030767-21auditctl23:55:002
3942402992517,4cyclictest0-21swapper/219:30:292
3942402992514,7cyclictest4026320-21grep23:35:272
3942397992518,3cyclictest0-21swapper/100:10:211
394239399259,13cyclictest4038227-21basename00:20:000
3942393992518,4cyclictest3984192-21taskset21:13:410
3942393992518,4cyclictest13650irq/42-30be0000.ethernet22:30:000
3942393992518,4cyclictest13650irq/42-30be0000.ethernet22:30:000
3942393992517,5cyclictest0-21swapper/021:50:200
3942393992516,5cyclictest0-21swapper/023:25:500
3942393992515,7cyclictest4031163-21uniq23:55:160
3942393992515,6cyclictest0-21swapper/022:00:000
3942397992417,4cyclictest3988764-21fschecks_time21:30:171
3942397992416,4cyclictest3983897-21head21:10:281
3942397992414,8cyclictest3942387-21cyclictest00:00:131
3942393992418,3cyclictest0-21swapper/022:15:010
3942393992417,5cyclictest3960071-21kworker/u8:1+events_unbound20:00:240
3942393992417,4cyclictest0-21swapper/020:10:010
3942393992417,3cyclictest0-21swapper/023:47:260
3942393992414,6cyclictest0-21swapper/023:40:230
394239399241,19cyclictest0-21swapper/022:24:350
394239399241,19cyclictest0-21swapper/021:26:430
394239399241,19cyclictest0-21swapper/000:29:160
394239399241,19cyclictest0-21swapper/000:29:160
3942402992317,3cyclictest0-21swapper/219:15:032
3942402992316,4cyclictest0-21swapper/219:40:272
3942402992316,3cyclictest0-21swapper/223:15:242
3942402992313,6cyclictest0-21swapper/220:10:012
3942402992312,8cyclictest3953124-21tr19:40:012
3942397992316,5cyclictest0-21swapper/121:20:001
3942397992316,4cyclictest3978530-21tail20:55:261
3942397992316,4cyclictest3942387-21cyclictest00:20:001
3942397992316,4cyclictest0-21swapper/121:35:171
3942397992314,6cyclictest0-21swapper/122:00:001
3942393992318,3cyclictest3955797-21sshd19:45:210
3942393992317,3cyclictest4011053-21sh22:45:000
3942393992317,3cyclictest0-21swapper/019:23:570
3942393992316,5cyclictest0-21swapper/019:51:080
3942393992316,3cyclictest0-21swapper/019:15:100
3942393992316,3cyclictest0-21swapper/000:06:200
3942393992315,5cyclictest121ktimers/022:06:110
3942393992314,5cyclictest0-21swapper/021:50:010
394239399231,18cyclictest0-21swapper/022:19:180
394239399231,18cyclictest0-21swapper/021:20:230
394239399231,18cyclictest0-21swapper/021:04:420
394239399231,18cyclictest0-21swapper/021:04:420
394239399230,19cyclictest0-21swapper/020:40:430
394239399230,19cyclictest0-21swapper/020:25:410
3942402992215,4cyclictest4027140-21fschecks_count23:40:142
3942402992215,3cyclictest0-21swapper/219:45:192
3942402992213,6cyclictest0-21swapper/220:50:232
3942402992212,8cyclictest4012769-21sed22:50:202
3942397992217,2cyclictest0-21swapper/122:15:171
3942397992216,3cyclictest0-21swapper/122:55:261
3942397992216,3cyclictest0-21swapper/120:45:011
3942397992215,4cyclictest3968606-21idleruntime-cro20:30:011
3942397992215,4cyclictest0-21swapper/120:30:211
3942397992215,4cyclictest0-21swapper/120:00:001
394239799221,13cyclictest0-21swapper/120:48:551
3942393992216,3cyclictest0-21swapper/023:00:150
3942393992215,3cyclictest0-21swapper/023:06:390
3942393992215,3cyclictest0-21swapper/022:45:540
3942393992215,3cyclictest0-21swapper/020:33:580
394239399221,3cyclictest0-21swapper/019:31:230
3942393992213,6cyclictest0-21swapper/019:55:170
3942402992114,5cyclictest3987627-21kworker/u8:2+events_unbound21:27:442
3942402992114,5cyclictest311ktimers/220:25:032
3942402992114,5cyclictest311ktimers/219:25:122
3942402992113,5cyclictest311ktimers/220:30:182
3942402992110,8cyclictest3972330-21awk20:40:152
3942397992116,3cyclictest4040550-21idleruntime-cro00:30:001
3942397992116,3cyclictest4040550-21idleruntime-cro00:30:001
3942397992115,4cyclictest2487715-1kworker/1:0H+kblockd22:40:011
3942397992115,3cyclictest0-21swapper/119:10:181
3942397992114,4cyclictest0-21swapper/121:00:261
3942397992114,4cyclictest0-21swapper/121:00:261
3942397992113,5cyclictest0-21swapper/123:50:121
3942397992111,5cyclictest3977367-21sort20:55:011
394239799211,12cyclictest0-21swapper/123:15:381
394239399211,16cyclictest0-21swapper/022:58:530
3942393992111,6cyclictest0-21swapper/021:30:260
3942402992014,3cyclictest0-21swapper/200:30:002
3942402992014,3cyclictest0-21swapper/200:30:002
3942402992010,7cyclictest4029219-21wc23:50:012
3942397992015,3cyclictest4022558-21apt-config23:25:001
3942397992014,4cyclictest4003859-21/usr/sbin/munin22:20:251
3942397992012,4cyclictest0-21swapper/100:10:001
3942397992010,7cyclictest4038996-21ntpq00:20:211
394240299199,7cyclictest4034950-21cat00:10:002
3942397991913,3cyclictest0-21swapper/120:35:231
3942397991912,4cyclictest231ktimers/122:05:021
3942397991911,5cyclictest0-21swapper/122:50:011
3942402991813,3cyclictest311ktimers/221:47:172
3942402991811,5cyclictest311ktimers/223:30:112
3942402991811,4cyclictest311ktimers/222:26:312
3942402991811,4cyclictest311ktimers/222:26:312
3942397991813,3cyclictest231ktimers/120:08:411
3942397991812,4cyclictest231ktimers/121:47:331
3942397991812,3cyclictest4029114-21latency_hist23:50:011
3942402991710,5cyclictest311ktimers/222:05:012
3942397991712,2cyclictest0-21swapper/122:26:521
3942397991712,2cyclictest0-21swapper/122:26:521
3942397991711,3cyclictest0-21swapper/121:40:141
394239799171,12cyclictest4017402-21cron23:10:001
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional