You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-04-03 - 11:25
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rack1slot1.osadl.org (updated Thu Apr 03, 2025 00:45:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
141432232158,26sleep30-21swapper/319:07:133
142182223158,25sleep10-21swapper/119:08:111
142962213157,25sleep20-21swapper/219:09:122
142842208150,44sleep00-21swapper/019:09:020
14459991512,3cyclictest28-21ksoftirqd/223:55:342
91032130,0sleep10-21swapper/120:05:131
14459991311,1cyclictest28-21ksoftirqd/222:40:002
1445499130,12cyclictest0-21swapper/119:30:161
14459991210,1cyclictest28-21ksoftirqd/222:50:152
1444999120,0cyclictest0-21swapper/000:10:160
14459991110,1cyclictest28-21ksoftirqd/222:00:202
14459991110,1cyclictest28-21ksoftirqd/221:34:592
14459991110,1cyclictest28-21ksoftirqd/200:15:002
1446799108,1cyclictest35-21ksoftirqd/319:49:593
1445999109,1cyclictest28-21ksoftirqd/223:50:142
1445999109,1cyclictest28-21ksoftirqd/223:20:202
1445999109,1cyclictest28-21ksoftirqd/220:50:002
1445999109,1cyclictest28-21ksoftirqd/219:35:012
1444999109,1cyclictest9-21ksoftirqd/022:15:000
144679997,1cyclictest35-21ksoftirqd/320:30:003
144599999,0cyclictest28-21ksoftirqd/222:55:232
144599998,1cyclictest28-21ksoftirqd/223:10:002
144599998,1cyclictest28-21ksoftirqd/222:26:492
144599998,1cyclictest28-21ksoftirqd/222:15:222
144599998,1cyclictest28-21ksoftirqd/222:10:172
144599998,1cyclictest28-21ksoftirqd/221:54:532
144599998,1cyclictest28-21ksoftirqd/221:49:462
144599998,1cyclictest28-21ksoftirqd/221:39:442
144599998,1cyclictest28-21ksoftirqd/221:29:242
144599998,1cyclictest28-21ksoftirqd/221:24:552
144599998,1cyclictest28-21ksoftirqd/221:17:002
144599998,1cyclictest28-21ksoftirqd/221:17:002
144599998,1cyclictest28-21ksoftirqd/200:34:282
144599998,1cyclictest28-21ksoftirqd/200:26:172
144599998,1cyclictest28-21ksoftirqd/200:06:262
144599998,1cyclictest28-21ksoftirqd/200:00:542
144599997,1cyclictest28-21ksoftirqd/223:35:002
144599997,1cyclictest28-21ksoftirqd/220:05:002
144599997,1cyclictest28-21ksoftirqd/200:20:222
144549990,8cyclictest0-21swapper/100:10:131
144499997,1cyclictest9-21ksoftirqd/020:20:110
144499991,4cyclictest15948-21sed20:20:010
144499991,4cyclictest12514-21perf22:00:010
144679987,1cyclictest35-21ksoftirqd/322:45:003
144679984,2cyclictest278-21systemd-udevd00:11:103
144679984,2cyclictest254-21systemd-journal23:55:543
144599988,0cyclictest28-21ksoftirqd/222:06:002
144599987,1cyclictest28-21ksoftirqd/223:48:222
144599987,1cyclictest28-21ksoftirqd/223:03:192
144599987,1cyclictest28-21ksoftirqd/222:47:432
144599987,1cyclictest28-21ksoftirqd/222:42:002
144599987,1cyclictest28-21ksoftirqd/221:59:212
144599987,1cyclictest28-21ksoftirqd/221:13:412
144599987,1cyclictest28-21ksoftirqd/219:10:152
144599987,1cyclictest28-21ksoftirqd/200:15:122
144599986,1cyclictest29752-21kworker/2:219:35:212
144599986,1cyclictest28-21ksoftirqd/222:20:052
144599986,1cyclictest28-21ksoftirqd/221:05:002
144599986,1cyclictest28-21ksoftirqd/219:40:192
144599983,2cyclictest254-21systemd-journal23:25:072
144549980,4cyclictest0-21swapper/121:40:131
144499986,1cyclictest9-21ksoftirqd/023:45:000
144499986,1cyclictest9-21ksoftirqd/023:45:000
144499986,1cyclictest9-21ksoftirqd/022:05:000
144499986,1cyclictest9-21ksoftirqd/000:01:220
144499984,1cyclictest9-21ksoftirqd/019:15:000
144499982,5cyclictest2650-21ssh21:45:150
144499982,5cyclictest1583-21perf19:50:010
144499980,7cyclictest8895-21ssh22:40:150
144499980,7cyclictest26890-21ssh21:35:030
144499980,7cyclictest20631-21ssh21:26:060
144499980,7cyclictest19241-21ssh00:25:080
144499980,7cyclictest0-21swapper/022:35:090
144499980,6cyclictest24822-21ssh21:31:010
144499980,1cyclictest31127-21ssh23:55:270
144499980,1cyclictest23246-21apt-get23:00:140
26968275,1sleep335-21ksoftirqd/320:40:213
23025270,0sleep07461-21diskmemload22:15:090
17399270,1sleep30-21swapper/300:21:173
144679976,1cyclictest16383-21ntpq23:35:173
144679975,1cyclictest5315-21apt-get21:05:023
144679975,1cyclictest2757-21ssh22:30:433
144679973,3cyclictest0-21swapper/321:17:023
144679973,3cyclictest0-21swapper/321:17:023
144679972,4cyclictest557-21nscd19:26:573
144679970,6cyclictest844-21ssh21:41:183
144679970,4cyclictest14883-21/usr/sbin/munin22:50:093
144679970,4cyclictest0-21swapper/300:09:233
144599977,0cyclictest28-21ksoftirqd/219:55:122
144599977,0cyclictest28-21ksoftirqd/200:35:252
144599976,1cyclictest60950irq/123-eno122:30:302
144599976,1cyclictest60950irq/123-eno120:55:122
144599976,1cyclictest29752-21kworker/2:220:35:152
144599976,1cyclictest29752-21kworker/2:219:50:152
144599976,1cyclictest29752-21kworker/2:219:15:202
144599976,1cyclictest28-21ksoftirqd/223:40:222
144599976,1cyclictest28-21ksoftirqd/223:40:212
144599976,1cyclictest28-21ksoftirqd/223:15:342
144599976,1cyclictest28-21ksoftirqd/223:11:512
144599976,1cyclictest28-21ksoftirqd/221:42:162
144599976,1cyclictest28-21ksoftirqd/220:40:012
144599976,1cyclictest28-21ksoftirqd/220:10:172
144599976,1cyclictest28-21ksoftirqd/220:05:192
144599975,1cyclictest20093-21aten_r1power_cu19:20:122
144599974,0cyclictest7461-21diskmemload23:35:152
144599970,7cyclictest0-21swapper/220:30:222
144549970,6cyclictest0-21swapper/121:50:081
144549970,4cyclictest0-21swapper/123:07:261
144549970,4cyclictest0-21swapper/120:40:211
144549970,3cyclictest0-21swapper/122:30:001
144499976,1cyclictest8138-21ssh23:23:290
144499976,1cyclictest15972-21ssh21:20:040
144499975,1cyclictest22209-21fschecks_time00:30:100
144499971,6cyclictest26675-21ssh23:50:150
144499971,1cyclictest11908-21aten_r1power_fr21:15:130
144499971,1cyclictest11908-21aten_r1power_fr21:15:120
144499970,6cyclictest9007-21ssh23:25:060
144499970,6cyclictest5733-21irqstats21:50:110
144499970,6cyclictest31574-21runrttasks22:26:430
144499970,6cyclictest2761-21ssh22:30:420
144499970,6cyclictest24569-21ssh23:48:510
144499970,6cyclictest20357-1kworker/u9:021:40:180
144499970,6cyclictest16738-21ssh22:50:250
144499970,6cyclictest12872-21ssh22:45:400
144499970,5cyclictest0-21swapper/023:35:050
144499970,1cyclictest6145-21ssh00:08:030
144499970,1cyclictest29282-21ssh22:21:320
144499970,1cyclictest27623-21ssh23:05:490
144499970,1cyclictest21658-21ssh22:57:240
144499970,1cyclictest17236-21ssh22:06:030
144499970,1cyclictest0-21swapper/023:31:240
144499970,1cyclictest0-21swapper/023:15:110
144499970,1cyclictest0-21swapper/023:10:130
144499970,1cyclictest0-21swapper/021:10:190
144499970,1cyclictest0-21swapper/000:15:180
144679965,1cyclictest9680-21ssh21:10:563
144679965,1cyclictest7644-21ssh21:52:533
144679965,1cyclictest7061-21ssh23:20:453
144679965,1cyclictest3364-21ssh23:16:293
144679965,1cyclictest32181-21ssh23:12:213
144679965,1cyclictest30911-21ssh22:25:023
144679965,1cyclictest27518-21ssh00:35:473
144679965,1cyclictest25096-21ssh22:16:003
144679965,1cyclictest24604-21ssh21:30:333
144679965,1cyclictest23183-21ssh23:45:213
144679965,1cyclictest21243-21ssh22:56:203
144679965,1cyclictest20224-21ssh21:25:133
144679965,1cyclictest19459-21ssh00:25:423
144679965,1cyclictest14834-21ssh22:01:063
144679965,1cyclictest12773-21ssh23:30:223
144679964,1cyclictest35-21ksoftirqd/320:50:013
144679964,0cyclictest7461-21diskmemload23:25:503
144679963,1cyclictest254-21systemd-journal23:50:003
144679963,1cyclictest254-21systemd-journal23:44:563
144679963,1cyclictest254-21systemd-journal23:44:553
144679963,1cyclictest254-21systemd-journal22:39:363
144679963,1cyclictest254-21systemd-journal22:20:503
144679962,1cyclictest254-21systemd-journal21:49:203
144679961,4cyclictest0-21swapper/320:50:153
144679960,6cyclictest7461-21diskmemload21:20:273
144679960,6cyclictest0-21swapper/321:35:013
144679960,4cyclictest0-21swapper/322:12:173
144679960,4cyclictest0-21swapper/322:07:333
144679960,3cyclictest0-21swapper/323:05:393
144679960,1cyclictest24483-21/usr/sbin/munin23:00:233
144679960,1cyclictest0-21swapper/320:15:123
144679960,0cyclictest0-21swapper/300:32:443
144599966,0cyclictest60950irq/123-eno120:20:112
144599966,0cyclictest60950irq/123-eno119:27:552
144599966,0cyclictest28-21ksoftirqd/220:25:132
144599966,0cyclictest28-21ksoftirqd/220:15:212
144599965,1cyclictest29752-21kworker/2:220:50:252
144599965,1cyclictest29752-21kworker/2:219:45:132
144599965,1cyclictest28-21ksoftirqd/221:05:002
144549963,1cyclictest0-21swapper/119:35:231
144549961,3cyclictest0-21swapper/122:42:291
144549961,3cyclictest0-21swapper/119:45:121
144549960,4cyclictest0-21swapper/122:14:201
144549960,4cyclictest0-21swapper/122:00:031
144549960,3cyclictest0-21swapper/122:15:171
144549960,2cyclictest0-21swapper/123:18:181
144499965,1cyclictest17204-21ntpq19:15:000
144499963,1cyclictest9-21ksoftirqd/020:46:320
144499963,1cyclictest9-21ksoftirqd/019:36:010
144499960,6cyclictest0-21swapper/020:30:270
144499960,6cyclictest0-21swapper/019:56:090
144499960,6cyclictest0-21swapper/019:52:280
144499960,5cyclictest26188-21ssh00:35:170
144499960,5cyclictest0-21swapper/021:00:160
144499960,1cyclictest17818-21ssh00:22:190
144499960,1cyclictest0-21swapper/020:10:180
144499960,0cyclictest0-21swapper/021:05:010
24007250,0sleep10-21swapper/123:47:251
144679955,0cyclictest0-21swapper/320:21:043
144679954,1cyclictest11151-21ssh00:15:043
144679953,1cyclictest742-21runrttasks22:48:203
144679953,1cyclictest1936-21sed20:55:213
144679952,1cyclictest9625-21grep20:05:173
144679951,3cyclictest4097-21/usr/sbin/munin21:00:183
144679951,2cyclictest7461-21diskmemload21:55:033
144679950,5cyclictest0-21swapper/319:42:463
144679950,5cyclictest0-21swapper/319:15:353
144679950,3cyclictest27050-21latency_hist19:35:003
144679950,2cyclictest4328-21apt-get19:55:103
144679950,2cyclictest0-21swapper/319:50:213
144679950,1cyclictest2582-21/usr/sbin/munin00:00:223
144679950,1cyclictest254-21systemd-journal20:34:173
144549955,0cyclictest0-21swapper/123:11:341
144549955,0cyclictest0-21swapper/100:31:121
144549954,1cyclictest0-21swapper/121:35:101
144549954,1cyclictest0-21swapper/100:35:131
144549953,1cyclictest14460-21chrt00:18:541
144549951,3cyclictest0-21swapper/122:55:171
144549951,3cyclictest0-21swapper/121:55:101
144549951,1cyclictest0-21swapper/123:33:381
144549950,5cyclictest0-21swapper/123:54:211
144549950,5cyclictest0-21swapper/100:03:561
144549950,4cyclictest0-21swapper/123:39:161
144549950,4cyclictest0-21swapper/120:35:221
144549950,3cyclictest22062-21chrt21:29:201
144549950,3cyclictest0-21swapper/123:41:121
144549950,3cyclictest0-21swapper/123:41:121
144549950,3cyclictest0-21swapper/121:47:571
144549950,3cyclictest0-21swapper/121:19:441
144549950,3cyclictest0-21swapper/121:19:431
144549950,3cyclictest0-21swapper/120:25:121
144549950,3cyclictest0-21swapper/119:50:011
144549950,3cyclictest0-21swapper/100:25:501
144549950,2cyclictest0-21swapper/123:55:161
144549950,2cyclictest0-21swapper/123:27:111
144549950,2cyclictest0-21swapper/123:23:341
144549950,1cyclictest0-21swapper/122:50:101
144549950,1cyclictest0-21swapper/122:20:151
144549950,1cyclictest0-21swapper/121:30:191
144549950,0cyclictest0-21swapper/122:38:271
144549950,0cyclictest0-21swapper/122:30:161
144499955,0cyclictest0-21swapper/019:40:190
144499953,1cyclictest7782-21grep20:00:170
144499952,1cyclictest254-21systemd-journal20:05:000
144499950,5cyclictest0-21swapper/020:53:280
144499950,5cyclictest0-21swapper/019:25:150
144499950,4cyclictest27428-21grep20:40:220
144499950,4cyclictest23193-21/usr/sbin/munin20:35:120
144499950,4cyclictest20190-21telnet19:20:130
144499950,2cyclictest254-21systemd-journal21:00:000
144499950,0cyclictest0-21swapper/019:30:150
144679944,0cyclictest28521-21sensors19:35:213
144679943,1cyclictest35-21ksoftirqd/320:10:063
144679942,1cyclictest20430-21expr19:20:143
144679940,4cyclictest6703-21chrt20:00:113
144679940,2cyclictest0-21swapper/320:35:093
144679940,2cyclictest0-21swapper/319:10:213
144549943,0cyclictest0-21swapper/119:10:131
144549942,1cyclictest0-21swapper/120:20:121
144549941,2cyclictest0-21swapper/120:00:101
144549941,2cyclictest0-21swapper/119:20:131
144549941,1cyclictest0-21swapper/121:10:141
144549941,1cyclictest0-21swapper/120:55:011
144549941,1cyclictest0-21swapper/119:30:011
144549940,3cyclictest0-21swapper/122:45:141
144549940,3cyclictest0-21swapper/119:55:101
144549940,3cyclictest0-21swapper/100:05:161
144549940,2cyclictest0-21swapper/120:15:191
144549940,2cyclictest0-21swapper/100:20:141
144549940,1cyclictest0-21swapper/123:00:161
144549940,1cyclictest0-21swapper/122:05:381
144549940,1cyclictest0-21swapper/121:20:391
144549940,0cyclictest0-21swapper/120:55:201
144549940,0cyclictest0-21swapper/119:15:011
144499943,1cyclictest9-21ksoftirqd/020:25:110
144549932,1cyclictest0-21swapper/120:30:151
144549932,1cyclictest0-21swapper/120:10:191
144549931,1cyclictest0-21swapper/121:05:001
144549931,1cyclictest0-21swapper/120:45:141
144549930,2cyclictest0-21swapper/121:00:111
144549930,1cyclictest0-21swapper/119:40:111
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional