You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-04-02 - 08:08
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rack1slot1.osadl.org (updated Wed Apr 02, 2025 00:45:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
151662214149,23sleep00-21swapper/019:09:050
151272201165,22sleep10-21swapper/119:08:351
151732200161,26sleep20-21swapper/219:09:112
151292197160,24sleep30-21swapper/319:08:363
275562700,0sleep10-21swapper/123:55:181
34792150,0sleep20-21swapper/200:08:572
15343991515,0cyclictest35-21ksoftirqd/300:20:123
15336991515,0cyclictest28-21ksoftirqd/222:40:282
15343991414,0cyclictest0-21swapper/323:59:343
15336991412,1cyclictest28-21ksoftirqd/219:15:012
15336991313,0cyclictest0-21swapper/223:10:072
15336991311,1cyclictest28-21ksoftirqd/223:55:002
15343991211,1cyclictest35-21ksoftirqd/323:35:003
15343991211,1cyclictest35-21ksoftirqd/321:50:153
15336991210,1cyclictest28-21ksoftirqd/223:55:132
15336991210,1cyclictest28-21ksoftirqd/219:25:002
15336991210,1cyclictest28-21ksoftirqd/200:30:172
15333991212,0cyclictest0-21swapper/123:10:081
1533299121,6cyclictest26410-21apt-get23:55:130
1534399119,1cyclictest35-21ksoftirqd/322:25:003
1534399119,1cyclictest35-21ksoftirqd/320:10:003
15343991110,1cyclictest35-21ksoftirqd/322:40:003
15343991110,1cyclictest35-21ksoftirqd/321:40:163
1533699119,1cyclictest28-21ksoftirqd/223:40:182
1533699119,1cyclictest28-21ksoftirqd/223:05:002
1533699119,1cyclictest28-21ksoftirqd/220:30:002
1533699119,1cyclictest28-21ksoftirqd/220:00:142
15336991110,1cyclictest28-21ksoftirqd/222:35:002
15336991110,1cyclictest28-21ksoftirqd/221:00:012
15336991110,1cyclictest28-21ksoftirqd/220:15:222
1533299119,2cyclictest29811-21apt20:55:010
1534399109,1cyclictest35-21ksoftirqd/321:15:013
1534399108,1cyclictest35-21ksoftirqd/322:00:123
1534399108,1cyclictest35-21ksoftirqd/300:10:003
1534399107,1cyclictest35-21ksoftirqd/319:40:003
1534399100,5cyclictest26361-21latency_hist23:10:003
1533699109,1cyclictest28-21ksoftirqd/223:33:142
1533699109,1cyclictest28-21ksoftirqd/222:15:142
1533699109,1cyclictest28-21ksoftirqd/221:46:282
1533699109,1cyclictest28-21ksoftirqd/220:20:182
1533699109,1cyclictest28-21ksoftirqd/220:20:182
1533699109,1cyclictest28-21ksoftirqd/219:45:162
1533699108,1cyclictest28-21ksoftirqd/222:36:362
1533699108,1cyclictest28-21ksoftirqd/222:03:142
1533699108,1cyclictest28-21ksoftirqd/221:30:182
1533299102,4cyclictest1642-21latency_hist00:04:590
1533299100,9cyclictest28002-21latency_hist21:40:000
8817296,1sleep09-21ksoftirqd/000:15:160
4483290,1sleep20-21swapper/221:51:562
153439998,1cyclictest35-21ksoftirqd/323:20:003
153439998,1cyclictest35-21ksoftirqd/320:50:003
153439997,1cyclictest35-21ksoftirqd/322:35:163
153439997,1cyclictest35-21ksoftirqd/320:20:003
153439997,1cyclictest21981-21ssh23:49:373
153439992,6cyclictest9819-21kworker/u8:219:41:293
153369998,1cyclictest28-21ksoftirqd/223:35:152
153369998,1cyclictest28-21ksoftirqd/222:53:472
153369998,1cyclictest28-21ksoftirqd/222:46:312
153369998,1cyclictest28-21ksoftirqd/222:20:162
153369998,1cyclictest28-21ksoftirqd/222:07:072
153369998,1cyclictest28-21ksoftirqd/221:35:502
153369998,1cyclictest28-21ksoftirqd/221:27:302
153369998,1cyclictest28-21ksoftirqd/221:15:112
153369998,1cyclictest28-21ksoftirqd/219:25:132
153369998,1cyclictest28-21ksoftirqd/219:25:132
153369998,1cyclictest28-21ksoftirqd/200:23:112
153369998,1cyclictest28-21ksoftirqd/200:18:432
153369998,1cyclictest28-21ksoftirqd/200:12:052
153369998,1cyclictest28-21ksoftirqd/200:02:332
153369997,1cyclictest28-21ksoftirqd/223:09:592
153369997,1cyclictest28-21ksoftirqd/221:42:492
153369997,1cyclictest28-21ksoftirqd/221:20:202
153369997,1cyclictest28-21ksoftirqd/220:55:172
153329993,3cyclictest5752-21perf21:55:010
153329990,7cyclictest254-21systemd-journal23:40:260
153329990,4cyclictest20076-21apt-get21:30:120
153439988,0cyclictest35-21ksoftirqd/323:10:003
153439988,0cyclictest35-21ksoftirqd/323:00:143
153439988,0cyclictest35-21ksoftirqd/321:35:163
153439988,0cyclictest35-21ksoftirqd/319:45:133
153439988,0cyclictest35-21ksoftirqd/300:30:203
153439987,1cyclictest35-21ksoftirqd/300:04:593
153439982,5cyclictest4658-21diskmemload21:48:283
153439981,4cyclictest4658-21diskmemload21:30:043
153369988,0cyclictest28-21ksoftirqd/220:34:552
153369987,1cyclictest28-21ksoftirqd/223:49:492
153369987,1cyclictest28-21ksoftirqd/223:18:332
153369987,1cyclictest28-21ksoftirqd/222:56:332
153369987,1cyclictest28-21ksoftirqd/222:27:082
153369987,1cyclictest28-21ksoftirqd/221:13:262
153369987,1cyclictest28-21ksoftirqd/219:55:202
153369987,1cyclictest28-21ksoftirqd/200:25:452
153369986,1cyclictest28-21ksoftirqd/221:55:152
153369986,1cyclictest28-21ksoftirqd/220:45:122
153369986,1cyclictest28-21ksoftirqd/219:55:002
153369983,3cyclictest28-21ksoftirqd/200:37:342
153369982,5cyclictest18381-21runrttasks22:11:262
153369980,2cyclictest0-21swapper/223:30:002
153339981,4cyclictest200-21jbd2/sda2-823:16:471
153329986,1cyclictest9-21ksoftirqd/019:25:000
153329983,4cyclictest16123-21idleruntime-cro00:25:010
153329980,7cyclictest743-21ssh21:47:270
153329980,7cyclictest26269-21ssh00:39:370
153329980,7cyclictest18362-21latency_hist00:30:000
153329980,7cyclictest16789-21ssh21:23:500
153329980,1cyclictest4859-21ssh22:38:330
153329980,1cyclictest0-21swapper/023:14:080
30852270,0sleep10-21swapper/100:00:151
153439977,0cyclictest35-21ksoftirqd/323:50:073
153439977,0cyclictest35-21ksoftirqd/323:20:433
153439977,0cyclictest35-21ksoftirqd/322:29:553
153439977,0cyclictest35-21ksoftirqd/322:15:133
153439977,0cyclictest35-21ksoftirqd/320:30:103
153439977,0cyclictest35-21ksoftirqd/319:25:143
153439977,0cyclictest35-21ksoftirqd/319:25:133
153439977,0cyclictest35-21ksoftirqd/300:10:113
153439976,1cyclictest35-21ksoftirqd/321:55:213
153439976,1cyclictest35-21ksoftirqd/320:30:003
153439976,1cyclictest35-21ksoftirqd/319:55:143
153439976,1cyclictest35-21ksoftirqd/319:15:023
153439971,5cyclictest4658-21diskmemload22:33:583
153439971,2cyclictest0-21swapper/300:35:273
153439971,0cyclictest4658-21diskmemload22:55:103
153439970,6cyclictest6290-21ssh23:25:383
153369976,1cyclictest60950irq/123-eno120:51:152
153369976,1cyclictest28-21ksoftirqd/223:20:252
153369976,1cyclictest28-21ksoftirqd/220:40:142
153369975,1cyclictest28-21ksoftirqd/221:05:162
153369975,1cyclictest28-21ksoftirqd/219:15:002
153339977,0cyclictest21-21ksoftirqd/100:20:011
153339971,3cyclictest0-21swapper/100:15:131
153339970,6cyclictest0-21swapper/122:30:161
153339970,4cyclictest0-21swapper/123:35:191
153339970,0cyclictest0-21swapper/122:40:151
153329976,1cyclictest9-21ksoftirqd/000:10:010
153329976,1cyclictest6141-21telnet22:40:130
153329976,1cyclictest29579-21ssh22:29:060
153329976,1cyclictest17610-21ssh21:25:140
153329975,1cyclictest5264-21ssh23:23:370
153329975,1cyclictest23199-21gltestperf23:50:100
153329973,3cyclictest16868-21grep22:10:110
153329972,3cyclictest0-21swapper/021:00:120
153329972,1cyclictest16082-21ssh22:55:050
153329971,2cyclictest0-21swapper/019:50:190
153329970,6cyclictest9969-21apt22:00:090
153329970,6cyclictest8538-21ssh21:14:450
153329970,6cyclictest25853-21apt-get19:30:150
153329970,6cyclictest25025-21ssh23:07:100
153329970,6cyclictest24023-21ssh22:20:060
153329970,6cyclictest21415-21ssh23:48:110
153329970,6cyclictest15230-21cat20:20:000
153329970,6cyclictest12337-21ssh21:18:180
153329970,6cyclictest11776-21ssh23:34:300
153329970,6cyclictest0-21swapper/021:40:270
153329970,5cyclictest0-21swapper/020:40:120
153329970,4cyclictest4717-21perf21:10:010
153329970,4cyclictest0-21swapper/021:56:490
153329970,1cyclictest4658-21diskmemload22:06:400
153329970,1cyclictest3621-21ssh00:09:170
153329970,1cyclictest32171-21munin-run21:00:000
153329970,1cyclictest21004-21ssh00:31:460
153329970,1cyclictest0-21swapper/023:27:110
153329970,1cyclictest0-21swapper/022:15:280
153439966,0cyclictest35-21ksoftirqd/320:20:153
153439966,0cyclictest35-21ksoftirqd/320:20:143
153439966,0cyclictest35-21ksoftirqd/300:15:163
153439965,1cyclictest35-21ksoftirqd/322:50:153
153439965,1cyclictest35-21ksoftirqd/321:15:003
153439965,1cyclictest18433-21ssh23:41:193
153439965,1cyclictest16413-21ssh00:25:123
153439965,1cyclictest15730-21ssh21:21:273
153439964,1cyclictest35-21ksoftirqd/320:40:153
153439964,1cyclictest32144-21idleruntime-cro21:00:003
153439964,1cyclictest3071-21/usr/sbin/munin19:50:193
153439963,1cyclictest570-21systemd-logind19:15:003
153439963,1cyclictest254-21systemd-journal21:09:373
153439963,1cyclictest254-21systemd-journal20:50:223
153439962,1cyclictest17683-21ssh21:25:223
153439961,3cyclictest0-21swapper/323:35:203
153439961,0cyclictest4658-21diskmemload22:48:483
153439960,3cyclictest4658-21diskmemload22:10:083
153439960,1cyclictest0-21swapper/322:05:583
153439960,1cyclictest0-21swapper/320:10:163
153369966,0cyclictest17679-21kworker/2:220:10:102
153369964,1cyclictest28-21ksoftirqd/220:10:002
153369960,4cyclictest0-21swapper/219:30:152
153339964,1cyclictest0-21swapper/119:10:121
153339961,4cyclictest200-21jbd2/sda2-821:54:291
153339961,1cyclictest26094-21chrt23:09:521
153339960,6cyclictest0-21swapper/122:00:191
153339960,6cyclictest0-21swapper/121:40:131
153339960,6cyclictest0-21swapper/120:40:161
153339960,5cyclictest0-21swapper/119:45:321
153339960,4cyclictest0-21swapper/123:50:271
153339960,4cyclictest0-21swapper/100:13:321
153339960,3cyclictest0-21swapper/121:38:511
153339960,3cyclictest0-21swapper/121:11:161
153339960,2cyclictest0-21swapper/123:25:241
153339960,2cyclictest0-21swapper/100:32:251
153339960,1cyclictest203292sleep123:45:281
153339960,0cyclictest0-21swapper/123:30:391
153339960,0cyclictest0-21swapper/119:50:241
153329965,1cyclictest31699-21ntpq19:40:180
153329962,2cyclictest4658-21diskmemload22:30:200
153329960,6cyclictest0-21swapper/022:50:010
153329960,6cyclictest0-21swapper/020:33:390
153329960,6cyclictest0-21swapper/020:20:190
153329960,6cyclictest0-21swapper/020:20:180
153329960,6cyclictest0-21swapper/020:02:230
153329960,6cyclictest0-21swapper/019:18:430
153329960,5cyclictest802-1kworker/u9:023:00:220
153329960,5cyclictest15524-21/usr/sbin/munin19:10:160
153329960,5cyclictest0-21swapper/023:35:060
153329960,3cyclictest4658-21diskmemload23:15:010
153329960,2cyclictest23588-21aten_r1power_fr19:25:130
153329960,2cyclictest23588-21aten_r1power_fr19:25:120
153329960,0cyclictest0-21swapper/022:45:230
153329960,0cyclictest0-21swapper/019:37:320
23221250,1sleep121-21ksoftirqd/121:33:191
153439955,0cyclictest35-21ksoftirqd/319:30:163
153439954,1cyclictest35-21ksoftirqd/320:00:193
153439953,1cyclictest21860-21/usr/sbin/munin19:20:153
153439950,2cyclictest0-21swapper/320:35:113
153369955,0cyclictest60950irq/123-eno120:37:122
153369954,1cyclictest28-21ksoftirqd/219:35:132
153369950,5cyclictest0-21swapper/219:40:162
153339955,0cyclictest0-21swapper/122:56:071
153339955,0cyclictest0-21swapper/119:20:231
153339955,0cyclictest0-21swapper/100:35:521
153339953,1cyclictest0-21swapper/120:55:121
153339952,1cyclictest0-21swapper/122:11:081
153339952,0cyclictest0-21swapper/121:47:281
153339951,2cyclictest0-21swapper/123:03:511
153339950,5cyclictest0-21swapper/122:21:501
153339950,5cyclictest0-21swapper/119:25:171
153339950,5cyclictest0-21swapper/119:25:161
153339950,4cyclictest0-21swapper/123:41:461
153339950,4cyclictest0-21swapper/122:36:121
153339950,4cyclictest0-21swapper/100:07:251
153339950,3cyclictest0-21swapper/122:52:411
153339950,3cyclictest0-21swapper/121:55:541
153339950,2cyclictest0-21swapper/122:48:521
153339950,2cyclictest0-21swapper/100:29:561
153339950,1cyclictest0-21swapper/122:17:291
153339950,0cyclictest0-21swapper/123:20:141
153339950,0cyclictest0-21swapper/121:20:141
153339950,0cyclictest0-21swapper/121:00:541
153339950,0cyclictest0-21swapper/120:45:111
153339950,0cyclictest0-21swapper/120:39:001
153329954,1cyclictest1734-21head19:45:180
153329950,5cyclictest0-21swapper/020:10:170
153329950,4cyclictest5205-21/usr/sbin/munin19:55:130
153329950,4cyclictest0-21swapper/020:35:130
153329950,1cyclictest25328-21/usr/sbin/munin20:45:140
153329950,0cyclictest0-21swapper/020:05:310
153439944,0cyclictest35-21ksoftirqd/321:00:153
153339944,0cyclictest0-21swapper/120:30:371
153339944,0cyclictest0-21swapper/120:15:021
153339944,0cyclictest0-21swapper/119:15:291
153339942,1cyclictest30262-21chrt19:39:291
153339941,1cyclictest0-21swapper/121:25:371
153339940,4cyclictest0-21swapper/120:25:001
153339940,4cyclictest0-21swapper/120:25:001
153339940,4cyclictest0-21swapper/120:10:151
153339940,3cyclictest0-21swapper/122:05:061
153339940,2cyclictest0-21swapper/121:17:461
153339940,1cyclictest0-21swapper/122:25:341
153339940,1cyclictest0-21swapper/121:05:121
153339940,1cyclictest0-21swapper/119:55:131
153329940,4cyclictest0-21swapper/020:25:180
153339933,0cyclictest0-21swapper/120:00:121
153339932,1cyclictest9916-21chrt20:05:001
153339932,1cyclictest27744-21chrt19:32:201
153339932,1cyclictest276922sleep120:50:181
153339930,2cyclictest0-21swapper/119:40:201
153339930,0cyclictest0-21swapper/120:26:151
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional