You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-11-22 - 08:57
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Fri Nov 22, 2024 00:43:28)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
292972740,0sleep40-21swapper/423:02:474
961625241,8sleep20-21swapper/219:05:502
725725241,8sleep30-21swapper/319:02:303
945224925,8sleep70-21swapper/719:03:397
964024825,8sleep60-21swapper/619:06:106
775624628,13sleep40-21swapper/419:02:394
53782460,0sleep40-21swapper/423:55:334
165502460,0sleep20-21swapper/222:14:232
221022450,0sleep50-21swapper/500:35:385
47992440,0sleep00-21swapper/023:35:340
282232440,0sleep40-21swapper/423:58:134
140412440,0sleep50-21swapper/523:12:495
259742420,2sleep5986099cyclictest22:50:305
940124129,8sleep50-21swapper/519:02:565
92652410,0sleep60-21swapper/623:00:256
38992410,0sleep30-21swapper/321:46:213
170882410,0sleep10-21swapper/122:53:151
953424027,9sleep00-21swapper/019:04:440
257102400,0sleep10-21swapper/100:06:031
257102400,0sleep10-21swapper/100:06:031
202632400,0sleep50-21swapper/522:14:515
293522390,0sleep30-21swapper/300:18:383
725523826,8sleep10-21swapper/119:02:281
165312380,0sleep50-21swapper/522:53:115
9844993231,1cyclictest10911-21kworker/1:123:33:291
9843992927,1cyclictest26055-21kworker/0:322:29:460
9844992828,0cyclictest24314-21kworker/1:522:36:471
9844992323,0cyclictest12587-21kworker/1:219:34:281
9844992019,1cyclictest12587-21kworker/1:220:12:251
986999190,17cyclictest8688-21bash22:13:247
984399193,15cyclictest481-21grepconf.sh22:43:100
9844991817,1cyclictest4733-21kworker/1:323:47:311
9844991817,1cyclictest18430-21kworker/1:323:11:271
188092180,0sleep60-21swapper/621:59:386
100082180,0sleep50-21swapper/523:28:115
9844991716,1cyclictest24314-21kworker/1:522:21:011
9843991717,0cyclictest0-21swapper/000:36:080
985199160,13cyclictest21968-21sshd00:35:373
9845991615,1cyclictest33-21ksoftirqd/223:19:522
9845991611,4cyclictest33-21ksoftirqd/221:46:262
9845991611,2cyclictest33-21ksoftirqd/200:24:022
9844991615,1cyclictest15230-21kworker/1:521:25:431
9844991614,1cyclictest25-21ksoftirqd/121:18:361
9844991613,2cyclictest31356-21bash22:27:341
984499160,15cyclictest23554-21kworker/1:222:24:231
9843991611,2cyclictest21797-21grepconf.sh23:41:350
984399160,13cyclictest711-21dbus-daemon23:09:440
984399160,1cyclictest22218-21kworker/0:222:50:440
229632160,0sleep60-21swapper/600:01:436
9869991514,1cyclictest73-21ksoftirqd/722:22:447
986999150,12cyclictest99-21kswapd021:20:407
986099150,15cyclictest0-21swapper/520:37:415
986099150,15cyclictest0-21swapper/520:37:415
985499150,13cyclictest1129-21sshd22:12:394
9845991514,1cyclictest33-21ksoftirqd/223:03:492
9845991513,1cyclictest33-21ksoftirqd/223:38:092
9845991513,1cyclictest33-21ksoftirqd/223:08:012
9845991513,1cyclictest33-21ksoftirqd/222:48:052
9845991513,1cyclictest33-21ksoftirqd/222:33:092
9845991511,3cyclictest33-21ksoftirqd/223:51:552
984599150,2cyclictest121rcu_preempt23:46:142
9844991514,1cyclictest22226-21kworker/1:221:15:191
9844991513,1cyclictest25-21ksoftirqd/123:21:221
9843991513,1cyclictest26870-21bash22:38:220
984399150,13cyclictest23224-21bash22:54:060
984399150,12cyclictest13092-21sshd00:29:540
95842150,1sleep09589-21gltestperf22:32:390
9869991413,1cyclictest73-21ksoftirqd/723:38:577
9869991412,1cyclictest73-21ksoftirqd/700:11:247
9845991414,0cyclictest13450irq/24-ahci[00022:43:032
9845991413,1cyclictest33-21ksoftirqd/222:29:002
9845991413,1cyclictest33-21ksoftirqd/222:25:552
9845991413,1cyclictest33-21ksoftirqd/222:05:402
9845991413,1cyclictest33-21ksoftirqd/221:52:182
9845991412,2cyclictest33-21ksoftirqd/223:59:222
9845991412,2cyclictest33-21ksoftirqd/221:57:402
9845991412,1cyclictest33-21ksoftirqd/223:28:552
9845991412,1cyclictest33-21ksoftirqd/223:12:392
9845991412,1cyclictest33-21ksoftirqd/222:21:552
9845991412,1cyclictest33-21ksoftirqd/222:07:522
9845991412,1cyclictest33-21ksoftirqd/221:52:282
9845991412,1cyclictest33-21ksoftirqd/221:12:442
9845991412,1cyclictest33-21ksoftirqd/221:12:042
9845991412,1cyclictest33-21ksoftirqd/200:22:232
9845991412,1cyclictest33-21ksoftirqd/200:06:082
9845991412,1cyclictest33-21ksoftirqd/200:06:082
984599140,1cyclictest131rcu_sched00:12:432
9844991413,1cyclictest25-21ksoftirqd/100:22:321
9844991413,1cyclictest16417-21kworker/1:022:12:111
9844991410,1cyclictest25-21ksoftirqd/122:38:111
9843991412,1cyclictest9-21ksoftirqd/000:26:260
9869991312,1cyclictest73-21ksoftirqd/723:47:127
9869991312,1cyclictest73-21ksoftirqd/723:27:457
9869991312,1cyclictest73-21ksoftirqd/723:05:547
9869991312,1cyclictest73-21ksoftirqd/722:56:387
9869991312,1cyclictest73-21ksoftirqd/700:12:387
9869991311,1cyclictest73-21ksoftirqd/723:52:277
9869991311,1cyclictest73-21ksoftirqd/722:57:357
9869991311,1cyclictest73-21ksoftirqd/721:40:417
984599139,3cyclictest33-21ksoftirqd/222:37:472
984599139,1cyclictest33-21ksoftirqd/221:37:362
984599138,3cyclictest33-21ksoftirqd/200:37:252
9845991313,0cyclictest13450irq/24-ahci[00020:02:432
9845991312,1cyclictest33-21ksoftirqd/221:27:442
9845991312,1cyclictest33-21ksoftirqd/221:22:102
9845991312,1cyclictest33-21ksoftirqd/219:37:402
9845991311,1cyclictest33-21ksoftirqd/223:02:272
9845991311,1cyclictest33-21ksoftirqd/221:24:032
9845991311,1cyclictest33-21ksoftirqd/200:07:422
9845991310,2cyclictest861-21gdbus22:56:312
9844991312,1cyclictest25410-21kworker/1:100:01:131
9844991312,1cyclictest25-21ksoftirqd/123:42:131
9844991312,1cyclictest25-21ksoftirqd/121:56:121
9844991312,1cyclictest24314-21kworker/1:522:13:451
9844991312,1cyclictest12254-21kworker/1:321:58:391
9844991311,1cyclictest25-21ksoftirqd/122:57:281
9844991310,3cyclictest25-21ksoftirqd/123:12:441
9844991310,1cyclictest25-21ksoftirqd/121:49:311
9843991312,1cyclictest9-21ksoftirqd/021:14:090
9843991311,1cyclictest9-21ksoftirqd/000:17:260
277002130,0sleep50-21swapper/522:38:295
237312130,0sleep50-21swapper/521:44:475
187012130,0sleep10-21swapper/123:05:401
986999129,1cyclictest73-21ksoftirqd/723:11:597
9869991211,1cyclictest73-21ksoftirqd/723:59:147
9869991211,1cyclictest73-21ksoftirqd/723:52:167
9869991211,1cyclictest73-21ksoftirqd/722:07:417
9869991211,1cyclictest73-21ksoftirqd/721:53:267
9869991211,1cyclictest73-21ksoftirqd/721:43:187
9869991211,1cyclictest73-21ksoftirqd/721:34:257
9869991210,1cyclictest73-21ksoftirqd/723:36:137
9869991210,1cyclictest73-21ksoftirqd/723:25:357
9869991210,1cyclictest73-21ksoftirqd/722:17:447
9869991210,1cyclictest73-21ksoftirqd/721:31:397
9869991210,1cyclictest73-21ksoftirqd/700:27:507
985499129,2cyclictest28988-21rm21:14:104
9851991211,1cyclictest41-21ksoftirqd/300:10:503
984599127,3cyclictest33-21ksoftirqd/223:33:592
9845991211,1cyclictest33-21ksoftirqd/223:27:012
9845991211,1cyclictest33-21ksoftirqd/220:17:262
9845991210,1cyclictest33-21ksoftirqd/223:53:542
9845991210,1cyclictest33-21ksoftirqd/221:32:562
9845991210,1cyclictest33-21ksoftirqd/219:52:272
9845991210,1cyclictest33-21ksoftirqd/200:28:202
984499129,2cyclictest32615-21grepconf.sh23:27:151
984499127,3cyclictest25-21ksoftirqd/123:55:301
9844991211,1cyclictest25-21ksoftirqd/123:29:471
9844991211,1cyclictest25-21ksoftirqd/121:34:321
9844991211,1cyclictest15-21kswork21:42:011
9844991211,1cyclictest12587-21kworker/1:220:12:551
9844991210,1cyclictest25-21ksoftirqd/122:42:271
9843991211,1cyclictest9-21ksoftirqd/023:21:420
9843991210,2cyclictest9-21ksoftirqd/021:55:450
9843991210,1cyclictest9-21ksoftirqd/021:18:420
127822120,0sleep30-21swapper/300:29:513
115512120,0sleep70-21swapper/722:32:467
986999119,1cyclictest73-21ksoftirqd/721:57:437
986999119,1cyclictest73-21ksoftirqd/721:12:387
986999119,1cyclictest73-21ksoftirqd/700:33:417
986999118,3cyclictest73-21ksoftirqd/722:28:567
986999113,5cyclictest73-21ksoftirqd/722:05:477
9869991110,1cyclictest73-21ksoftirqd/722:51:047
9869991110,1cyclictest73-21ksoftirqd/722:44:147
9869991110,1cyclictest73-21ksoftirqd/721:10:597
986599119,1cyclictest711-21dbus-daemon00:07:526
986599119,1cyclictest65-21ksoftirqd/623:48:546
986599119,1cyclictest65-21ksoftirqd/621:20:056
986599119,1cyclictest65-21ksoftirqd/600:16:576
986599119,1cyclictest0-21swapper/622:08:226
986599118,2cyclictest4401-21bash23:15:476
986599118,2cyclictest26852-21sshd23:10:396
986599111,5cyclictest1-21systemd22:45:076
986599110,5cyclictest0-21swapper/621:43:286
986599110,10cyclictest32131-21sshd23:38:426
986099119,1cyclictest57-21ksoftirqd/522:20:195
986099119,1cyclictest57-21ksoftirqd/500:09:155
986099119,1cyclictest28105-21nfsd00:28:315
986099114,4cyclictest13441-21sshd21:23:565
986099112,5cyclictest12463-21grepconf.sh21:31:555
9860991110,1cyclictest57-21ksoftirqd/500:02:425
9860991110,1cyclictest57-21ksoftirqd/500:02:425
986099110,8cyclictest0-21swapper/523:40:335
986099110,10cyclictest0-21swapper/520:27:425
986099110,1cyclictest0-21swapper/523:53:175
985499113,2cyclictest30858-21ls22:12:264
985499111,4cyclictest24318-21sshd23:22:204
985199114,4cyclictest27845-21bash23:42:213
9851991110,1cyclictest41-21ksoftirqd/322:04:193
985199110,10cyclictest1-21systemd23:46:133
984599119,2cyclictest33-21ksoftirqd/220:07:482
984599119,1cyclictest33-21ksoftirqd/220:32:362
984599119,1cyclictest33-21ksoftirqd/220:27:422
9845991110,1cyclictest6029-21kworker/2:119:34:232
9845991110,1cyclictest33-21ksoftirqd/219:32:262
984499119,1cyclictest7067-21open_inodes21:42:431
984499119,1cyclictest25-21ksoftirqd/100:32:441
984499118,3cyclictest25-21ksoftirqd/122:05:241
984499118,1cyclictest25-21ksoftirqd/121:07:401
9844991110,1cyclictest25-21ksoftirqd/123:42:441
9844991110,1cyclictest25-21ksoftirqd/121:28:501
9844991110,1cyclictest25-21ksoftirqd/100:16:191
9844991110,1cyclictest25-21ksoftirqd/100:10:161
984399119,1cyclictest9-21ksoftirqd/022:02:290
984399119,1cyclictest9-21ksoftirqd/022:02:260
984399119,1cyclictest9-21ksoftirqd/021:33:160
984399119,1cyclictest0-21swapper/023:48:440
984399118,2cyclictest29881-21bash23:07:060
984399113,0cyclictest0-21swapper/020:39:320
984399113,0cyclictest0-21swapper/020:39:320
289162110,0sleep30-21swapper/320:37:263
282752110,0sleep50-21swapper/521:14:045
986999109,1cyclictest73-21ksoftirqd/722:37:357
986999108,1cyclictest73-21ksoftirqd/700:18:187
986999107,2cyclictest73-21ksoftirqd/723:21:137
986999105,3cyclictest73-21ksoftirqd/723:16:227
986599109,1cyclictest65-21ksoftirqd/623:33:286
986599109,1cyclictest65-21ksoftirqd/621:50:026
986599104,3cyclictest758-21sshd22:07:116
986599100,1cyclictest1-21systemd23:54:096
986099109,1cyclictest57-21ksoftirqd/521:55:545
986099109,1cyclictest28105-21nfsd20:22:405
986099107,1cyclictest861-21gdbus00:19:135
985499108,1cyclictest711-21dbus-daemon23:36:224
985499108,1cyclictest668-21systemd-logind00:12:564
985499100,4cyclictest0-21swapper/422:58:164
985199109,1cyclictest41-21ksoftirqd/322:35:523
985199109,1cyclictest41-21ksoftirqd/322:09:083
985199109,1cyclictest41-21ksoftirqd/321:34:193
985199109,1cyclictest41-21ksoftirqd/321:12:383
985199108,1cyclictest41-21ksoftirqd/321:28:593
985199102,5cyclictest17154-21sshd21:20:353
985199100,10cyclictest0-21swapper/323:35:393
985199100,10cyclictest0-21swapper/300:24:133
984599109,1cyclictest33-21ksoftirqd/220:42:432
984499109,1cyclictest25-21ksoftirqd/122:47:451
984499109,1cyclictest25-21ksoftirqd/100:27:591
984499109,1cyclictest25-21ksoftirqd/100:20:061
984399109,1cyclictest9-21ksoftirqd/023:01:480
984399109,1cyclictest9-21ksoftirqd/021:40:500
984399109,1cyclictest9-21ksoftirqd/021:27:280
984399109,1cyclictest9-21ksoftirqd/000:08:330
984399109,1cyclictest9-21ksoftirqd/000:07:190
984399109,1cyclictest9-21ksoftirqd/000:07:190
984399108,1cyclictest9-21ksoftirqd/023:30:530
984399108,1cyclictest9-21ksoftirqd/021:49:260
984399104,3cyclictest998-21sshd22:20:070
984399102,8cyclictest368-21jbd2/sda2-823:52:390
196832100,1sleep719674-21sshd21:52:107
98699998,1cyclictest73-21ksoftirqd/721:22:597
98699997,1cyclictest73-21ksoftirqd/700:22:407
98699990,3cyclictest0-21swapper/720:30:067
98699990,0cyclictest0-21swapper/700:05:287
98699990,0cyclictest0-21swapper/700:05:287
98659999,0cyclictest0-21swapper/622:35:206
98659998,1cyclictest65-21ksoftirqd/622:47:526
98659998,1cyclictest65-21ksoftirqd/622:17:596
98659998,1cyclictest65-21ksoftirqd/621:37:396
98659998,1cyclictest65-21ksoftirqd/621:36:296
98659998,1cyclictest65-21ksoftirqd/600:27:596
98659997,1cyclictest65-21ksoftirqd/623:26:426
98659997,1cyclictest65-21ksoftirqd/622:13:036
98659997,1cyclictest0-21swapper/622:53:376
98659996,2cyclictest1601-21grepconf.sh22:27:466
98659994,1cyclictest10377-21grepconf.sh00:04:026
98659994,1cyclictest10377-21grepconf.sh00:04:026
98659993,5cyclictest1848-21sshd00:19:166
98659993,3cyclictest0-21swapper/623:30:076
98659992,5cyclictest0-21swapper/623:17:386
98659992,4cyclictest5116-21grepconf.sh21:11:276
98659991,3cyclictest23567-21bash23:45:536
98659990,9cyclictest0-21swapper/621:14:186
98659990,9cyclictest0-21swapper/600:35:476
98609998,1cyclictest57-21ksoftirqd/522:59:435
98609998,1cyclictest57-21ksoftirqd/500:14:415
98609997,1cyclictest57-21ksoftirqd/523:09:075
98609997,1cyclictest57-21ksoftirqd/520:22:265
98609993,3cyclictest30196-21grep23:02:505
98609992,4cyclictest0-21swapper/520:11:135
98609992,1cyclictest668-21systemd-logind23:17:295
98609992,0cyclictest0-21swapper/500:26:155
98609990,9cyclictest0-21swapper/522:24:125
98609990,9cyclictest0-21swapper/522:04:135
98609990,9cyclictest0-21swapper/521:52:035
98609990,9cyclictest0-21swapper/521:33:175
98609990,9cyclictest0-21swapper/519:27:485
98609990,8cyclictest6165-21kworker/5:522:31:235
98609990,8cyclictest4264-21grepconf.sh22:35:525
98609990,3cyclictest0-21swapper/521:42:195
98609990,3cyclictest0-21swapper/521:11:415
98609990,0cyclictest0-21swapper/523:46:405
98609990,0cyclictest0-21swapper/522:08:365
98549999,0cyclictest0-21swapper/422:06:214
98549998,1cyclictest0-21swapper/423:42:314
98549998,1cyclictest0-21swapper/400:21:464
98549997,1cyclictest49-21ksoftirqd/421:41:354
98549992,3cyclictest4259-21bash22:51:534
98549990,9cyclictest0-21swapper/423:13:404
98549990,9cyclictest0-21swapper/422:55:224
98549990,9cyclictest0-21swapper/421:49:474
98519998,1cyclictest41-21ksoftirqd/322:19:523
98519997,1cyclictest41-21ksoftirqd/323:28:413
98519997,1cyclictest41-21ksoftirqd/323:11:543
98519997,1cyclictest25791-21sshd21:09:213
98519994,3cyclictest740-21gdbus00:15:263
98519993,3cyclictest10893-21munin-run21:02:273
98519990,9cyclictest0-21swapper/322:59:243
98519990,9cyclictest0-21swapper/322:23:183
98519990,9cyclictest0-21swapper/321:41:033
98519990,0cyclictest0-21swapper/323:19:533
98459998,1cyclictest33-21ksoftirqd/220:37:472
98459998,1cyclictest33-21ksoftirqd/220:37:472
98459998,1cyclictest33-21ksoftirqd/219:12:442
98459997,1cyclictest33-21ksoftirqd/219:57:432
98449998,1cyclictest12587-21kworker/1:220:05:591
98449990,9cyclictest0-21swapper/120:37:461
98449990,9cyclictest0-21swapper/120:37:461
98439998,1cyclictest9-21ksoftirqd/000:19:260
98439997,1cyclictest9-21ksoftirqd/021:45:150
98439993,3cyclictest5432-21sshd22:24:200
98439993,3cyclictest18134-21sshd22:14:350
98439990,9cyclictest14361-21kworker/0:121:07:340
98439990,9cyclictest0-21swapper/023:14:590
98439990,9cyclictest0-21swapper/020:02:480
98439990,3cyclictest0-21swapper/020:52:120
98439990,3cyclictest0-21swapper/019:31:540
98439990,0cyclictest0-21swapper/023:42:350
98699988,0cyclictest0-21swapper/719:52:447
98659986,1cyclictest65-21ksoftirqd/623:04:326
98659986,1cyclictest65-21ksoftirqd/600:24:086
98659983,2cyclictest26394-21bash21:52:456
98659982,4cyclictest15402-21grepconf.sh21:28:046
98659982,3cyclictest6874-21bash22:40:016
98659982,3cyclictest19406-21bash21:24:446
98659981,4cyclictest0-21swapper/622:22:336
98609988,0cyclictest0-21swapper/521:59:565
98609987,1cyclictest0-21swapper/523:33:535
98609986,1cyclictest57-21ksoftirqd/523:49:185
98609983,2cyclictest0-21swapper/522:43:175
98609983,2cyclictest0-21swapper/520:52:535
98609983,2cyclictest0-21swapper/520:42:555
98609983,2cyclictest0-21swapper/520:05:275
98609983,2cyclictest0-21swapper/519:47:195
98609983,2cyclictest0-21swapper/519:47:195
98609983,2cyclictest0-21swapper/519:34:375
98609983,1cyclictest10028-21ps20:57:455
98609983,0cyclictest0-21swapper/520:49:035
98609983,0cyclictest0-21swapper/520:12:315
98609983,0cyclictest0-21swapper/519:51:015
98609983,0cyclictest0-21swapper/519:13:285
98609983,0cyclictest0-21swapper/519:09:565
98609982,4cyclictest7558-21sshd23:24:045
98609982,3cyclictest711-21dbus-daemon21:18:115
98609982,3cyclictest20496-21bash23:57:285
98609980,3cyclictest0-21swapper/519:52:315
98549988,0cyclictest0-21swapper/423:24:324
98549988,0cyclictest0-21swapper/400:23:594
98549988,0cyclictest0-21swapper/400:10:444
98549986,1cyclictest49-21ksoftirqd/423:31:274
98549986,1cyclictest49-21ksoftirqd/423:09:244
98549986,1cyclictest49-21ksoftirqd/421:58:314
98549986,1cyclictest49-21ksoftirqd/421:54:044
98549986,1cyclictest49-21ksoftirqd/421:12:244
98549985,2cyclictest16719-21grep22:37:234
98549985,2cyclictest11608-21cp00:34:064
98549983,2cyclictest0-21swapper/400:04:484
98549983,2cyclictest0-21swapper/400:04:484
98549981,4cyclictest22098-21grep21:25:044
98549980,2cyclictest15894-21sshd21:36:094
98519988,0cyclictest0-21swapper/323:14:133
98519986,1cyclictest41-21ksoftirqd/323:03:313
98519986,1cyclictest41-21ksoftirqd/322:45:263
98519986,1cyclictest41-21ksoftirqd/322:40:263
98519986,1cyclictest41-21ksoftirqd/321:54:223
98519983,2cyclictest5419-21sshd23:47:353
98519982,3cyclictest859-21polkitd22:01:063
98519982,3cyclictest5203-21grepconf.sh23:59:263
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional