You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-16 - 08:22
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack1slot1.osadl.org (updated Tue Jul 16, 2024 00:45:11)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
179762215160,25sleep00-21swapper/019:09:060
179682203162,27sleep20-21swapper/219:09:002
177292203165,25sleep10-21swapper/119:05:541
177562198161,23sleep30-21swapper/319:06:163
45232610,0sleep10-21swapper/123:16:261
77512530,0sleep10-21swapper/121:00:251
1815399250,24cyclictest0-21swapper/220:40:002
1815399140,13cyclictest21083-21apt-get22:10:132
1813599130,12cyclictest10838-21diskmemload22:00:310
188632110,0sleep310838-21diskmemload00:23:103
1816199110,6cyclictest0-21swapper/300:04:353
1815399116,4cyclictest13230-21sh22:45:002
1815399116,1cyclictest19745-21snmpd21:19:082
1815399110,0cyclictest0-21swapper/222:02:072
1813599110,10cyclictest20484-21munin-node23:39:230
98752100,0sleep20-21swapper/221:54:462
18161991010,0cyclictest35-21ksoftirqd/300:09:203
1815399108,1cyclictest520-21rpcbind22:23:102
1815399106,1cyclictest61250irq/122-eno123:50:222
1813599106,2cyclictest9-21ksoftirqd/021:40:180
1813599102,4cyclictest27199-21perf23:50:000
1813599100,7cyclictest3233-21apt-get21:45:110
1813599100,5cyclictest14267-21latency_hist21:15:000
181619991,7cyclictest5991-21runrttasks21:48:303
181619991,6cyclictest31702-21apt-get20:45:123
181619991,5cyclictest18017-21apt-get21:20:113
181619990,3cyclictest0-21swapper/319:55:133
181619990,1cyclictest259-21systemd-journal20:40:003
181619990,0cyclictest0-21swapper/322:59:503
181539994,1cyclictest61250irq/122-eno123:15:262
181539993,2cyclictest23929-21apt-get23:45:132
181539990,8cyclictest12637-21/usr/sbin/munin00:15:242
181359997,1cyclictest9-21ksoftirqd/021:25:350
181359997,1cyclictest9-21ksoftirqd/000:15:170
181359996,1cyclictest9-21ksoftirqd/020:40:000
181359990,6cyclictest9106-1kworker/u9:223:30:340
181359990,5cyclictest0-21swapper/023:40:100
26943280,0sleep30-21swapper/323:49:223
181619986,1cyclictest19745-21snmpd23:50:313
181619986,1cyclictest19745-21snmpd22:40:413
181619986,1cyclictest19745-21snmpd22:11:073
181619986,1cyclictest19745-21snmpd19:54:183
181619986,1cyclictest19745-21snmpd19:33:233
181619986,1cyclictest19745-21snmpd00:26:473
181619982,4cyclictest27213-21sh21:31:233
181619981,5cyclictest1422-21ntpd20:30:223
181619981,4cyclictest0-21swapper/322:15:083
181619981,3cyclictest544-21nscd00:17:323
181619980,4cyclictest0-21swapper/321:15:143
181619980,3cyclictest0-21swapper/320:50:143
181619980,0cyclictest0-21swapper/321:26:203
181539988,0cyclictest0-21swapper/223:08:382
181539986,1cyclictest61250irq/122-eno123:30:282
181539986,1cyclictest61250irq/122-eno123:20:202
181539986,1cyclictest61250irq/122-eno122:55:182
181539986,1cyclictest61250irq/122-eno121:37:212
181539986,1cyclictest61250irq/122-eno100:38:562
181539986,1cyclictest61250irq/122-eno100:38:562
181539986,1cyclictest61250irq/122-eno100:25:182
181539986,1cyclictest61250irq/122-eno100:20:192
181539986,1cyclictest61250irq/122-eno100:13:562
181539986,1cyclictest19745-21snmpd23:44:042
181539986,1cyclictest19745-21snmpd22:36:142
181539986,1cyclictest19745-21snmpd22:15:102
181539986,1cyclictest19745-21snmpd21:06:532
181539986,1cyclictest19745-21snmpd20:26:042
181539986,1cyclictest19745-21snmpd19:47:112
181539986,1cyclictest19745-21snmpd00:06:562
181539984,2cyclictest283-21systemd-udevd22:49:152
181539982,4cyclictest530-21systemd-logind22:32:152
181539981,6cyclictest757-21runrttasks21:57:362
181539980,8cyclictest0-21swapper/220:15:122
181539980,7cyclictest17885-21ntpq23:35:252
181539980,7cyclictest0-21swapper/221:20:272
181539980,2cyclictest0-21swapper/219:25:132
181359988,0cyclictest9-21ksoftirqd/021:53:510
181359987,1cyclictest9-21ksoftirqd/023:25:110
181359987,1cyclictest9-21ksoftirqd/023:00:200
181359987,1cyclictest9-21ksoftirqd/021:15:280
181359987,1cyclictest9-21ksoftirqd/020:35:000
181359986,1cyclictest9-21ksoftirqd/022:35:270
181359986,1cyclictest9-21ksoftirqd/020:10:170
181359986,1cyclictest9-21ksoftirqd/020:10:160
181359986,1cyclictest9-21ksoftirqd/019:15:000
181359986,1cyclictest19745-21snmpd22:09:490
181359986,1cyclictest19745-21snmpd00:30:380
181359986,1cyclictest19745-21snmpd00:30:380
181359984,3cyclictest757-21runrttasks21:32:310
181359982,3cyclictest3179-21apt-get19:45:160
181359980,7cyclictest28431-21fschecks_count23:05:250
181359980,0cyclictest10838-21diskmemload21:38:530
7701270,1sleep00-21swapper/021:00:250
24005270,0sleep30-21swapper/300:30:183
24005270,0sleep30-21swapper/300:30:183
181619975,1cyclictest21113-21cat23:40:183
181619975,1cyclictest19745-21snmpd22:49:383
181619975,1cyclictest19745-21snmpd21:57:313
181619975,1cyclictest19745-21snmpd20:59:083
181619975,1cyclictest19745-21snmpd20:25:103
181619975,1cyclictest19745-21snmpd19:16:463
181619974,2cyclictest10259-21apt-get20:00:133
181619971,4cyclictest29690-21seq23:05:443
181619970,6cyclictest0-21swapper/321:13:033
181619970,4cyclictest0-21swapper/322:54:043
181619970,4cyclictest0-21swapper/322:54:043
181619970,4cyclictest0-21swapper/322:37:383
181619970,3cyclictest0-21swapper/320:15:123
181539977,0cyclictest0-21swapper/223:58:192
181539976,1cyclictest61250irq/122-eno123:04:162
181539976,1cyclictest61250irq/122-eno122:50:162
181539976,1cyclictest61250irq/122-eno122:50:162
181539976,1cyclictest61250irq/122-eno121:45:112
181539976,1cyclictest61250irq/122-eno121:44:432
181539976,0cyclictest61250irq/122-eno121:27:042
181539975,1cyclictest61250irq/122-eno123:10:312
181539975,1cyclictest19745-21snmpd23:29:252
181539975,1cyclictest19745-21snmpd22:05:072
181539975,1cyclictest19745-21snmpd21:11:352
181539975,1cyclictest19745-21snmpd00:30:202
181539975,1cyclictest19745-21snmpd00:30:202
181539975,1cyclictest19745-21snmpd00:01:592
181539974,1cyclictest283-21systemd-udevd20:39:152
181539973,2cyclictest530-21systemd-logind19:22:152
181539971,6cyclictest0-21swapper/219:17:232
181539970,4cyclictest0-21swapper/220:00:132
181539970,1cyclictest0-21swapper/220:22:552
181439971,6cyclictest0-21swapper/100:12:411
181439970,4cyclictest0-21swapper/123:40:101
181439970,4cyclictest0-21swapper/122:15:261
181439970,3cyclictest0-21swapper/100:05:001
181439970,1cyclictest0-21swapper/120:24:071
181439970,1cyclictest0-21swapper/120:10:201
181439970,1cyclictest0-21swapper/120:10:201
181359977,0cyclictest9-21ksoftirqd/022:45:110
181359977,0cyclictest9-21ksoftirqd/000:35:130
181359977,0cyclictest9-21ksoftirqd/000:35:130
181359976,1cyclictest9-21ksoftirqd/022:40:130
181359976,1cyclictest9-21ksoftirqd/020:25:010
181359976,1cyclictest9-21ksoftirqd/000:00:160
181359976,1cyclictest783-21sshd22:31:440
181359976,1cyclictest19745-21snmpd19:35:230
181359975,1cyclictest25510-21cat22:15:230
181359975,1cyclictest21053-21cut19:15:010
181359971,1cyclictest23046-21ssh22:57:050
181359970,6cyclictest9574-21expr00:10:110
181359970,6cyclictest6849-21ssh23:20:200
181359970,6cyclictest4895-21sh23:17:360
181359970,6cyclictest30718-21ssh22:22:520
181359970,6cyclictest29570-21/usr/sbin/munin19:30:220
181359970,6cyclictest28487-21ssh23:50:220
181359970,6cyclictest10838-21diskmemload21:20:170
181359970,6cyclictest10838-21diskmemload00:20:070
181359970,6cyclictest10838-21diskmemload00:05:220
181359970,6cyclictest0-21swapper/022:25:150
181359970,6cyclictest0-21swapper/021:58:310
181359970,4cyclictest0-21swapper/023:11:420
181359970,1cyclictest7644-21sh19:55:000
181359970,1cyclictest22956-21sh22:10:410
181359970,1cyclictest0-21swapper/020:25:240
181359970,1cyclictest0-21swapper/019:21:050
181359970,1cyclictest0-21swapper/000:25:160
181359970,0cyclictest0-21swapper/023:55:280
181619965,1cyclictest7896-21ssh23:20:553
181619965,1cyclictest4331-21ssh23:15:493
181619965,1cyclictest19745-21snmpd19:27:233
181619965,1cyclictest1919-21ntpq19:40:233
181619964,1cyclictest19745-21snmpd21:05:083
181619964,1cyclictest19745-21snmpd20:08:093
181619964,1cyclictest19745-21snmpd00:10:113
181619964,1cyclictest18081-21/usr/sbin/munin22:05:173
181619963,2cyclictest10838-21diskmemload21:36:263
181619962,2cyclictest10838-21diskmemload23:36:273
181619961,4cyclictest32495-21rm23:10:283
181619961,4cyclictest20484-21munin-node21:03:253
181619961,3cyclictest0-21swapper/320:40:173
181619960,4cyclictest0-21swapper/323:34:093
181619960,3cyclictest0-21swapper/322:01:203
181619960,3cyclictest0-21swapper/321:50:063
181619960,3cyclictest0-21swapper/321:40:123
181619960,3cyclictest0-21swapper/300:37:283
181619960,3cyclictest0-21swapper/300:37:273
181619960,2cyclictest0-21swapper/323:30:003
181619960,2cyclictest0-21swapper/322:30:183
181619960,2cyclictest0-21swapper/322:25:083
181619960,2cyclictest0-21swapper/322:20:533
181619960,1cyclictest0-21swapper/323:55:433
181619960,1cyclictest0-21swapper/323:02:193
181539966,0cyclictest61250irq/122-eno120:57:222
181539966,0cyclictest61250irq/122-eno120:11:102
181539966,0cyclictest61250irq/122-eno120:11:102
181539966,0cyclictest61250irq/122-eno120:05:102
181539966,0cyclictest61250irq/122-eno119:44:332
181539964,1cyclictest61250irq/122-eno122:25:082
181539964,1cyclictest61250irq/122-eno121:30:142
181539964,1cyclictest61250irq/122-eno119:10:292
181539964,1cyclictest28-21ksoftirqd/219:55:142
181539962,3cyclictest1635-21apt-get20:50:142
181539960,6cyclictest0-21swapper/221:02:172
181539960,6cyclictest0-21swapper/220:45:192
181539960,2cyclictest0-21swapper/219:50:102
181539960,1cyclictest0-21swapper/219:36:052
181439966,0cyclictest0-21swapper/122:54:461
181439966,0cyclictest0-21swapper/122:54:461
181439966,0cyclictest0-21swapper/100:30:001
181439966,0cyclictest0-21swapper/100:30:001
181439961,4cyclictest0-21swapper/123:57:381
181439960,6cyclictest0-21swapper/123:02:331
181439960,6cyclictest0-21swapper/121:50:451
181439960,6cyclictest0-21swapper/121:30:031
181439960,6cyclictest0-21swapper/121:15:011
181439960,6cyclictest0-21swapper/100:38:481
181439960,6cyclictest0-21swapper/100:38:481
181439960,6cyclictest0-21swapper/100:23:411
181439960,6cyclictest0-21swapper/100:17:221
181439960,5cyclictest0-21swapper/120:05:061
181439960,5cyclictest0-21swapper/119:31:171
181439960,4cyclictest0-21swapper/121:20:271
181439960,3cyclictest0-21swapper/123:27:091
181439960,0cyclictest0-21swapper/120:18:361
181359966,0cyclictest18743-21sensors20:15:300
181359966,0cyclictest0-21swapper/019:59:100
181359965,1cyclictest760-21/usr/sbin/munin19:40:190
181359965,1cyclictest14020-21sensors20:05:250
181359961,2cyclictest3989-21apt-get20:55:130
181359960,6cyclictest0-21swapper/021:08:080
181359960,6cyclictest0-21swapper/020:41:290
181359960,5cyclictest10838-21diskmemload22:50:080
181359960,5cyclictest10838-21diskmemload22:50:080
181359960,1cyclictest0-21swapper/020:00:130
181359960,0cyclictest0-21swapper/019:25:240
181619953,1cyclictest32639-21taskset19:36:193
181619953,1cyclictest19745-21snmpd19:22:203
181539953,1cyclictest61250irq/122-eno119:30:262
181539950,1cyclictest0-21swapper/220:30:112
181439955,0cyclictest0-21swapper/122:01:091
181439955,0cyclictest0-21swapper/120:50:171
181439951,3cyclictest0-21swapper/122:27:451
181439951,2cyclictest0-21swapper/122:11:121
181439951,2cyclictest0-21swapper/121:10:151
181439951,2cyclictest0-21swapper/120:45:111
181439951,1cyclictest0-21swapper/123:30:111
181439950,5cyclictest0-21swapper/122:31:111
181439950,5cyclictest0-21swapper/121:08:561
181439950,4cyclictest0-21swapper/119:46:351
181439950,3cyclictest0-21swapper/123:20:281
181439950,3cyclictest0-21swapper/123:07:281
181439950,3cyclictest0-21swapper/120:30:101
181439950,3cyclictest0-21swapper/100:25:091
181439950,2cyclictest0-21swapper/123:53:061
181439950,2cyclictest0-21swapper/123:35:121
181439950,2cyclictest0-21swapper/122:55:491
181439950,2cyclictest0-21swapper/122:35:151
181439950,2cyclictest0-21swapper/122:23:461
181439950,2cyclictest0-21swapper/121:41:471
181439950,2cyclictest0-21swapper/121:35:031
181439950,1cyclictest0-21swapper/121:45:111
181439950,0cyclictest0-21swapper/123:45:021
181439950,0cyclictest0-21swapper/122:40:121
181439950,0cyclictest0-21swapper/122:07:591
181439950,0cyclictest0-21swapper/121:59:371
181439950,0cyclictest0-21swapper/119:37:561
181439950,0cyclictest0-21swapper/100:07:351
181359950,0cyclictest0-21swapper/020:45:150
181619944,0cyclictest21121-21sensors20:20:283
181619943,1cyclictest3459-21tr19:45:183
181619942,1cyclictest19047-21tune2fs19:10:193
181619942,1cyclictest15517-21cut20:10:153
181619942,1cyclictest15517-21cut20:10:153
181439944,0cyclictest0-21swapper/119:27:171
181439943,1cyclictest0-21swapper/119:50:271
181439943,1cyclictest0-21swapper/119:20:001
181439941,2cyclictest0-21swapper/120:38:581
181439941,2cyclictest0-21swapper/119:20:111
181439940,2cyclictest0-21swapper/123:10:041
181439940,2cyclictest0-21swapper/121:25:121
181439940,1cyclictest0-21swapper/122:45:231
181439940,1cyclictest0-21swapper/120:40:251
181439940,0cyclictest0-21swapper/120:01:491
181439940,0cyclictest0-21swapper/119:40:261
181359940,1cyclictest259-21systemd-journal20:50:000
181439932,1cyclictest0-21swapper/120:55:121
181439930,2cyclictest0-21swapper/120:25:111
181439930,1cyclictest0-21swapper/119:55:281
181439930,0cyclictest0-21swapper/119:10:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional