You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-04-02 - 06:44
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot3.osadl.org (updated Wed Apr 02, 2025 00:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
239455299726,64cyclictest0-21swapper/123:18:541
2394552996562,2cyclictest0-21swapper/122:51:591
2394552996562,2cyclictest0-21swapper/122:00:281
239455299650,64cyclictest0-21swapper/123:41:541
2394552996462,1cyclictest0-21swapper/121:49:291
2394552996462,1cyclictest0-21swapper/121:49:291
2394552996462,1cyclictest0-21swapper/120:57:301
2394552996462,1cyclictest0-21swapper/120:44:331
239455299640,63cyclictest0-21swapper/119:25:351
239455299640,2cyclictest2392769-21kworker/1:219:16:291
2394552996361,1cyclictest0-21swapper/120:23:051
2394552996361,1cyclictest0-21swapper/119:52:041
239455299630,62cyclictest0-21swapper/122:16:541
239455299630,62cyclictest0-21swapper/121:23:291
2394552996259,1cyclictest0-21swapper/121:08:291
2394552996157,2cyclictest2460877-21cron23:00:001
2394552996141,19cyclictest2323756-1kworker/1:2H23:10:001
2394552996139,20cyclictest2478148-21kworker/1:100:20:151
2394552996135,25cyclictest2416384-21kworker/1:120:45:151
239455299610,60cyclictest0-21swapper/119:56:301
2394552996057,2cyclictest0-21swapper/100:00:291
2394552996043,15cyclictest2323756-1kworker/1:2H21:15:141
239455299600,59cyclictest0-21swapper/121:56:291
2394552995957,1cyclictest0-21swapper/121:00:261
2394552995956,2cyclictest0-21swapper/121:42:281
2394552995940,17cyclictest2445482-21kworker/1:122:29:231
2394577995844,2cyclictest1130424-21kworker/3:000:00:293
2394552995855,2cyclictest0-21swapper/100:30:351
2394552995843,14cyclictest2445482-21kworker/1:123:14:551
2394552995842,15cyclictest2323756-1kworker/1:2H20:04:001
2394552995841,16cyclictest2445482-21kworker/1:122:45:061
2394552995841,13cyclictest2406418-21cron19:45:011
2394552995840,17cyclictest2392769-21kworker/1:219:20:161
239455299580,54cyclictest2438745-21/usr/sbin/munin21:35:171
2394552995742,14cyclictest2445482-21kworker/1:123:20:181
2394552995741,15cyclictest2416384-21kworker/1:120:50:291
2394552995741,15cyclictest2416384-21kworker/1:120:31:291
2394552995741,15cyclictest2416384-21kworker/1:120:31:281
2394552995741,15cyclictest2412940-21kworker/1:220:15:171
2394552995741,15cyclictest2392769-21kworker/1:219:45:221
2394552995740,15cyclictest2323756-1kworker/1:2H19:30:181
2394552995739,17cyclictest2392769-21kworker/1:219:10:161
2394552995739,17cyclictest2392769-21kworker/1:219:10:151
2394552995739,16cyclictest2323756-1kworker/1:2H20:10:131
2394552995641,14cyclictest2478148-21kworker/1:100:39:551
2394552995641,14cyclictest2478148-21kworker/1:100:10:111
2394552995641,14cyclictest2445482-21kworker/1:122:40:141
2394552995639,16cyclictest2445482-21kworker/1:123:00:301
2394552995639,16cyclictest2323756-1kworker/1:2H22:24:231
2394552995639,16cyclictest2323756-1kworker/1:2H21:50:181
2394552995639,16cyclictest2323756-1kworker/1:2H21:35:001
2394552995637,18cyclictest2469513-21kworker/1:023:55:151
2394552995637,18cyclictest2445482-21kworker/1:123:30:101
2394552995539,15cyclictest2478148-21kworker/1:100:05:011
2394552995539,15cyclictest2469513-21kworker/1:023:50:101
2394552995539,15cyclictest2323756-1kworker/1:2H20:36:221
2394552995534,19cyclictest2323756-1kworker/1:2H21:12:231
239455299550,54cyclictest0-21swapper/121:27:241
2394577995449,3cyclictest2109825-1kworker/3:1H23:19:543
2394552995451,2cyclictest0-21swapper/119:39:531
2394552995438,15cyclictest2478148-21kworker/1:100:15:171
2394552995438,15cyclictest2469513-21kworker/1:023:35:041
2394552995438,15cyclictest2445482-21kworker/1:123:25:011
2394552995437,16cyclictest2469513-21kworker/1:023:47:281
2394577995349,2cyclictest2292410-21kworker/3:222:27:543
2394565995349,3cyclictest2399972-21kworker/2:023:01:542
2394565995348,3cyclictest2399972-21kworker/2:023:32:342
2394552995351,1cyclictest0-21swapper/120:25:551
2394552995337,15cyclictest2445482-21kworker/1:122:10:101
2394552995337,15cyclictest2412940-21kworker/1:220:06:591
2394577995249,2cyclictest2292410-21kworker/3:200:30:353
2394577995249,2cyclictest1130424-21kworker/3:023:26:283
2394577995247,3cyclictest2109825-1kworker/3:1H19:20:143
2394577995246,4cyclictest2109825-1kworker/3:1H19:57:423
2394552995236,15cyclictest2478148-21kworker/1:100:25:011
2394552995236,15cyclictest2445482-21kworker/1:122:35:141
239455299520,2cyclictest26-21ksoftirqd/122:07:591
2394541995246,4cyclictest3427659-1kworker/0:0H00:35:160
2394577995148,2cyclictest2109825-1kworker/3:1H20:14:553
2394577995147,3cyclictest1130424-21kworker/3:021:01:183
2394577995147,3cyclictest1130424-21kworker/3:020:20:233
2394577995147,3cyclictest1130424-21kworker/3:020:17:423
2394577995147,3cyclictest1130424-21kworker/3:000:38:593
2394577995147,2cyclictest1130424-21kworker/3:000:13:303
2394577995146,3cyclictest1130424-21kworker/3:023:08:303
2394565995146,3cyclictest2399972-21kworker/2:021:40:222
2394552995135,15cyclictest2445482-21kworker/1:122:30:011
2394577995047,2cyclictest2292410-21kworker/3:223:03:293
2394577995046,3cyclictest1130424-21kworker/3:021:23:553
2394541995047,2cyclictest3427659-1kworker/0:0H19:59:040
2394541995046,3cyclictest3427659-1kworker/0:0H20:58:050
2394577994946,2cyclictest2292410-21kworker/3:220:04:593
2394577994945,3cyclictest1130424-21kworker/3:021:33:293
2394577994945,3cyclictest1130424-21kworker/3:020:35:003
2394577994945,3cyclictest1130424-21kworker/3:020:35:003
2394577994944,3cyclictest2292410-21kworker/3:222:15:063
2394577994944,3cyclictest2109825-1kworker/3:1H20:50:213
2394577994944,3cyclictest1130424-21kworker/3:019:41:293
2394565994945,2cyclictest2399972-21kworker/2:020:08:292
2394565994944,4cyclictest367561-1kworker/2:1H19:45:202
2394565994944,3cyclictest367561-1kworker/2:1H19:30:182
2394565994943,3cyclictest367561-1kworker/2:1H23:40:012
2394541994946,2cyclictest2452508-21kworker/0:222:35:210
2394577994845,2cyclictest2292410-21kworker/3:222:43:293
2394577994842,4cyclictest2109825-1kworker/3:1H23:37:543
2394541994843,3cyclictest3427659-1kworker/0:0H20:40:150
2394577994743,2cyclictest2292410-21kworker/3:221:55:353
2394577994743,2cyclictest2292410-21kworker/3:220:35:343
2394577994742,3cyclictest2292410-21kworker/3:221:50:213
2394577994742,3cyclictest2292410-21kworker/3:221:49:543
2394577994742,3cyclictest2292410-21kworker/3:221:49:533
2394577994742,3cyclictest2109825-1kworker/3:1H19:37:533
2394577994742,3cyclictest1130424-21kworker/3:023:53:543
2394577994742,3cyclictest1130424-21kworker/3:023:34:593
2394577994742,3cyclictest1130424-21kworker/3:021:27:543
2394577994742,3cyclictest1130424-21kworker/3:021:19:293
2394577994742,3cyclictest1130424-21kworker/3:000:27:293
2394577994742,3cyclictest1130424-21kworker/3:000:16:293
2394565994744,2cyclictest2399972-21kworker/2:022:19:232
2394541994744,2cyclictest2442250-21kworker/0:221:59:050
2394541994743,2cyclictest2480283-21kworker/0:000:25:350
2394577994642,3cyclictest2292410-21kworker/3:222:03:053
2394577994641,3cyclictest2292410-21kworker/3:222:32:303
2394577994641,3cyclictest2109825-1kworker/3:1H22:55:273
2394577994641,3cyclictest1130424-21kworker/3:023:11:113
2394577994641,3cyclictest1130424-21kworker/3:020:49:293
2394577994641,3cyclictest1130424-21kworker/3:000:22:283
2394577994640,4cyclictest1130424-21kworker/3:019:47:593
2394577994637,5cyclictest2109825-1kworker/3:1H22:50:103
2394565994642,3cyclictest367561-1kworker/2:1H21:59:302
2394565994642,2cyclictest2399972-21kworker/2:020:50:052
2394565994641,3cyclictest2399972-21kworker/2:000:00:002
2394541994643,2cyclictest2472757-21kworker/0:123:50:180
2394541994643,2cyclictest2452560-21kworker/0:322:40:210
2394541994642,2cyclictest3427659-1kworker/0:0H23:15:290
2394541994642,2cyclictest3427659-1kworker/0:0H20:09:590
2394541994642,2cyclictest2472757-21kworker/0:100:22:590
2394577994542,2cyclictest2109825-1kworker/3:1H23:44:283
2394577994540,3cyclictest2292410-21kworker/3:222:08:563
2394577994540,3cyclictest2292410-21kworker/3:219:51:553
2394577994540,3cyclictest2109825-1kworker/3:1H21:10:173
2394577994539,4cyclictest2109825-1kworker/3:1H22:20:233
2394577994539,4cyclictest2109825-1kworker/3:1H21:05:353
2394577994539,4cyclictest1130424-21kworker/3:019:15:383
2394565994542,2cyclictest2399972-21kworker/2:020:10:352
2394565994542,2cyclictest2205050-21kworker/2:219:16:032
2394565994540,3cyclictest367561-1kworker/2:1H21:17:372
2394565994539,4cyclictest2483588-21kworker/2:200:30:002
2394541994542,2cyclictest3427659-1kworker/0:0H23:35:040
2394541994541,2cyclictest3427659-1kworker/0:0H22:11:590
2394541994540,3cyclictest3427659-1kworker/0:0H21:00:150
2394541994540,3cyclictest3427659-1kworker/0:0H00:30:150
2394577994440,3cyclictest1130424-21kworker/3:023:48:593
2394577994439,3cyclictest2109825-1kworker/3:1H21:40:143
2394577994439,3cyclictest2109825-1kworker/3:1H20:29:533
2394577994439,3cyclictest1130424-21kworker/3:000:05:343
2394565994441,2cyclictest367561-1kworker/2:1H22:50:312
2394565994441,2cyclictest2399972-21kworker/2:022:44:282
2394565994440,3cyclictest367561-1kworker/2:1H20:20:012
2394565994439,3cyclictest367561-1kworker/2:1H22:30:112
2394565994439,3cyclictest367561-1kworker/2:1H22:14:232
2394565994439,3cyclictest367561-1kworker/2:1H20:46:232
2394565994438,4cyclictest367561-1kworker/2:1H23:40:132
2394541994440,2cyclictest3427659-1kworker/0:0H23:35:000
2394541994440,2cyclictest3427659-1kworker/0:0H19:25:300
2394541994439,3cyclictest3427659-1kworker/0:0H23:44:290
2394577994333,6cyclictest2109825-1kworker/3:1H20:41:233
2394565994340,2cyclictest2399972-21kworker/2:021:00:422
2394541994340,2cyclictest3427659-1kworker/0:0H21:10:460
2394541994338,3cyclictest2452508-21kworker/0:222:45:290
2394565994240,1cyclictest2399972-21kworker/2:021:53:592
2394565994239,2cyclictest367561-1kworker/2:1H19:50:102
2394565994239,2cyclictest2478416-21kworker/2:100:24:292
2394565994239,2cyclictest2399972-21kworker/2:019:38:562
2394565994238,2cyclictest2399972-21kworker/2:019:55:152
2394565994238,2cyclictest2399972-21kworker/2:019:29:542
2394565994237,3cyclictest367561-1kworker/2:1H22:25:012
2394541994239,2cyclictest3427659-1kworker/0:0H20:53:580
2394541994239,2cyclictest2459253-21kworker/0:123:00:060
2394541994239,2cyclictest2394298-21kworker/0:319:30:400
2394541994238,2cyclictest2460869-21kworker/0:023:26:340
2394541994236,4cyclictest3427659-1kworker/0:0H22:34:240
2394577994137,3cyclictest1130424-21kworker/3:019:30:263
2394565994137,2cyclictest2399972-21kworker/2:022:48:052
2394541994138,2cyclictest3427659-1kworker/0:0H22:56:590
2394541994138,2cyclictest2472757-21kworker/0:100:06:340
2394541994138,2cyclictest2436869-21kworker/0:021:42:530
2394541994137,2cyclictest3427659-1kworker/0:0H19:40:160
2394541994137,2cyclictest2472757-21kworker/0:123:59:360
2394541994136,3cyclictest3427659-1kworker/0:0H21:50:100
2394541994136,3cyclictest2450607-21kworker/0:222:19:280
2394577994035,3cyclictest2109825-1kworker/3:1H23:55:043
2394577994034,4cyclictest2109825-1kworker/3:1H21:39:553
2394565994036,2cyclictest367561-1kworker/2:1H21:20:152
2394565994036,2cyclictest367561-1kworker/2:1H20:00:082
2394541994037,2cyclictest2450607-21kworker/0:222:20:140
2394541994037,2cyclictest2441991-21kworker/0:121:45:290
2394541994037,2cyclictest2441991-21kworker/0:121:45:290
2394541994037,2cyclictest2436869-21kworker/0:021:35:150
2394541994037,2cyclictest2434975-21kworker/0:121:24:290
2394541994036,2cyclictest3427659-1kworker/0:0H21:05:150
2394541994035,3cyclictest3427659-1kworker/0:0H22:52:590
2394541994035,3cyclictest3427659-1kworker/0:0H20:20:170
2394577993934,3cyclictest1130424-21kworker/3:019:14:553
2394577993934,3cyclictest1130424-21kworker/3:019:14:543
2394565993936,2cyclictest2399972-21kworker/2:023:15:402
2394565993935,3cyclictest367561-1kworker/2:1H22:25:292
2394565993935,3cyclictest2399972-21kworker/2:022:05:532
2394565993935,2cyclictest367561-1kworker/2:1H20:28:572
2394565993935,2cyclictest367561-1kworker/2:1H00:10:002
2394565993935,2cyclictest2399972-21kworker/2:023:10:352
2394565993935,2cyclictest2399972-21kworker/2:021:29:542
2394565993935,2cyclictest2399972-21kworker/2:020:55:352
2394565993935,2cyclictest2399972-21kworker/2:020:35:442
2394565993934,3cyclictest367561-1kworker/2:1H20:30:102
2394565993934,3cyclictest367561-1kworker/2:1H20:30:102
2394541993937,1cyclictest2413148-21kworker/0:020:37:290
2394541993935,2cyclictest3427659-1kworker/0:0H00:10:100
2394541993935,2cyclictest2445757-21kworker/0:022:09:290
2394565993836,1cyclictest2399972-21kworker/2:021:34:042
2394565993835,2cyclictest367561-1kworker/2:1H00:17:312
2394565993835,2cyclictest2399972-21kworker/2:023:25:462
2394565993834,3cyclictest367561-1kworker/2:1H19:12:542
2394565993834,3cyclictest367561-1kworker/2:1H19:12:532
2394541993835,2cyclictest3427659-1kworker/0:0H23:23:590
2394541993835,2cyclictest2472757-21kworker/0:100:15:240
2394541993835,2cyclictest2412889-21kworker/0:220:10:060
2394565993734,2cyclictest2399972-21kworker/2:020:18:582
239455299370,2cyclictest2394632-21latency_hist19:10:011
2394541993734,2cyclictest3427659-1kworker/0:0H19:37:590
2394541993733,2cyclictest2407910-21kworker/0:120:02:290
2394577993633,2cyclictest2109825-1kworker/3:1H20:09:553
2394565993633,2cyclictest2483588-21kworker/2:200:35:462
2394565993633,2cyclictest2483588-21kworker/2:200:33:592
2394565993633,2cyclictest2399972-21kworker/2:023:54:342
2394565993632,3cyclictest2399972-21kworker/2:023:46:342
2394565993631,3cyclictest367561-1kworker/2:1H21:37:242
2394541993633,2cyclictest2394298-21kworker/0:319:14:290
2394541993633,2cyclictest2394298-21kworker/0:319:14:280
2394541993632,2cyclictest3427659-1kworker/0:0H20:45:440
2394577993531,3cyclictest2292410-21kworker/3:222:40:003
2394565993528,4cyclictest367561-1kworker/2:1H00:10:232
2394541993532,2cyclictest2442250-21kworker/0:222:00:050
2394565993431,2cyclictest2399972-21kworker/2:023:22:542
2394565993430,2cyclictest2399972-21kworker/2:022:58:292
2394541993430,3cyclictest3427659-1kworker/0:0H23:08:000
2394541993430,3cyclictest3427659-1kworker/0:0H19:50:250
2394541993429,3cyclictest3427659-1kworker/0:0H23:10:100
2394577993328,3cyclictest2109825-1kworker/3:1H20:55:303
2394565993330,2cyclictest2399972-21kworker/2:021:05:062
2394565993330,2cyclictest2399972-21kworker/2:020:42:542
2394565993330,2cyclictest2205050-21kworker/2:219:22:042
2394565993329,2cyclictest2399972-21kworker/2:022:36:292
2394565993329,2cyclictest2399972-21kworker/2:021:10:412
2394565993328,3cyclictest367561-1kworker/2:1H21:48:232
2394565993328,3cyclictest367561-1kworker/2:1H21:48:222
2394541993331,1cyclictest2413148-21kworker/0:020:15:350
2394541993329,3cyclictest3427659-1kworker/0:0H19:47:550
2394577993227,3cyclictest2109825-1kworker/3:1H23:23:543
2394577993227,3cyclictest2109825-1kworker/3:1H22:12:533
2394541993229,2cyclictest2434975-21kworker/0:121:25:360
2394541993126,3cyclictest2472757-21kworker/0:123:46:340
2394541993027,2cyclictest2394298-21kworker/0:319:20:300
2394577992925,3cyclictest2109825-1kworker/3:1H22:49:553
2394541992926,2cyclictest2413148-21kworker/0:020:30:010
2394541992926,2cyclictest2413148-21kworker/0:020:30:000
2394565992823,3cyclictest2477812-21sensors00:00:202
2394541992825,2cyclictest3427659-1kworker/0:0H20:26:310
2394541992825,2cyclictest2394298-21kworker/0:319:18:560
2394541992724,2cyclictest2472757-21kworker/0:100:01:540
2394541992715,7cyclictest50-21kcompactd021:31:400
2394577992624,1cyclictest2109825-1kworker/3:1H19:25:173
2394565992623,2cyclictest2399972-21kworker/2:022:00:292
2394565992610,4cyclictest2399972-21kworker/2:019:45:012
239454199257,4cyclictest2433639-21apt-get21:15:110
239454199251,15cyclictest384844-21systemd-journal22:29:230
2394565992017,2cyclictest2399972-21kworker/2:023:06:282
239454199184,12cyclictest2394540-21cat19:10:000
239457799132,7cyclictest0-21swapper/319:10:013
2394565991310,2cyclictest0-21swapper/219:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional