You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-04-03 - 11:39
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackbslot1.osadl.org (updated Wed Apr 02, 2025 12:44:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
6437102217162,14sleep30-21swapper/307:09:103
6437652211186,15sleep10-21swapper/107:09:531
6437442204181,14sleep00-21swapper/007:09:350
6436842198174,14sleep20-21swapper/207:08:492
75010521450,1sleep20-21swapper/208:55:212
644015997366,5cyclictest808166-21cp10:00:011
644015996967,1cyclictest29-21ksoftirqd/111:45:021
644017996459,3cyclictest3605905-21python309:45:022
644011996259,2cyclictest643878-21kworker/u8:0+flush-179:007:15:330
644020996145,15cyclictest778311-21/usr/share/muni09:25:083
644011995852,5cyclictest738173-21munin-update08:45:360
644020995753,3cyclictest757588-21kworker/u8:3+events_unbound09:50:303
644020995752,2cyclictest696408-21kworker/u8:5+events_unbound08:05:143
644015995641,3cyclictest849385-21chrome10:45:011
64401199550,55cyclictest935536-21kworker/u8:0+efi_rts_wq12:22:070
644017995446,6cyclictest826342-21latency_hist10:20:012
644015995449,3cyclictest628902-21kworker/u8:1+events_unbound07:15:001
644011995348,4cyclictest908806-21/usr/share/muni11:55:040
644011995346,5cyclictest892636-21/usr/share/muni11:35:030
644020995246,4cyclictest762985-21/usr/share/muni09:10:083
644020995147,3cyclictest708895-21kworker/u8:1+events_unbound08:57:063
8347902500,1chrt834784-21snmp_ryswitch.c10:30:033
644020995046,3cyclictest757588-21kworker/u8:3+events_unbound09:40:193
644011995045,4cyclictest669444-21/usr/share/muni07:35:050
644015994943,4cyclictest795592-21chrome09:45:021
644020994845,2cyclictest794731-21kworker/u8:2+events_unbound09:50:003
644020994844,3cyclictest772187-21kworker/u8:4+events_unbound09:30:263
644020994841,5cyclictest918443-21/usr/share/muni12:05:043
644020994841,5cyclictest3451073-20chrome11:50:113
644017994846,1cyclictest596334-21kworker/2:3+pm08:00:042
644017994844,3cyclictest757588-21kworker/u8:3+flush-179:009:55:312
644017994844,2cyclictest795351-21kworker/2:1+pm10:29:222
644015994842,4cyclictest931224-21/usr/share/muni12:20:051
644020994744,2cyclictest848766-21kworker/u8:1+events_unbound10:50:223
644020994742,4cyclictest920836-21kworker/u8:0+events_unbound12:10:133
644015994735,10cyclictest829396-21/usr/share/muni10:25:161
644011994743,3cyclictest795584-21CacheThread_Blo09:45:010
644020994643,2cyclictest4111684-1kworker/3:1H+kblockd12:16:423
644020994642,3cyclictest802803-21kworker/u8:0+events_unbound10:15:283
644020994639,5cyclictest674097-21latency_hist07:40:003
644017994643,2cyclictest596334-21kworker/2:3+pm07:35:152
644015994642,3cyclictest772187-21kworker/u8:4+flush-179:009:30:201
644015994640,4cyclictest790647-21/usr/share/muni09:40:181
644020994541,3cyclictest844181-21munin-update10:40:353
644020994541,3cyclictest643878-21kworker/u8:0+events_unbound07:17:013
644020994536,8cyclictest802803-21kworker/u8:0+events_unbound10:35:083
644017994540,4cyclictest844174-21latency_hist10:40:012
644015994541,3cyclictest693081-31munin-html07:55:361
644015994539,4cyclictest852587-21/usr/share/muni10:50:121
644011994540,4cyclictest758118-21/usr/share/muni09:05:160
644011994539,4cyclictest679313-21ThreadPoolForeg07:45:030
644020994441,2cyclictest895244-21kworker/u8:0+flush-179:011:40:083
644020994441,2cyclictest895244-21kworker/u8:0+flush-179:011:40:083
644020994441,2cyclictest708895-21kworker/u8:1+events_unbound09:05:013
644020994440,3cyclictest703682-21kworker/u8:0+events_unbound08:10:093
644020994439,4cyclictest938404-21kworker/u8:4+events_unbound12:26:403
644017994439,4cyclictest798519-21/usr/share/muni09:50:082
644015994439,4cyclictest813553-21/usr/share/muni10:05:021
644015994439,4cyclictest694376-21/usr/share/muni08:00:031
644011994428,15cyclictest757865-21latency_hist09:05:010
644020994341,2cyclictest643878-21kworker/u8:0+events_unbound08:00:203
644020994339,3cyclictest708895-21kworker/u8:1+events_unbound09:35:023
644020994337,5cyclictest803400-21/usr/share/muni09:55:073
644020994320,21cyclictest813566-21/usr/share/muni10:05:033
644017994340,2cyclictest628902-21kworker/u8:1+flush-179:007:30:182
644017994339,3cyclictest738513-21chrome08:45:022
644015994338,4cyclictest753257-21/usr/share/muni09:00:051
644011994338,4cyclictest708450-31munin-html08:10:410
644020994238,3cyclictest912966-21kworker/u8:3+flush-179:012:20:173
644020994238,3cyclictest654581-21munin-update07:20:043
644017994238,2cyclictest708895-21kworker/u8:1+flush-179:009:15:062
644017994229,11cyclictest19250irq/16-mmc010:45:012
644015994238,3cyclictest729882-21apt-get08:35:151
644011994238,3cyclictest757588-21kworker/u8:3+flush-179:009:10:420
644011994237,4cyclictest728661-21/usr/share/muni08:35:030
7508062410,1sleep1750807-21sh08:55:241
644020994137,3cyclictest708895-21kworker/u8:1+events_unbound08:45:313
644020994135,4cyclictest849360-21ThreadPoolForeg10:45:023
644020994134,5cyclictest664577-21/usr/share/muni07:30:173
644017994138,2cyclictest867161-21kworker/2:3+pm11:25:452
644017994138,2cyclictest713848-21kworker/2:2+pm08:36:582
644017994137,3cyclictest713848-21kworker/2:2+pm09:01:092
644017994135,4cyclictest879998-21/usr/share/muni11:20:062
644015994136,3cyclictest825537-21munin-limits10:15:341
644015994135,5cyclictest3451182-21ThreadPoolForeg12:35:191
644015994129,10cyclictest816615-21/usr/share/muni10:10:071
644020994036,3cyclictest619102-21kworker/u8:2+events_unbound07:41:153
644020994036,3cyclictest619102-21kworker/u8:2+events_unbound07:41:153
644020994030,9cyclictest4111684-1kworker/3:1H+kblockd07:59:483
644017994038,1cyclictest713848-21kworker/2:2+pm08:20:242
644017994038,1cyclictest596334-21kworker/2:3+pm08:18:432
644017994037,2cyclictest867161-21kworker/2:3+pm11:12:492
644017994037,2cyclictest790631-1kworker/2:2H+kblockd11:01:382
644017994037,2cyclictest761993-21kworker/2:0+pm09:21:242
644017994037,2cyclictest761993-21kworker/2:0+pm09:13:402
644017994036,3cyclictest867161-21kworker/2:3+pm11:35:102
644017994036,3cyclictest867161-21kworker/2:3+pm11:35:102
644017994036,3cyclictest619102-21kworker/u8:2+flush-179:007:45:002
644017994036,3cyclictest619102-21kworker/u8:2+flush-179:007:45:002
644017994035,3cyclictest795351-21kworker/2:1+pm10:10:002
644015994037,2cyclictest258221-1kworker/1:1H+kblockd08:18:581
644020993936,2cyclictest903066-21kworker/u8:1+flush-179:012:00:323
644020993936,2cyclictest895244-21kworker/u8:0+flush-179:011:55:273
644020993936,2cyclictest879805-21kworker/u8:1+flush-179:011:20:293
644020993936,2cyclictest851880-21kworker/3:0+pm11:46:273
644020993936,2cyclictest802803-21kworker/u8:0+flush-179:010:25:293
644020993936,2cyclictest708895-21kworker/u8:1+events_unbound08:30:403
644020993936,2cyclictest708895-21kworker/u8:1+events_unbound08:30:403
644020993931,6cyclictest711140-21ntpq08:15:203
644017993937,1cyclictest867161-21kworker/2:3+pm11:52:502
644017993937,1cyclictest596334-21kworker/2:3+pm08:11:222
644017993937,1cyclictest596334-21kworker/2:3+pm08:06:482
644017993937,1cyclictest596334-21kworker/2:3+pm07:25:542
644017993937,1cyclictest596334-21kworker/2:3+pm07:11:262
644017993936,2cyclictest867161-21kworker/2:3+pm12:25:292
644017993936,2cyclictest867161-21kworker/2:3+pm12:23:492
644017993936,2cyclictest867161-21kworker/2:3+pm12:15:172
644017993936,2cyclictest867161-21kworker/2:3+pm12:14:332
644017993936,2cyclictest867161-21kworker/2:3+pm11:33:392
644017993936,2cyclictest795351-21kworker/2:1+pm10:24:592
644017993936,2cyclictest780331-21kworker/2:1+pm09:30:182
644017993936,2cyclictest776265-21kworker/2:2+pm09:41:522
644017993936,2cyclictest713848-21kworker/2:2+pm09:05:362
644017993935,3cyclictest867161-21kworker/2:3+pm11:43:342
644017993935,3cyclictest867161-21kworker/2:3+pm11:43:342
644017993935,2cyclictest867161-21kworker/2:3+pm12:05:032
644017993935,2cyclictest867161-21kworker/2:3+pm11:45:222
644015993935,2cyclictest643735-21kworker/1:2+pm08:24:041
644015993933,4cyclictest893122-21cat11:35:041
64401599390,38cyclictest0-21swapper/107:26:441
644011993934,4cyclictest3451167-21ThreadPoolForeg11:29:530
644020993835,2cyclictest866872-21kworker/u8:1+events_unbound11:05:213
644020993835,2cyclictest859157-21kworker/u8:3+events_unbound11:10:253
644020993835,2cyclictest809043-21kworker/u8:1+events_unbound10:24:273
644020993835,2cyclictest643878-21kworker/u8:0+flush-179:007:10:293
644020993835,2cyclictest4111684-1kworker/3:1H+kblockd08:20:173
644020993834,3cyclictest688941-21latency_hist07:55:013
644020993833,4cyclictest738157-21latency_hist08:45:013
644020993832,2cyclictest802803-21kworker/u8:0+events_unbound10:00:313
644017993837,1cyclictest596334-21kworker/2:3+pm07:51:202
644017993836,2cyclictest596334-21kworker/2:3+pm07:55:352
644017993836,1cyclictest713848-21kworker/2:2+pm08:34:502
644017993836,1cyclictest713848-21kworker/2:2+pm08:34:502
644017993835,2cyclictest938717-21kworker/2:0+pm12:30:072
644017993835,2cyclictest847484-21kworker/2:2+pm10:53:492
644017993835,2cyclictest790631-1kworker/2:2H+kblockd10:33:172
644017993834,2cyclictest596334-21kworker/2:3+pm07:20:152
644015993834,3cyclictest258221-1kworker/1:1H+kblockd09:25:011
644015993832,5cyclictest3451132-21Chrome_ChildIOT11:35:341
644015993832,5cyclictest3451132-21Chrome_ChildIOT11:35:331
644015993831,6cyclictest907981-31munin-html11:50:371
644015993814,23cyclictest3451170-20Compositor12:16:391
644011993836,1cyclictest802957-21kworker/0:2+pm10:24:390
644011993834,3cyclictest3335049-21systemd-journal08:05:080
644011993834,2cyclictest4004256-1kworker/0:2H+kblockd09:50:360
644011993833,4cyclictest3606029-21ThreadPoolForeg08:40:210
644020993735,1cyclictest851880-21kworker/3:0+pm11:32:073
644020993734,2cyclictest757588-21kworker/u8:3+events_unbound09:02:173
644020993734,2cyclictest3451132-21Chrome_ChildIOT11:36:343
644020993734,2cyclictest3451132-21Chrome_ChildIOT11:36:333
644020993731,5cyclictest943955-21/usr/share/muni12:35:063
644020993728,8cyclictest1276-21snmpd11:15:173
644017993735,1cyclictest867161-21kworker/2:3+pm12:04:392
644017993735,1cyclictest847484-21kworker/2:2+pm10:57:382
644017993735,1cyclictest776265-21kworker/2:2+pm09:38:442
644017993735,1cyclictest596334-21kworker/2:3+pm07:48:232
644017993734,2cyclictest795351-21kworker/2:1+pm10:01:342
644017993734,2cyclictest790631-1kworker/2:2H+kblockd11:05:022
644017993733,3cyclictest867161-21kworker/2:3+pm11:55:152
644017993733,2cyclictest713848-21kworker/2:2+pm08:40:082
644017993732,3cyclictest834930-21kworker/u8:4+flush-179:010:40:052
64401799370,35cyclictest948257-31munin-html12:35:442
644015993736,1cyclictest258221-1kworker/1:1H+kblockd11:47:181
644015993734,2cyclictest258221-1kworker/1:1H+kblockd09:52:251
644015993734,2cyclictest258221-1kworker/1:1H+kblockd09:37:031
644015993734,2cyclictest258221-1kworker/1:1H+kblockd09:20:041
644015993733,3cyclictest3451163-21chrome08:52:571
644015993731,5cyclictest917831-31munin-graph12:01:311
644015993722,14cyclictest703682-21kworker/u8:0+flush-179:008:13:291
644011993736,1cyclictest869757-21kworker/0:0+pm12:04:590
644011993735,1cyclictest648782-21kworker/0:4+pm08:22:080
644011993734,2cyclictest4004256-1kworker/0:2H+kblockd10:31:000
644020993634,1cyclictest4111684-1kworker/3:1H+kblockd10:55:193
644020993633,2cyclictest912966-21kworker/u8:3+flush-179:012:34:543
644020993633,2cyclictest4111684-1kworker/3:1H+kblockd11:00:183
644020993633,2cyclictest4111684-1kworker/3:1H+kblockd08:37:173
644020993633,2cyclictest4111684-1kworker/3:1H+kblockd08:26:003
644017993634,1cyclictest780331-21kworker/2:1+pm09:26:482
644017993633,2cyclictest795351-21kworker/2:1+pm10:07:322
644017993633,2cyclictest790631-1kworker/2:2H+kblockd11:15:042
644017993633,2cyclictest713848-21kworker/2:2+pm08:50:182
644017993633,2cyclictest596334-21kworker/2:3+pm07:16:192
644017993632,2cyclictest0-21swapper/208:27:022
644015993634,1cyclictest258221-1kworker/1:1H+kblockd12:27:081
644015993634,1cyclictest258221-1kworker/1:1H+kblockd12:12:441
644015993634,1cyclictest258221-1kworker/1:1H+kblockd11:22:141
644015993634,1cyclictest258221-1kworker/1:1H+kblockd08:28:271
644015993633,2cyclictest802803-21kworker/u8:0+flush-179:011:00:281
644015993633,2cyclictest3606033-13Compositor11:42:561
644015993633,2cyclictest258221-1kworker/1:1H+kblockd12:30:311
644015993633,2cyclictest258221-1kworker/1:1H+kblockd11:10:481
644015993633,2cyclictest258221-1kworker/1:1H+kblockd10:31:001
644015993633,2cyclictest258221-1kworker/1:1H+kblockd09:15:471
644015993633,2cyclictest258221-1kworker/1:1H+kblockd08:33:191
644015993633,2cyclictest258221-1kworker/1:1H+kblockd08:33:181
644015993632,3cyclictest643878-21kworker/u8:0+flush-179:007:20:131
644015993631,3cyclictest733539-21/usr/share/muni08:40:131
644015993630,4cyclictest844451-21/usr/share/muni10:40:041
644015993620,15cyclictest258221-1kworker/1:1H+kblockd08:45:131
644011993634,1cyclictest4004256-1kworker/0:2H+kblockd11:47:220
644011993634,1cyclictest4004256-1kworker/0:2H+kblockd11:22:270
644011993634,1cyclictest4004256-1kworker/0:2H+kblockd08:31:020
644011993634,1cyclictest4004256-1kworker/0:2H+kblockd08:31:020
644011993633,2cyclictest895244-21kworker/u8:0+flush-179:011:52:030
644011993633,2cyclictest4004256-1kworker/0:2H+kblockd10:42:430
644011993633,2cyclictest4004256-1kworker/0:2H+kblockd10:05:010
644011993633,2cyclictest4004256-1kworker/0:2H+kblockd09:24:030
644011993633,2cyclictest4004256-1kworker/0:2H+kblockd08:27:520
644011993633,2cyclictest4004256-1kworker/0:2H+kblockd07:58:570
644011993633,1cyclictest4004256-1kworker/0:2H+kblockd09:36:070
644020993533,2cyclictest628902-21kworker/u8:1+flush-179:007:46:143
644020993532,2cyclictest4111684-1kworker/3:1H+kblockd11:29:393
644020993530,3cyclictest772539-21latency_hist09:20:023
644015993533,1cyclictest258221-1kworker/1:1H+kblockd11:25:151
644015993533,1cyclictest258221-1kworker/1:1H+kblockd11:07:221
644015993533,1cyclictest258221-1kworker/1:1H+kblockd10:56:111
644015993531,3cyclictest876196-21apt-get11:15:121
644015993531,2cyclictest258221-1kworker/1:1H+kblockd10:20:021
644011993533,1cyclictest4004256-1kworker/0:2H+kblockd12:08:480
644011993532,2cyclictest4004256-1kworker/0:2H+kblockd10:10:130
644011993532,2cyclictest4004256-1kworker/0:2H+kblockd08:54:290
644011993532,2cyclictest4004256-1kworker/0:2H+kblockd07:42:430
644011993532,2cyclictest4004256-1kworker/0:2H+kblockd07:42:430
644011993532,2cyclictest4004256-1kworker/0:2H+kblockd07:28:230
644011993532,2cyclictest3606031-13Chrome_ChildIOT10:36:210
644011993521,13cyclictest3605933-21ChromeDriver15:20:430
644020993431,2cyclictest4111684-1kworker/3:1H+kblockd07:28:433
644020993430,3cyclictest708895-21kworker/u8:1+flush-179:008:50:283
644015993432,1cyclictest643735-21kworker/1:2+pm09:13:181
644015993432,1cyclictest258221-1kworker/1:1H+kblockd07:15:211
644015993431,2cyclictest258221-1kworker/1:1H+kblockd11:56:051
644015993431,2cyclictest258221-1kworker/1:1H+kblockd09:06:331
644015993431,2cyclictest258221-1kworker/1:1H+kblockd08:05:351
644015993431,2cyclictest258221-1kworker/1:1H+kblockd07:38:091
644015993430,3cyclictest921013-21latency_hist12:10:011
644011993432,1cyclictest869757-21kworker/0:0+pm11:14:430
644011993432,1cyclictest781217-21kworker/0:1+pm10:08:380
644011993432,1cyclictest4004256-1kworker/0:2H+kblockd11:16:060
644011993432,1cyclictest4004256-1kworker/0:2H+kblockd10:58:090
644011993432,1cyclictest4004256-1kworker/0:2H+kblockd08:15:470
644011993432,1cyclictest4004256-1kworker/0:2H+kblockd07:20:320
644011993431,2cyclictest4004256-1kworker/0:2H+kblockd12:38:530
644011993431,2cyclictest4004256-1kworker/0:2H+kblockd12:13:270
644011993431,2cyclictest4004256-1kworker/0:2H+kblockd11:05:460
644011993431,2cyclictest4004256-1kworker/0:2H+kblockd10:27:430
644011993430,2cyclictest3606033-13Compositor11:02:300
644011993428,5cyclictest3605992-21Chrome_ChildIOT07:50:240
644015993331,1cyclictest258221-1kworker/1:1H+kblockd07:47:591
644015993328,4cyclictest674123-21munin-update07:40:051
644015993328,4cyclictest674123-21munin-update07:40:051
644011993330,2cyclictest3605933-21ChromeDriver15:20:430
64401199330,32cyclictest2217822-21openvpn09:55:360
644020993229,3cyclictest708895-21kworker/u8:1+flush-179:009:20:343
644015993230,2cyclictest802803-21kworker/u8:0+flush-179:010:02:161
644015993229,2cyclictest258221-1kworker/1:1H+kblockd07:55:001
644015993227,4cyclictest3605992-21Chrome_ChildIOT10:35:271
644011993230,1cyclictest4004256-1kworker/0:2H+kblockd09:15:090
644011993230,1cyclictest1276-21snmpd12:16:080
644020993128,3cyclictest815712-21kworker/u8:3+events_unbound10:11:593
64401199315,25cyclictest3451163-21chrome11:40:080
64401199315,25cyclictest3451163-21chrome11:40:080
644011993129,1cyclictest4004256-1kworker/0:2H+kblockd08:01:160
644011993128,2cyclictest3605935-213fbbdc8314cb6c107:12:590
644011993118,12cyclictest4004256-1kworker/0:2H+kblockd10:45:050
644015993016,13cyclictest1276-21snmpd07:30:401
644011993028,1cyclictest1276-21snmpd09:49:590
644011993027,2cyclictest4004256-1kworker/0:2H+kblockd09:30:250
644011993027,2cyclictest4004256-1kworker/0:2H+kblockd07:30:040
644011993027,2cyclictest3606033-13Compositor11:35:150
644011993027,2cyclictest3606033-13Compositor11:35:150
644011992929,0cyclictest1276-21snmpd09:28:130
644011992927,1cyclictest869757-21kworker/0:0+pm12:34:530
644011992926,2cyclictest4004256-1kworker/0:2H+kblockd08:55:360
644011992926,2cyclictest0-21swapper/010:50:550
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional