You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-11-22 - 04:04
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack2slot7.osadl.org (updated Fri Nov 22, 2024 00:43:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4133878994519,6cyclictest4181625-21basename21:19:330
4133878994035,4cyclictest0-21swapper/022:20:440
413387899364,23cyclictest0-21swapper/023:54:310
413388099356,7cyclictest56722-21ssh22:34:392
4133878993518,2cyclictest103849-21ntpq23:29:420
4133880993419,13cyclictest0-21swapper/222:49:492
413388099333,4cyclictest4188183-21rm21:25:402
413388099332,13cyclictest86662-21ntpq23:09:352
413388099326,6cyclictest152255-21mailstats00:29:442
413388099322,10cyclictest51794-21cut22:29:382
413388099316,20cyclictest0-21swapper/222:09:382
413388099312,7cyclictest132025-21/usr/sbin/munin00:04:352
4133878993116,3cyclictest62922-21ssh22:40:420
413388099303,5cyclictest0-21swapper/200:14:382
413388099303,23cyclictest0-21swapper/222:20:442
413387899301,9cyclictest155670-21find00:34:420
413388099292,6cyclictest78288-21ssh22:59:372
413388099292,10cyclictest4191440-21ssh21:29:442
413387899293,21cyclictest0-21swapper/023:34:320
413387899292,5cyclictest62712-21sed22:40:400
413387899291,21cyclictest0-21swapper/021:54:330
413387899290,13cyclictest9924-21/usr/sbin/munin21:44:400
413388099283,7cyclictest23885-21cut21:59:332
413388099281,6cyclictest158574-21fschecks_count00:39:352
413387899284,23cyclictest0-21swapper/000:04:330
413388099273,7cyclictest127741-21fschecks_count23:59:332
413388099270,10cyclictest119345-21cut23:49:312
413387899272,11cyclictest0-21swapper/023:59:390
4133878992719,3cyclictest28421-21/usr/sbin/munin22:04:330
413388099262,7cyclictest1623-21tail21:34:342
413388099261,9cyclictest154745-21aten2.4-expect00:34:322
413388099260,14cyclictest4138093-21fschecks_time19:24:332
413387899262,22cyclictest4135502-21idleruntime-cro19:15:390
4133878992620,5cyclictest82130-21gltestperf23:04:350
413388099252,8cyclictest74306-21ssh22:54:392
413388099251,8cyclictest4137491-21gpg-connect-age19:20:402
4133880992510,1cyclictest0-21swapper/221:49:362
413388099250,6cyclictest136441-21tune2fs00:09:402
413387999252,4cyclictest0-21swapper/123:34:391
413387899256,13cyclictest57241-21ssh22:34:430
4133878992522,2cyclictest86809-21ps23:09:370
413387899252,20cyclictest0-21swapper/021:27:020
413388099243,7cyclictest0-21swapper/223:19:442
413388099243,6cyclictest0-21swapper/222:14:412
413388099242,9cyclictest123823-21/usr/sbin/munin23:54:352
413388099242,7cyclictest109311-21latency_hist23:35:402
413388099241,9cyclictest42391-21grep22:19:342
413388099241,8cyclictest60824-21if_end022:39:342
413388099241,3cyclictest90623-21ssh23:14:352
413388099240,9cyclictest4140145-21gzip19:29:352
413388099240,8cyclictest4134406-21fschecks_count19:14:342
4133879992420,3cyclictest140404-21fschecks_count00:14:341
413387899241,3cyclictest15889-21sed21:49:440
413388099235,4cyclictest65488-21ssh22:44:412
413388099234,4cyclictest19653-21/usr/sbin/munin21:54:332
413388099233,6cyclictest4152134-21/usr/sbin/munin20:04:342
413388099232,5cyclictest4169395-21unixbench_singl20:54:392
413388099232,5cyclictest149982-21latency_hist00:25:402
4133880992315,7cyclictest0-21swapper/223:04:432
4133880992310,12cyclictest0-21swapper/220:09:412
413387999233,5cyclictest94987-21cut23:19:371
413387899234,2cyclictest11050irq/107-eth%d00:24:370
413387899231,18cyclictest143991-21/usr/sbin/munin00:19:420
413388099225,3cyclictest171rcu_preempt23:29:422
413388099223,8cyclictest112211-21tail23:39:352
413388099223,2cyclictest0-21swapper/223:24:312
413388099221,10cyclictest10284-21fschecks_time21:44:322
4133879992216,4cyclictest98997-21gltestperf23:24:341
4133878992217,4cyclictest75177-21sh22:55:400
4133878992214,2cyclictest69620-21if_wlan022:49:470
4133878992210,2cyclictest4153651-21tr20:09:350
413387899220,1cyclictest4139035-21grep19:24:410
413387899220,10cyclictest23981-21fschecks_time21:59:340
413388099213,5cyclictest4144792-21grep19:44:352
413388099213,4cyclictest4177303-21fschecks_count21:14:342
413388099211,8cyclictest4155201-21fschecks_count20:14:352
413388099211,6cyclictest5501-21/usr/sbin/munin21:39:322
4133879992116,3cyclictest0-21swapper/122:19:371
413387899215,7cyclictest0-21swapper/022:29:370
413387899215,4cyclictest112179-21fschecks_time23:39:350
4133878992118,2cyclictest158631-21grep00:39:350
4133878992117,3cyclictest4187442-21unixbench_multi21:24:440
413387899211,4cyclictest11050irq/107-eth%d22:19:390
413387899210,3cyclictest77827-21cut22:59:330
413388099204,5cyclictest4147451-21/usr/sbin/munin19:49:412
413388099203,7cyclictest144947-21ssh00:19:412
413388099203,5cyclictest4148764-21/usr/sbin/munin19:54:362
413388099203,3cyclictest4160885-21/usr/sbin/munin20:29:402
413388099202,4cyclictest29902-21/usr/sbin/munin22:04:442
4133879992015,4cyclictest74615-21grep22:54:411
4133879992014,3cyclictest0-21swapper/119:14:381
413387899202,3cyclictest0-21swapper/020:59:400
413387899202,3cyclictest0-21swapper/020:59:400
413387899201,17cyclictest2949-21latency_hist21:35:400
413387899201,11cyclictest98939-21fschecks_time23:24:330
413388099191,7cyclictest4181548-21/usr/sbin/munin21:19:322
413387999194,10cyclictest25897-21dpkg22:00:411
413387999193,3cyclictest11050irq/107-eth%d23:09:361
4133879991915,3cyclictest762-21in:imuxsock22:05:401
4133879991913,3cyclictest4150947-21unixbench_singl19:59:431
413387999190,5cyclictest11050irq/107-eth%d22:14:391
413387999190,5cyclictest11050irq/107-eth%d00:39:421
413387899194,12cyclictest0-21swapper/021:14:350
413387899193,15cyclictest0-21swapper/000:14:400
413387899192,2cyclictest119820-21ntpq23:49:340
4133878991913,4cyclictest34364-21grep22:09:430
413388099184,2cyclictest4171696-21/usr/sbin/munin21:04:342
413388099183,6cyclictest4170920-21/usr/sbin/munin20:59:412
413388099183,6cyclictest4170920-21/usr/sbin/munin20:59:412
413388099183,3cyclictest4161467-21/usr/sbin/munin20:34:352
413388099182,6cyclictest4150578-21/usr/sbin/munin19:59:412
413387999185,10cyclictest122792-21ntpd23:35:421
413387899186,3cyclictest6098-21wc21:39:360
413387899181,15cyclictest4137393-21apt-key19:20:400
413387899180,9cyclictest136874-21netstat00:09:430
413388099176,2cyclictest0-21swapper/220:39:372
413388099171,7cyclictest4159293-21/usr/sbin/munin20:24:402
413387999179,4cyclictest0-21swapper/123:49:371
413387999172,3cyclictest11050irq/107-eth%d00:29:411
413387999172,13cyclictest60716-21grep22:39:341
413387999172,12cyclictest14824-21/usr/sbin/munin21:49:361
4133879991714,2cyclictest4191924-21unixbench_singl21:29:471
4133879991714,2cyclictest136510-21grep00:09:401
4133879991712,2cyclictest65235-21cut22:44:391
413387999170,3cyclictest11050irq/107-eth%d00:33:581
413387899175,11cyclictest0-21swapper/022:14:350
413387899170,9cyclictest90933-21collect223:14:370
413388199163,7cyclictest0-21swapper/323:59:373
413387999169,5cyclictest0-21swapper/120:20:401
413387999169,4cyclictest4156243-21grep20:14:431
413387999163,8cyclictest124552-21/usr/sbin/munin23:54:411
413387999162,8cyclictest4133830-21munin-run19:10:401
4133879991611,4cyclictest4149311-21unixbench_singl19:54:411
413387999160,13cyclictest104898-21cut23:30:401
413387899160,8cyclictest0-21swapper/020:05:400
413388199153,6cyclictest0-21swapper/322:39:343
413388199151,7cyclictest0-21swapper/300:14:413
413387999159,3cyclictest0-21swapper/119:24:401
413387999154,8cyclictest55853-21aten2.4-expect22:34:321
413387999154,8cyclictest4186411-21grep21:24:351
413387999153,10cyclictest4167811-21idleruntime-cro20:50:401
413387999151,3cyclictest0-21swapper/100:04:391
413387899155,4cyclictest95004-21/usr/sbin/munin23:19:370
413387899154,7cyclictest152649-21/usr/sbin/munin00:29:460
4133878991512,2cyclictest4172759-21unixbench_singl21:04:420
413388099144,8cyclictest116700-21systemd-run23:45:402
413388099140,6cyclictest4174086-21/usr/sbin/munin21:09:422
413387999144,7cyclictest70166-21/usr/sbin/munin22:49:521
413387999143,9cyclictest4181626-21aten_r2power_vo21:19:331
413387999143,8cyclictest77688-21/usr/sbin/munin22:59:321
413387999142,7cyclictest90131-21ssh23:14:321
413387999142,3cyclictest11050irq/107-eth%d21:54:111
413387999141,7cyclictest148288-21tune2fs00:24:351
413387999140,2cyclictest11050irq/107-eth%d00:19:391
413387899149,2cyclictest0-21swapper/020:44:390
413387899148,5cyclictest4168786-21needreboot20:54:340
413387899142,10cyclictest4163167-21/usr/sbin/munin20:39:310
4133878991411,2cyclictest4147647-21unixbench_multi19:49:420
4133878991411,2cyclictest0-21swapper/020:14:360
4133878991410,3cyclictest4162215-21needreboot20:34:350
413387899140,8cyclictest0-21swapper/020:19:310
413388199134,3cyclictest0-21swapper/323:34:393
413388199133,5cyclictest0-21swapper/322:20:423
413388199133,5cyclictest0-21swapper/300:34:393
413388199133,4cyclictest0-21swapper/320:19:343
413388199132,6cyclictest0-21swapper/323:49:373
413388199132,4cyclictest0-21swapper/320:04:383
413388099132,8cyclictest4166584-21/usr/sbin/munin20:49:332
413387999139,3cyclictest111788-21systemd-journal21:10:401
413387999135,5cyclictest0-21swapper/119:49:371
413387999134,6cyclictest6021-21ssh21:39:361
413387999133,5cyclictest116670-21ssh23:45:401
413387999132,8cyclictest47154-21hostname22:24:311
413387999132,8cyclictest4136101-21tune2fs19:19:341
413387999132,8cyclictest10286-21fschecks_time21:44:321
413387999131,9cyclictest4170086-21fschecks_time20:59:341
413387999131,9cyclictest4170086-21fschecks_time20:59:341
413387999131,11cyclictest1069-21sort21:34:301
413387999130,9cyclictest4151593-21apt-get20:00:411
413387899135,3cyclictest4166484-21awk20:49:330
413387899131,8cyclictest0-21swapper/023:42:250
413387899131,8cyclictest0-21swapper/019:34:310
413387899130,8cyclictest0-21swapper/019:59:380
413388199123,6cyclictest0-21swapper/323:39:343
413388199123,5cyclictest0-21swapper/321:59:393
413388199123,4cyclictest0-21swapper/321:49:363
413388199123,4cyclictest0-21swapper/300:04:353
413388199123,3cyclictest0-21swapper/320:55:183
413388199122,7cyclictest0-21swapper/323:19:373
413388199122,7cyclictest0-21swapper/320:34:333
413388199122,6cyclictest0-21swapper/300:29:353
413388199122,5cyclictest0-21swapper/323:26:163
413388199122,5cyclictest0-21swapper/321:39:363
413388099121,2cyclictest11050irq/107-eth%d19:34:332
413387999129,2cyclictest4166055-21grep20:44:401
413387999129,2cyclictest4142359-21unixbench_multi19:34:401
413387999129,1cyclictest0-21swapper/119:29:361
413387999128,2cyclictest0-21swapper/120:34:331
413387999127,2cyclictest0-21swapper/120:24:391
413387999122,9cyclictest51503-21head22:29:351
413387999122,7cyclictest82060-21tr23:04:351
413387999122,7cyclictest35025-21munin-plugin-st22:10:401
413387999122,5cyclictest4178052-21/usr/sbin/munin21:14:411
413387999121,7cyclictest4163866-21/usr/sbin/munin20:39:361
4133879991210,1cyclictest0-21swapper/119:44:351
413387899125,2cyclictest4173175-21awk21:09:330
413387899123,5cyclictest4158760-21/usr/sbin/munin20:24:340
413387899122,6cyclictest4148082-21/usr/sbin/munin19:54:310
413387899122,4cyclictest4144697-21/usr/sbin/munin19:44:350
413387899120,8cyclictest0-21swapper/020:29:420
413387899120,1cyclictest4139399-21/usr/sbin/munin19:29:380
413388199113,4cyclictest0-21swapper/322:40:423
413388199112,5cyclictest0-21swapper/322:54:323
413388199112,5cyclictest0-21swapper/321:34:293
413388199112,3cyclictest0-21swapper/321:19:323
413388199111,6cyclictest0-21swapper/323:04:353
413388199111,5cyclictest0-21swapper/322:14:413
413388199111,5cyclictest0-21swapper/322:00:423
413388199111,5cyclictest0-21swapper/321:00:403
413388199111,5cyclictest0-21swapper/321:00:403
413388099114,5cyclictest4144083-21munin-plugin-st19:40:402
413388099114,4cyclictest0-21swapper/220:19:382
413387999115,5cyclictest4142980-21/usr/sbin/munin19:39:371
413387999112,8cyclictest127798-21fschecks_time23:59:331
413387999111,7cyclictest4160204-21cut20:29:331
413387999110,10cyclictest4171858-21grep21:04:341
413387899114,4cyclictest4143067-21/usr/sbin/munin19:39:370
413388199106,3cyclictest0-21swapper/319:34:333
413388199105,3cyclictest0-21swapper/320:49:393
413388199104,4cyclictest0-21swapper/323:09:353
413388199104,4cyclictest0-21swapper/322:59:323
413388199104,3cyclictest0-21swapper/323:24:333
413388199103,4cyclictest0-21swapper/321:44:303
413388199103,4cyclictest0-21swapper/320:44:313
413388199103,4cyclictest0-21swapper/319:39:363
413388199103,3cyclictest0-21swapper/319:19:403
413388199102,5cyclictest0-21swapper/322:49:493
413388199102,5cyclictest0-21swapper/322:19:323
413388199102,5cyclictest0-21swapper/322:09:363
413388199102,5cyclictest0-21swapper/300:19:413
413388199102,4cyclictest0-21swapper/322:34:313
413388199102,4cyclictest0-21swapper/321:24:423
413388199102,4cyclictest0-21swapper/321:14:323
413388199102,4cyclictest0-21swapper/319:29:343
413388199102,4cyclictest0-21swapper/300:37:393
413388199101,5cyclictest0-21swapper/300:09:373
413388199101,4cyclictest0-21swapper/323:14:323
413388199100,6cyclictest0-21swapper/323:54:403
413388199100,6cyclictest0-21swapper/300:24:343
413388099101,7cyclictest4164765-21/usr/sbin/munin20:44:302
413387999103,5cyclictest4153615-21fschecks_time20:09:351
413387999101,5cyclictest4168039-21/usr/sbin/munin20:54:301
41338819995,3cyclictest0-21swapper/322:29:433
41338819993,4cyclictest0-21swapper/321:54:393
41338819993,4cyclictest0-21swapper/319:24:363
41338819993,3cyclictest0-21swapper/319:54:403
41338819993,3cyclictest0-21swapper/319:44:353
41338819992,4cyclictest0-21swapper/321:04:333
41338819992,4cyclictest0-21swapper/319:59:363
41338819992,3cyclictest0-21swapper/320:24:303
41338819991,4cyclictest0-21swapper/319:49:333
41338819990,5cyclictest0-21swapper/321:27:593
41338809992,5cyclictest0-21swapper/219:10:402
41338789991,6cyclictest4133976-21latency_hist19:10:400
41338819982,4cyclictest0-21swapper/321:09:333
41338819982,4cyclictest0-21swapper/320:29:343
41338819982,4cyclictest0-21swapper/320:14:383
41338819982,3cyclictest0-21swapper/320:39:333
41338819981,4cyclictest0-21swapper/319:14:343
41338819973,2cyclictest0-21swapper/323:45:403
41338819972,3cyclictest0-21swapper/320:09:383
41338819964,1cyclictest0-21swapper/319:10:403
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional