You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-11-23 - 17:37
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot6.osadl.org (updated Sat Nov 23, 2024 12:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2731021820,3sleep01189899cyclictest08:27:470
1518911720,50ptp4l20220-21kworker/3:007:55:383
145012680,5sleep314503-21irqrtprio10:07:553
11904996754,7cyclictest25-21ksoftirqd/110:02:471
11904996754,7cyclictest25-21ksoftirqd/110:02:471
168852630,3sleep30-21swapper/308:03:053
111832600,4sleep21190899cyclictest13:12:462
116372594,43sleep00-21swapper/007:55:230
146422580,2sleep00-21swapper/010:47:550
7762560,4sleep233-21ksoftirqd/213:01:542
115192544,9sleep20-21swapper/207:53:522
48982510,2sleep10-21swapper/111:16:141
11904994534,5cyclictest25-21ksoftirqd/108:27:451
189152400,1sleep10-21swapper/108:07:571
151891390,1ptp4l401ktimersoftd/313:06:033
151891390,1ptp4l401ktimersoftd/311:57:533
151891390,1ptp4l401ktimersoftd/310:23:263
1191599391,30cyclictest1660-21apt-get10:32:483
1191599391,29cyclictest30022-21apt-get10:27:503
151891380,1ptp4l401ktimersoftd/312:22:243
151891380,1ptp4l401ktimersoftd/310:49:373
151891380,1ptp4l401ktimersoftd/310:41:573
151891370,1ptp4l401ktimersoftd/313:15:333
151891370,1ptp4l401ktimersoftd/311:18:063
151891370,1ptp4l401ktimersoftd/309:37:353
151891370,1ptp4l401ktimersoftd/308:17:043
151891370,1ptp4l401ktimersoftd/308:17:043
1191599372,32cyclictest11551-21grep10:43:073
11898993729,5cyclictest25850-21cron09:32:350
151891360,1ptp4l401ktimersoftd/312:54:513
151891360,1ptp4l401ktimersoftd/312:49:023
151891360,1ptp4l401ktimersoftd/312:17:013
151891360,1ptp4l401ktimersoftd/311:07:593
151891360,1ptp4l401ktimersoftd/309:24:403
1191599362,26cyclictest5631-21apt-get12:32:513
11915993621,12cyclictest41-21ksoftirqd/309:33:543
11915993615,18cyclictest31957-21ls08:37:453
151891350,1ptp4l401ktimersoftd/313:01:543
151891350,0ptp4l401ktimersoftd/311:22:573
1191599353,26cyclictest0-21swapper/309:47:483
1191599352,30cyclictest22475-21gltestperf10:57:573
1191599352,25cyclictest31090-21apt-get11:47:523
1191599352,25cyclictest31090-21apt-get11:47:523
11904993529,3cyclictest25-21ksoftirqd/109:12:351
1191599342,24cyclictest17588-21apt-get08:07:463
11915993414,17cyclictest5406-21cat12:32:403
11915993412,19cyclictest29410-21cut12:22:583
1191599340,2cyclictest0-21swapper/313:24:383
1191599340,2cyclictest0-21swapper/313:24:383
1191599340,2cyclictest0-21swapper/308:57:363
11904993419,7cyclictest25-21ksoftirqd/109:17:481
310952332,3sleep2121rcu_preempt11:47:522
310952332,3sleep2121rcu_preempt11:47:522
1191599332,24cyclictest1931-21apt-get11:12:503
1191599332,24cyclictest12163-21apt-get07:57:453
11915993314,16cyclictest11360-21timerandwakeup10:03:083
11915993314,16cyclictest11360-21timerandwakeup10:03:083
11915993313,17cyclictest5915-21sh11:55:113
11915993313,17cyclictest12215-21sh12:02:543
11915993313,16cyclictest3813-21cat09:52:533
1191599331,29cyclictest30316-21ssh11:46:563
1191599331,29cyclictest26189-21cut11:02:523
1191599331,25cyclictest10384-21apt-get12:37:523
1191599331,24cyclictest30890-21apt-get09:42:473
11904993321,5cyclictest25-21ksoftirqd/112:42:531
11904993320,6cyclictest25-21ksoftirqd/110:12:471
11915993212,17cyclictest16569-21grep13:18:013
11915993212,17cyclictest16569-21grep13:18:013
11915993211,18cyclictest22515-21cat08:17:483
1191599320,2cyclictest0-21swapper/308:47:083
1191599320,29cyclictest5292-21diskmemload09:59:573
11908993226,3cyclictest33-21ksoftirqd/210:27:362
11904993227,3cyclictest25-21ksoftirqd/112:02:391
11904993227,3cyclictest25-21ksoftirqd/110:47:381
11904993226,3cyclictest25-21ksoftirqd/112:48:001
11904993218,6cyclictest25-21ksoftirqd/111:37:531
1169323211,10sleep10-21swapper/107:56:091
260662310,4sleep01189899cyclictest12:53:090
1191599314,24cyclictest19173-21tr09:17:493
1191599314,23cyclictest30051-21if_err_enp1s0.108:32:543
1191599312,22cyclictest16389-21apt-get12:07:513
1191599311,25cyclictest14121-21apt-get11:27:503
11915993112,16cyclictest24608-21/usr/sbin/munin08:22:493
11915993112,16cyclictest15380-21cat12:42:553
11915993111,17cyclictest11457-21basename09:02:473
11915993110,17cyclictest5498-21grep08:47:583
1191599310,3cyclictest47650irq/102-ens3-Tx10:53:073
1191599310,2cyclictest0-21swapper/311:33:033
11904993126,3cyclictest25-21ksoftirqd/113:22:401
11904993126,3cyclictest25-21ksoftirqd/113:22:401
11904993126,3cyclictest25-21ksoftirqd/112:17:391
11904993126,3cyclictest25-21ksoftirqd/111:07:581
11904993125,3cyclictest25-21ksoftirqd/113:27:401
11904993125,3cyclictest25-21ksoftirqd/113:27:401
11904993125,3cyclictest25-21ksoftirqd/112:37:401
11904993125,3cyclictest25-21ksoftirqd/110:12:371
11904993117,6cyclictest25-21ksoftirqd/110:17:561
1191599307,20cyclictest6958-21fschecks_time13:07:583
11915993011,16cyclictest40292irq/92-enp1s0-T10:13:533
1191599300,2cyclictest0-21swapper/309:12:363
1191599300,2cyclictest0-21swapper/308:28:033
1191599300,26cyclictest21857-21bc10:17:553
11908993025,3cyclictest33-21ksoftirqd/213:22:412
11908993023,4cyclictest33-21ksoftirqd/211:27:442
11904993025,3cyclictest25-21ksoftirqd/109:02:351
11904993024,3cyclictest25-21ksoftirqd/112:58:001
11904993024,3cyclictest25-21ksoftirqd/111:47:381
11904993024,3cyclictest25-21ksoftirqd/110:51:191
11904993024,3cyclictest25-21ksoftirqd/109:37:501
11904993024,3cyclictest25-21ksoftirqd/108:17:331
11904993024,3cyclictest25-21ksoftirqd/108:17:331
1191599295,20cyclictest8775-21date08:57:353
1191599293,23cyclictest23968-21cstates09:27:483
1191599290,2cyclictest0-21swapper/311:39:203
1191599290,25cyclictest14198-21tr09:07:483
11908992924,3cyclictest33-21ksoftirqd/210:07:362
11908992924,3cyclictest33-21ksoftirqd/210:07:362
11908992922,4cyclictest33-21ksoftirqd/211:39:442
11904992924,3cyclictest6092-21grep11:17:551
11904992924,3cyclictest25-21ksoftirqd/113:03:011
11904992924,3cyclictest25-21ksoftirqd/110:37:371
11904992923,3cyclictest25-21ksoftirqd/111:32:571
11904992922,4cyclictest25-21ksoftirqd/108:36:151
11904992917,5cyclictest25-21ksoftirqd/109:57:521
11904992916,6cyclictest25-21ksoftirqd/112:02:511
11908992822,3cyclictest33-21ksoftirqd/212:08:112
11908992822,3cyclictest33-21ksoftirqd/208:30:252
11908992821,4cyclictest33-21ksoftirqd/212:04:132
11908992821,4cyclictest33-21ksoftirqd/208:50:052
11904992823,3cyclictest25-21ksoftirqd/110:58:101
11904992823,3cyclictest25-21ksoftirqd/109:47:351
11904992822,4cyclictest25-21ksoftirqd/108:37:551
11904992822,3cyclictest25-21ksoftirqd/112:27:571
11904992822,3cyclictest25-21ksoftirqd/111:47:571
11904992822,3cyclictest25-21ksoftirqd/111:47:571
11904992822,3cyclictest25-21ksoftirqd/111:28:081
11904992822,3cyclictest25-21ksoftirqd/110:24:551
248112270,3sleep024819-21ssh10:20:500
11908992721,3cyclictest33-21ksoftirqd/212:38:122
11908992721,3cyclictest33-21ksoftirqd/208:05:072
11908992720,4cyclictest33-21ksoftirqd/209:21:332
11908992720,4cyclictest33-21ksoftirqd/208:54:552
11904992722,3cyclictest25-21ksoftirqd/112:57:401
11904992722,3cyclictest25-21ksoftirqd/112:38:031
11904992722,3cyclictest25-21ksoftirqd/111:27:371
11904992722,3cyclictest25-21ksoftirqd/110:53:021
11904992721,3cyclictest25-21ksoftirqd/109:22:521
11904992721,3cyclictest25-21ksoftirqd/109:02:501
11904992721,3cyclictest25-21ksoftirqd/108:07:331
11904992720,4cyclictest25-21ksoftirqd/109:37:351
11904992715,6cyclictest25-21ksoftirqd/112:22:511
11908992621,3cyclictest33-21ksoftirqd/211:22:572
11908992621,3cyclictest33-21ksoftirqd/208:12:432
11908992621,3cyclictest33-21ksoftirqd/208:12:432
11908992620,4cyclictest33-21ksoftirqd/209:26:032
11908992620,4cyclictest33-21ksoftirqd/209:11:292
11908992620,3cyclictest33-21ksoftirqd/211:14:322
11908992620,3cyclictest33-21ksoftirqd/208:23:382
11908992620,3cyclictest33-21ksoftirqd/208:09:462
11908992619,4cyclictest33-21ksoftirqd/212:44:282
11908992619,4cyclictest33-21ksoftirqd/210:39:052
11908992619,4cyclictest33-21ksoftirqd/210:35:402
11908992619,4cyclictest33-21ksoftirqd/207:58:232
11904992621,3cyclictest25-21ksoftirqd/112:17:501
11904992621,3cyclictest25-21ksoftirqd/112:08:091
11904992621,3cyclictest25-21ksoftirqd/111:52:571
11904992621,3cyclictest25-21ksoftirqd/110:27:561
11904992621,3cyclictest25-21ksoftirqd/109:17:351
11904992621,3cyclictest25-21ksoftirqd/108:47:341
11904992621,3cyclictest25-21ksoftirqd/108:17:531
11898992620,3cyclictest9-21ksoftirqd/009:20:210
11898992619,4cyclictest9-21ksoftirqd/008:48:590
11898992619,4cyclictest10321-21basename10:02:530
11898992619,4cyclictest10321-21basename10:02:530
11898992613,3cyclictest9-21ksoftirqd/013:21:510
11898992613,3cyclictest9-21ksoftirqd/013:21:510
11898992610,10cyclictest9-21ksoftirqd/008:41:560
84202250,2sleep10-21swapper/113:08:121
1190899252,14cyclictest5639-21ssh12:32:522
1190899252,10cyclictest21024-21ssh13:22:562
1190899252,10cyclictest21024-21ssh13:22:562
11908992520,3cyclictest33-21ksoftirqd/212:47:542
11908992519,4cyclictest33-21ksoftirqd/211:08:482
11908992519,3cyclictest33-21ksoftirqd/209:42:122
11908992519,3cyclictest33-21ksoftirqd/208:41:082
11908992518,4cyclictest33-21ksoftirqd/210:15:172
11908992518,4cyclictest33-21ksoftirqd/209:52:522
11908992518,4cyclictest33-21ksoftirqd/209:49:272
1190899251,21cyclictest9326-21grep11:58:112
11904992520,3cyclictest25-21ksoftirqd/113:12:591
11904992519,3cyclictest25-21ksoftirqd/109:55:121
11904992519,3cyclictest25-21ksoftirqd/108:56:311
11904992519,3cyclictest25-21ksoftirqd/108:01:191
11898992519,3cyclictest9-21ksoftirqd/010:27:380
11898992519,3cyclictest9-21ksoftirqd/009:02:240
11898992519,3cyclictest8244-21ps11:57:590
11898992518,4cyclictest9-21ksoftirqd/012:04:110
11898992518,4cyclictest9-21ksoftirqd/009:43:110
11898992518,4cyclictest9-21ksoftirqd/008:20:450
11908992419,3cyclictest33-21ksoftirqd/210:57:382
11908992419,3cyclictest33-21ksoftirqd/210:27:522
11908992419,3cyclictest33-21ksoftirqd/209:36:222
11908992419,3cyclictest33-21ksoftirqd/209:31:002
11908992418,3cyclictest33-21ksoftirqd/209:46:482
11908992417,4cyclictest33-21ksoftirqd/210:48:332
11908992417,4cyclictest33-21ksoftirqd/209:03:022
11908992417,4cyclictest33-21ksoftirqd/208:21:192
1190899241,20cyclictest1992-21df08:42:472
1190899240,22cyclictest0-21swapper/211:18:002
11904992419,3cyclictest25-21ksoftirqd/110:38:041
11904992418,3cyclictest25-21ksoftirqd/111:07:381
11904992417,4cyclictest25-21ksoftirqd/109:49:381
11898992419,3cyclictest9-21ksoftirqd/011:31:470
11898992418,3cyclictest9-21ksoftirqd/013:13:060
11898992418,3cyclictest9-21ksoftirqd/012:39:260
11898992418,3cyclictest9-21ksoftirqd/008:36:220
11898992418,3cyclictest9-21ksoftirqd/008:10:530
11898992417,4cyclictest9-21ksoftirqd/009:36:160
11898992417,4cyclictest9-21ksoftirqd/008:45:220
11898992417,4cyclictest9-21ksoftirqd/008:03:220
11898992414,5cyclictest2775-21irqrtprio13:03:010
1189899241,20cyclictest29256-21taskset11:06:180
11908992318,3cyclictest33-21ksoftirqd/212:52:532
11908992318,3cyclictest33-21ksoftirqd/209:57:572
11908992317,4cyclictest33-21ksoftirqd/211:32:512
11908992316,4cyclictest33-21ksoftirqd/212:29:342
1190899230,21cyclictest1769-21/usr/sbin/munin13:03:022
1190899230,20cyclictest30862-21date08:33:042
11904992317,3cyclictest25-21ksoftirqd/108:47:461
11898992317,3cyclictest9-21ksoftirqd/009:50:240
11898992317,3cyclictest9-21ksoftirqd/008:25:460
11898992317,3cyclictest15290-21tr12:42:540
11898992316,4cyclictest9-21ksoftirqd/011:34:040
11898992316,4cyclictest6905-21cut08:52:490
11898992316,4cyclictest22327-21grep10:57:570
1189899231,19cyclictest1505-21runrttasks10:57:360
1190899223,11cyclictest9782-21ssh10:42:502
11908992217,3cyclictest33-21ksoftirqd/210:17:592
11908992216,4cyclictest18887-21ssh13:20:002
1190899221,4cyclictest26447-21ssh12:19:342
1190899221,3cyclictest0-21swapper/212:17:132
1190899221,18cyclictest18015-21snmp_o5powerctl09:12:592
1190899220,20cyclictest5292-21diskmemload13:07:512
1190899220,19cyclictest29338-21taskset11:44:582
1190899220,19cyclictest291002sleep211:05:592
11904992216,3cyclictest25-21ksoftirqd/109:32:351
11898992215,4cyclictest9-21ksoftirqd/009:41:180
11898992215,4cyclictest23436-21sh12:17:390
1189899221,3cyclictest10441-21interrupts10:42:560
1189899221,13cyclictest26617-21ssh11:42:510
11908992115,3cyclictest33-21ksoftirqd/209:02:352
1190899211,2cyclictest5292-21diskmemload10:10:532
11908992111,8cyclictest5292-21diskmemload10:57:532
1190899211,18cyclictest0-21swapper/212:24:542
1190899210,19cyclictest0-21swapper/211:53:232
11904992116,3cyclictest25-21ksoftirqd/108:23:311
11898992116,3cyclictest9-21ksoftirqd/010:40:520
11898992116,3cyclictest9-21ksoftirqd/009:26:110
11898992116,3cyclictest9-21ksoftirqd/007:59:450
11898992115,3cyclictest9-21ksoftirqd/011:42:230
11898992115,3cyclictest21047-21sh12:48:030
1189899211,4cyclictest28835-21diskstats12:22:540
11898992114,4cyclictest9-21ksoftirqd/009:12:240
11898992114,4cyclictest25185-21sh13:27:250
11898992114,4cyclictest25185-21sh13:27:250
54952200,2sleep00-21swapper/011:17:300
11898992015,3cyclictest9-21ksoftirqd/011:49:400
11898992015,3cyclictest9-21ksoftirqd/011:49:400
11898992015,3cyclictest18690-21tr10:12:540
11898992014,4cyclictest9-21ksoftirqd/009:04:530
11898992014,3cyclictest9881-21sh12:37:300
11898992014,3cyclictest9-21ksoftirqd/011:24:420
11898992014,3cyclictest9-21ksoftirqd/010:32:570
11898992014,3cyclictest15124-21sh10:07:590
11898992013,5cyclictest9-21ksoftirqd/011:12:260
11898992013,4cyclictest9-21ksoftirqd/009:16:410
11898992013,4cyclictest8161-21sh11:19:070
11898992013,4cyclictest6799-21grep09:58:010
11898992013,4cyclictest5438-21ls09:57:360
11898992013,4cyclictest29227-21sh10:26:420
11898992013,4cyclictest2903-21sh12:28:280
11898992012,5cyclictest3625-21idleruntime11:52:550
1189899201,17cyclictest0-21swapper/013:07:590
11898991913,4cyclictest20107-21ls08:12:460
11898991913,4cyclictest20107-21ls08:12:460
11898991913,3cyclictest29194-21sh12:57:490
11898991912,4cyclictest16911-21idleruntime12:07:560
1189899190,3cyclictest24426-21if_ens312:17:540
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional