You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-11-22 - 08:32
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Fri Nov 22, 2024 00:50:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1923929287,2sleep60-21swapper/619:05:246
1941228454,26sleep00-21swapper/019:05:490
1967228248,30sleep70-21swapper/719:09:337
1966827945,29sleep30-21swapper/319:09:293
1953827742,30sleep40-21swapper/419:07:374
1947927743,29sleep20-21swapper/219:06:482
1956427642,30sleep10-21swapper/119:07:591
1945327541,29sleep50-21swapper/519:06:275
267882500,0sleep50-21swapper/523:28:475
214392500,0sleep30-21swapper/321:52:293
116972500,0sleep70-21swapper/723:53:567
26902480,0sleep50-21swapper/520:25:135
213012480,0sleep10-21swapper/121:36:421
165942480,1sleep72014299cyclictest22:05:227
252742470,0sleep70-21swapper/722:25:177
155142460,0sleep70-21swapper/700:26:317
118982440,0sleep10-21swapper/122:50:161
292522430,0sleep20-21swapper/221:40:192
13032430,0sleep10-21swapper/123:00:181
20136993737,0cyclictest0-21swapper/120:25:161
20140993028,1cyclictest313-21systemd-journal23:58:255
20139992810,17cyclictest0-21swapper/422:40:114
20136992828,0cyclictest0-21swapper/123:21:121
20137992423,1cyclictest0-21swapper/220:30:112
20140992116,5cyclictest662-21ptp4l00:21:385
20139992110,9cyclictest0-21swapper/423:14:544
20139992110,7cyclictest0-21swapper/421:58:344
20139992110,6cyclictest0-21swapper/422:46:264
20142992016,3cyclictest18400-21nscd00:02:347
20139992017,0cyclictest69450irq/124-eth023:32:134
20139992010,9cyclictest69450irq/124-eth000:15:124
20139992010,9cyclictest0-21swapper/423:44:084
20139992010,9cyclictest0-21swapper/422:00:214
20139992010,9cyclictest0-21swapper/400:30:564
20139992010,7cyclictest0-21swapper/400:39:374
20139992010,6cyclictest0-21swapper/422:24:244
20139992010,6cyclictest0-21swapper/422:13:574
20139992010,5cyclictest0-21swapper/421:44:354
20138992017,3cyclictest2593-21kworker/3:100:18:413
20138992015,5cyclictest2593-21kworker/3:100:12:063
20137992020,0cyclictest0-21swapper/200:18:202
20137992010,0cyclictest0-21swapper/223:11:422
20135992010,10cyclictest0-21swapper/022:50:280
20142991917,2cyclictest23139-21munin-node22:56:267
20141991919,0cyclictest0-21swapper/620:30:116
20139991910,8cyclictest0-21swapper/423:49:324
20139991910,8cyclictest0-21swapper/423:36:264
20139991910,8cyclictest0-21swapper/422:16:204
20139991910,8cyclictest0-21swapper/421:50:114
20139991910,8cyclictest0-21swapper/421:48:074
20139991910,6cyclictest69450irq/124-eth021:35:544
20139991910,6cyclictest0-21swapper/423:22:554
20139991910,6cyclictest0-21swapper/423:18:374
20139991910,6cyclictest0-21swapper/423:18:364
20139991910,6cyclictest0-21swapper/423:04:304
20139991910,6cyclictest0-21swapper/422:34:104
20139991910,6cyclictest0-21swapper/400:27:574
20139991910,6cyclictest0-21swapper/400:06:304
20139991910,5cyclictest0-21swapper/422:06:544
20139991910,5cyclictest0-21swapper/421:26:384
20139991910,5cyclictest0-21swapper/421:15:204
20139991910,5cyclictest0-21swapper/419:29:074
20139991910,5cyclictest0-21swapper/400:02:594
20138991918,1cyclictest29239-21nscd22:45:063
20138991912,1cyclictest121rcu_preempt23:39:093
20138991911,6cyclictest30902-21kworker/3:123:28:343
20137991919,0cyclictest0-21swapper/219:28:282
20137991910,0cyclictest0-21swapper/222:21:072
20135991910,9cyclictest0-21swapper/023:24:560
20142991818,0cyclictest0-21swapper/722:02:107
20142991818,0cyclictest0-21swapper/700:31:087
20142991810,3cyclictest0-21swapper/700:16:427
2014199180,0cyclictest0-21swapper/600:01:206
20140991816,1cyclictest630-21avahi-daemon22:11:375
20140991814,3cyclictest6858-21runrttasks22:32:065
20140991813,0cyclictest8970-21kworker/u16:000:12:395
20140991810,7cyclictest0-21swapper/519:55:115
20140991810,0cyclictest0-21swapper/500:16:135
20139991810,8cyclictest0-21swapper/423:07:284
20139991810,7cyclictest0-21swapper/423:55:234
20139991810,7cyclictest0-21swapper/423:50:084
20139991810,7cyclictest0-21swapper/423:25:064
20139991810,7cyclictest0-21swapper/422:55:094
20139991810,7cyclictest0-21swapper/422:50:204
20139991810,7cyclictest0-21swapper/421:30:094
20139991810,7cyclictest0-21swapper/421:20:074
20139991810,7cyclictest0-21swapper/421:10:104
20139991810,7cyclictest0-21swapper/421:00:154
20139991810,7cyclictest0-21swapper/420:44:574
20139991810,7cyclictest0-21swapper/420:38:104
20139991810,7cyclictest0-21swapper/420:30:174
20139991810,7cyclictest0-21swapper/420:15:184
20139991810,7cyclictest0-21swapper/420:13:314
20139991810,7cyclictest0-21swapper/420:05:234
20139991810,7cyclictest0-21swapper/419:52:054
20139991810,7cyclictest0-21swapper/419:32:224
20139991810,7cyclictest0-21swapper/419:20:194
20139991810,7cyclictest0-21swapper/400:13:434
20139991810,6cyclictest0-21swapper/422:38:454
20139991810,5cyclictest0-21swapper/422:25:204
20138991811,5cyclictest662-21ptp4l00:30:193
20137991818,0cyclictest0-21swapper/222:59:242
20137991810,3cyclictest0-21swapper/220:25:172
20135991810,3cyclictest0-21swapper/020:25:180
20135991810,0cyclictest0-21swapper/023:17:260
20135991810,0cyclictest0-21swapper/023:17:250
20141991710,7cyclictest0-21swapper/623:47:066
20140991716,1cyclictest5497-21nscd00:37:275
20139991710,6cyclictest0-21swapper/421:05:024
20139991710,6cyclictest0-21swapper/420:55:024
20139991710,6cyclictest0-21swapper/420:50:124
20139991710,6cyclictest0-21swapper/420:25:184
20139991710,6cyclictest0-21swapper/420:20:154
20139991710,6cyclictest0-21swapper/419:55:124
20139991710,6cyclictest0-21swapper/419:40:144
20139991710,6cyclictest0-21swapper/419:15:114
20139991710,6cyclictest0-21swapper/400:20:224
20138991716,1cyclictest2593-21kworker/3:100:26:413
20138991715,1cyclictest401ktimersoftd/322:42:313
20138991711,4cyclictest632-21irqbalance21:30:293
20138991710,4cyclictest121rcu_preempt23:54:503
20136991710,2cyclictest0-21swapper/119:10:001
1723321710,5sleep50-21swapper/522:52:455
226512164,0sleep622677-21ssh00:15:026
20142991614,2cyclictest649-21nscd00:21:237
20142991612,1cyclictest20133-21cyclictest22:40:417
20142991610,2cyclictest0-21swapper/723:40:407
20142991610,0cyclictest0-21swapper/723:24:077
20142991610,0cyclictest0-21swapper/722:50:367
20141991615,1cyclictest7590-21ssh00:23:046
20141991610,6cyclictest0-21swapper/623:09:316
20141991610,5cyclictest0-21swapper/621:05:176
20141991610,3cyclictest0-21swapper/622:22:546
20141991610,2cyclictest0-21swapper/623:31:546
20140991615,1cyclictest1080-21wc22:29:595
20140991614,2cyclictest23139-21munin-node22:09:385
20140991610,6cyclictest0-21swapper/500:27:325
20140991610,4cyclictest0-21swapper/522:43:535
20140991610,0cyclictest0-21swapper/523:40:065
20140991610,0cyclictest0-21swapper/521:45:005
20139991610,6cyclictest0-21swapper/420:45:114
20139991610,6cyclictest0-21swapper/420:00:134
20139991610,6cyclictest0-21swapper/419:45:124
20139991610,6cyclictest0-21swapper/419:35:124
20139991610,6cyclictest0-21swapper/419:10:124
20138991615,1cyclictest2593-21kworker/3:100:08:433
2013899161,4cyclictest0-21swapper/319:40:013
20138991614,1cyclictest641-21nscd00:35:483
20138991610,0cyclictest0-21swapper/323:20:403
20137991616,0cyclictest0-21swapper/219:10:122
20137991615,1cyclictest16750irq/126-ahci[0023:20:322
20137991615,0cyclictest14568-1kworker/u17:223:17:582
20137991615,0cyclictest14568-1kworker/u17:223:17:572
20137991610,5cyclictest0-21swapper/222:32:092
20137991610,3cyclictest0-21swapper/200:20:152
20137991610,2cyclictest0-21swapper/200:05:122
20137991610,0cyclictest0-21swapper/222:06:512
2013799160,16cyclictest0-21swapper/200:39:592
20136991610,6cyclictest0-21swapper/123:50:421
20136991610,6cyclictest0-21swapper/122:35:131
20136991610,6cyclictest0-21swapper/122:16:181
20136991610,0cyclictest0-21swapper/121:44:491
20135991616,0cyclictest11454-21strings23:05:170
20135991615,1cyclictest101ktimersoftd/022:34:430
20135991614,1cyclictest0-21swapper/020:35:100
20135991610,6cyclictest0-21swapper/023:55:540
20135991610,6cyclictest0-21swapper/022:07:550
20135991610,6cyclictest0-21swapper/000:26:520
20135991610,0cyclictest0-21swapper/000:14:200
242162150,0sleep2311rcuc/221:00:172
20142991514,1cyclictest8207-21ssh22:32:587
20142991514,1cyclictest27020-21tail21:55:127
20142991512,3cyclictest1560-21runrttasks23:57:227
20142991510,5cyclictest0-21swapper/723:36:097
20142991510,5cyclictest0-21swapper/722:48:027
20142991510,5cyclictest0-21swapper/700:10:107
20142991510,5cyclictest0-21swapper/700:07:247
20142991510,4cyclictest0-21swapper/721:25:127
20142991510,3cyclictest0-21swapper/720:26:397
20142991510,2cyclictest0-21swapper/721:45:097
20142991510,0cyclictest0-21swapper/723:15:167
20142991510,0cyclictest0-21swapper/723:15:157
20142991510,0cyclictest0-21swapper/723:12:407
20142991510,0cyclictest0-21swapper/722:35:077
20142991510,0cyclictest0-21swapper/721:10:327
20141991512,1cyclictest2802-21ssh21:28:136
20141991511,0cyclictest13128-21kworker/u16:223:11:186
20141991510,5cyclictest0-21swapper/622:53:106
20141991510,3cyclictest0-21swapper/623:57:236
20141991510,3cyclictest0-21swapper/622:00:106
20141991510,3cyclictest0-21swapper/620:30:016
20141991510,2cyclictest0-21swapper/622:08:286
20141991510,0cyclictest0-21swapper/623:42:116
20141991510,0cyclictest0-21swapper/623:27:336
20141991510,0cyclictest0-21swapper/600:28:006
20140991513,2cyclictest29239-21nscd21:46:375
20140991512,3cyclictest0-21swapper/521:19:305
20140991512,1cyclictest9187-21ssh21:30:395
20140991510,5cyclictest0-21swapper/523:22:525
20140991510,3cyclictest0-21swapper/523:15:545
20140991510,3cyclictest0-21swapper/523:15:535
20140991510,3cyclictest0-21swapper/523:11:075
20140991510,0cyclictest0-21swapper/523:35:175
20140991510,0cyclictest0-21swapper/523:34:265
20140991510,0cyclictest0-21swapper/523:09:055
20140991510,0cyclictest0-21swapper/522:55:315
20140991510,0cyclictest0-21swapper/522:46:365
20140991510,0cyclictest0-21swapper/522:21:195
20140991510,0cyclictest0-21swapper/500:32:075
20140991510,0cyclictest0-21swapper/500:07:495
20138991514,1cyclictest401ktimersoftd/323:00:113
20138991514,1cyclictest1466-21kworker/u16:122:17:573
20138991514,1cyclictest11156-21ssh21:47:343
20138991511,1cyclictest41-21ksoftirqd/319:20:013
20138991510,5cyclictest0-21swapper/323:56:163
20138991510,5cyclictest0-21swapper/321:00:203
20138991510,3cyclictest0-21swapper/322:00:163
20138991510,1cyclictest401ktimersoftd/300:04:283
20138991510,0cyclictest0-21swapper/323:47:353
20138991510,0cyclictest0-21swapper/323:05:183
20138991510,0cyclictest0-21swapper/322:30:063
20138991510,0cyclictest0-21swapper/322:12:343
20138991510,0cyclictest0-21swapper/321:37:293
20138991510,0cyclictest0-21swapper/320:26:513
20137991510,5cyclictest0-21swapper/222:38:112
20137991510,4cyclictest0-21swapper/223:03:552
20137991510,3cyclictest0-21swapper/221:33:322
20137991510,0cyclictest0-21swapper/222:50:492
20137991510,0cyclictest0-21swapper/222:45:032
20137991510,0cyclictest0-21swapper/221:19:072
20136991515,0cyclictest15599-21ls22:20:211
20136991515,0cyclictest0-21swapper/123:15:011
20136991515,0cyclictest0-21swapper/123:15:011
20136991510,5cyclictest0-21swapper/123:32:241
20136991510,5cyclictest0-21swapper/123:05:551
20136991510,5cyclictest0-21swapper/122:43:031
20136991510,5cyclictest0-21swapper/122:25:061
20136991510,5cyclictest0-21swapper/122:09:441
20136991510,5cyclictest0-21swapper/121:26:521
20136991510,3cyclictest0-21swapper/123:42:381
20136991510,3cyclictest0-21swapper/123:26:231
20136991510,2cyclictest0-21swapper/100:08:531
20136991510,0cyclictest0-21swapper/123:56:091
20136991510,0cyclictest0-21swapper/123:13:581
20136991510,0cyclictest0-21swapper/122:55:111
20136991510,0cyclictest0-21swapper/122:45:011
20136991510,0cyclictest0-21swapper/122:32:301
20136991510,0cyclictest0-21swapper/100:32:191
20136991510,0cyclictest0-21swapper/100:18:241
20136991510,0cyclictest0-21swapper/100:00:201
20135991510,5cyclictest0-21swapper/021:45:180
20135991510,3cyclictest0-21swapper/022:20:160
20135991510,3cyclictest0-21swapper/019:45:000
20135991510,1cyclictest0-21swapper/020:30:100
20135991510,0cyclictest0-21swapper/023:33:490
20135991510,0cyclictest0-21swapper/023:11:020
20135991510,0cyclictest0-21swapper/021:30:260
1952621510,4sleep30-21swapper/322:22:493
20142991413,1cyclictest734-21gmain19:53:057
20142991413,1cyclictest25245-21rm21:54:557
20142991410,4cyclictest0-21swapper/721:36:507
20142991410,0cyclictest0-21swapper/723:46:167
20142991410,0cyclictest0-21swapper/723:33:327
20142991410,0cyclictest0-21swapper/723:26:287
20142991410,0cyclictest0-21swapper/723:06:087
20142991410,0cyclictest0-21swapper/723:00:017
20142991410,0cyclictest0-21swapper/722:23:087
20142991410,0cyclictest0-21swapper/721:40:247
20142991410,0cyclictest0-21swapper/721:33:337
20142991410,0cyclictest0-21swapper/721:20:167
20142991410,0cyclictest0-21swapper/721:15:467
20142991410,0cyclictest0-21swapper/700:36:157
20141991412,1cyclictest641-21nscd23:20:196
20141991412,1cyclictest1560-21runrttasks21:03:236
20141991410,4cyclictest0-21swapper/623:00:336
20141991410,4cyclictest0-21swapper/622:10:466
20141991410,4cyclictest0-21swapper/600:33:336
20141991410,4cyclictest0-21swapper/600:07:346
20141991410,3cyclictest0-21swapper/622:35:426
20141991410,2cyclictest0-21swapper/623:36:016
20141991410,2cyclictest0-21swapper/622:31:356
20141991410,2cyclictest0-21swapper/622:19:446
20141991410,2cyclictest0-21swapper/621:21:086
20141991410,2cyclictest0-21swapper/600:37:156
20141991410,0cyclictest0-21swapper/623:52:036
20141991410,0cyclictest0-21swapper/623:17:336
20141991410,0cyclictest0-21swapper/623:17:336
20141991410,0cyclictest0-21swapper/622:56:036
20141991410,0cyclictest0-21swapper/622:45:346
20141991410,0cyclictest0-21swapper/622:25:326
20141991410,0cyclictest0-21swapper/621:55:296
20141991410,0cyclictest0-21swapper/621:34:216
20141991410,0cyclictest0-21swapper/621:11:146
20141991410,0cyclictest0-21swapper/600:12:426
2014099143,10cyclictest23139-21munin-node23:45:235
20140991414,0cyclictest19182-21ls21:20:155
20140991414,0cyclictest0-21swapper/523:50:015
20140991413,1cyclictest3561-1kworker/u17:121:55:275
20140991413,1cyclictest18400-21nscd21:10:455
20140991412,1cyclictest16702-21nscd21:25:465
20140991410,4cyclictest0-21swapper/523:00:315
20140991410,4cyclictest0-21swapper/522:15:065
20140991410,4cyclictest0-21swapper/521:37:425
20140991410,4cyclictest0-21swapper/519:25:005
20140991410,3cyclictest0-21swapper/519:10:115
20140991410,3cyclictest0-21swapper/500:00:045
20140991410,0cyclictest0-21swapper/522:35:475
20140991410,0cyclictest0-21swapper/522:01:185
20140991410,0cyclictest0-21swapper/521:54:215
20138991414,0cyclictest0-21swapper/321:21:073
20138991413,1cyclictest401ktimersoftd/323:32:523
20138991412,2cyclictest401ktimersoftd/323:13:123
20138991412,1cyclictest641-21nscd21:55:163
20138991412,1cyclictest401ktimersoftd/322:35:113
20138991412,1cyclictest401ktimersoftd/319:20:123
20138991412,1cyclictest28374-21diskmemload22:52:523
20138991410,4cyclictest0-21swapper/322:55:093
20138991410,2cyclictest0-21swapper/320:15:123
20138991410,2cyclictest0-21swapper/319:10:123
20138991410,0cyclictest0-21swapper/323:17:573
20138991410,0cyclictest0-21swapper/323:17:563
20138991410,0cyclictest0-21swapper/322:25:213
20138991410,0cyclictest0-21swapper/322:08:153
20138991410,0cyclictest0-21swapper/321:28:503
20138991410,0cyclictest0-21swapper/321:19:243
20138991410,0cyclictest0-21swapper/321:12:523
20138991410,0cyclictest0-21swapper/319:50:113
20138991410,0cyclictest0-21swapper/319:35:153
20138991410,0cyclictest0-21swapper/300:20:123
20137991414,0cyclictest0-21swapper/222:12:052
20137991413,1cyclictest0-21swapper/222:16:312
20137991412,2cyclictest16702-21nscd22:01:462
20137991410,4cyclictest0-21swapper/223:55:042
20137991410,4cyclictest0-21swapper/223:52:552
20137991410,4cyclictest0-21swapper/223:28:552
20137991410,4cyclictest0-21swapper/222:40:162
20137991410,4cyclictest0-21swapper/222:25:152
20137991410,4cyclictest0-21swapper/221:46:232
20137991410,4cyclictest0-21swapper/200:12:162
20137991410,0cyclictest0-21swapper/223:45:192
20137991410,0cyclictest0-21swapper/223:31:122
20137991410,0cyclictest0-21swapper/223:05:182
20137991410,0cyclictest0-21swapper/221:58:232
20137991410,0cyclictest0-21swapper/221:37:372
20137991410,0cyclictest0-21swapper/200:31:092
20137991410,0cyclictest0-21swapper/200:28:412
20136991414,0cyclictest0-21swapper/123:35:541
20136991414,0cyclictest0-21swapper/100:10:101
20136991412,0cyclictest641-21nscd22:11:281
20136991410,4cyclictest0-21swapper/121:47:431
20136991410,4cyclictest0-21swapper/121:15:071
20136991410,4cyclictest0-21swapper/119:35:141
20136991410,3cyclictest0-21swapper/123:46:051
20136991410,0cyclictest0-21swapper/122:00:311
20136991410,0cyclictest0-21swapper/121:32:581
20136991410,0cyclictest0-21swapper/121:23:551
20136991410,0cyclictest0-21swapper/120:30:231
20136991410,0cyclictest0-21swapper/100:35:231
20136991410,0cyclictest0-21swapper/100:25:521
20136991410,0cyclictest0-21swapper/100:21:181
20135991414,0cyclictest21635-21strings19:10:170
20135991414,0cyclictest0-21swapper/021:27:440
20135991413,1cyclictest641-21nscd23:27:400
20135991410,4cyclictest0-21swapper/023:41:380
20135991410,4cyclictest0-21swapper/022:25:150
20135991410,4cyclictest0-21swapper/022:18:060
20135991410,4cyclictest0-21swapper/022:01:070
20135991410,4cyclictest0-21swapper/021:40:320
20135991410,4cyclictest0-21swapper/000:31:010
20135991410,0cyclictest0-21swapper/023:48:040
20135991410,0cyclictest0-21swapper/023:36:010
20135991410,0cyclictest0-21swapper/022:55:050
20135991410,0cyclictest0-21swapper/022:47:340
20135991410,0cyclictest0-21swapper/022:41:130
20135991410,0cyclictest0-21swapper/022:37:340
20135991410,0cyclictest0-21swapper/021:57:170
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional