You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-27 - 14:25
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Sat Jul 27, 2024 12:43:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
213532850,1sleep121352-21systemd-cgroups11:14:301
320172830,1sleep60-21swapper/607:00:416
169942580,1sleep233-21ksoftirqd/212:28:562
44802540,0sleep10-21swapper/112:24:381
216852510,0sleep7721ktimersoftd/711:36:157
99224825,8sleep30-21swapper/307:03:443
113422480,0sleep00-21swapper/009:30:340
169812470,0sleep40-21swapper/412:19:374
323372450,0sleep30-21swapper/310:02:403
189422450,1sleep665-21ksoftirqd/612:29:086
121102450,0sleep60-21swapper/611:00:426
293232440,0sleep00-21swapper/011:34:000
107824431,9sleep00-21swapper/007:04:530
27862430,0sleep30-21swapper/311:15:443
251712430,0sleep40-21swapper/410:08:344
148532430,2sleep4127799cyclictest09:24:134
148532430,2sleep4127799cyclictest09:24:134
108724331,8sleep70-21swapper/707:05:007
79424229,9sleep10-21swapper/107:01:101
22442420,0sleep40-21swapper/411:21:544
115862410,0sleep40-21swapper/411:16:344
104324130,8sleep20-21swapper/207:04:232
3105524028,9sleep40-21swapper/407:00:324
273402400,0sleep50-21swapper/511:40:055
100424028,9sleep50-21swapper/507:03:545
24992390,0sleep10-21swapper/111:28:161
214262390,0sleep50-21swapper/510:21:245
197512300,2sleep6129699cyclictest10:51:216
150012190,0sleep00-21swapper/010:40:500
130362180,0sleep51-21systemd09:47:215
312672170,0sleep10-21swapper/109:45:491
29522170,0sleep30-21swapper/309:53:033
207062170,0sleep50-21swapper/509:58:105
82132160,0sleep00-21swapper/012:18:450
298632160,0sleep30-21swapper/311:46:283
147572160,0sleep50-21swapper/509:06:365
30192150,1sleep21-21systemd10:26:102
30192150,1sleep21-21systemd10:26:102
265522150,0sleep70-21swapper/711:27:267
203862150,0sleep40-21swapper/410:04:504
128999159,4cyclictest27148-21sshd11:52:315
101172150,1sleep110116-21sshd12:00:191
54102140,2sleep6129699cyclictest11:40:546
318452140,0sleep50-21swapper/507:55:505
173652140,0sleep20-21swapper/210:20:572
1272991414,0cyclictest0-21swapper/309:37:373
1272991414,0cyclictest0-21swapper/309:37:373
111392140,0sleep50-21swapper/509:33:515
70572130,0sleep40-21swapper/410:26:364
70572130,0sleep40-21swapper/410:26:364
191852130,0sleep30-21swapper/311:23:373
130499135,2cyclictest11729-21kill11:16:347
130499132,7cyclictest19526-21systemd-cgroups09:51:197
128999136,1cyclictest6008-21grepconf.sh11:19:155
1277991310,2cyclictest698-21dbus-daemon11:08:434
119672130,0sleep50-21swapper/510:50:405
83082120,0sleep30-21swapper/309:43:343
50082120,0sleep15007-21systemd-cgroups09:53:171
166202120,0sleep449-21ksoftirqd/412:10:164
133122120,0sleep10-21swapper/109:24:021
133122120,0sleep10-21swapper/109:24:021
130499120,11cyclictest24580-21kworker/7:110:16:557
128999129,2cyclictest766-21gdbus12:19:175
128999126,0cyclictest0-21swapper/511:00:435
128999124,4cyclictest7322-21systemd10:10:055
128999124,4cyclictest0-21swapper/511:55:595
128999122,6cyclictest6422-21sshd10:50:075
128999120,5cyclictest0-21swapper/509:13:495
127799122,4cyclictest0-21swapper/409:36:564
127799122,4cyclictest0-21swapper/409:36:564
1277991210,1cyclictest0-21swapper/409:49:594
127299122,4cyclictest698-21dbus-daemon11:13:543
127299122,4cyclictest0-21swapper/309:47:093
126699124,4cyclictest4966-21bash09:43:131
126099120,9cyclictest26184-21kworker/0:110:35:300
70252110,0sleep60-21swapper/611:53:446
63372110,0sleep20-21swapper/210:43:242
46752110,0sleep70-21swapper/712:02:507
222482110,1sleep41-21systemd10:25:004
130499111,4cyclictest129032sleep710:37:207
129699119,1cyclictest65-21ksoftirqd/609:17:346
129699118,2cyclictest65-21ksoftirqd/612:31:526
129699110,10cyclictest7614-21systemd11:00:206
129699110,1cyclictest0-21swapper/610:20:176
128999117,3cyclictest717-21systemd-logind10:17:475
128999113,5cyclictest717-21systemd-logind09:23:355
128999113,5cyclictest717-21systemd-logind09:23:355
127799113,7cyclictest717-21systemd-logind11:29:544
127799111,4cyclictest0-21swapper/411:11:174
127799110,11cyclictest22072-21kworker/4:110:35:014
127299115,3cyclictest698-21dbus-daemon09:10:133
127299113,4cyclictest26076-21systemd-cgroups10:45:273
127299112,4cyclictest0-21swapper/311:43:533
127299111,4cyclictest3076-21systemd-cgroups12:02:413
127299111,4cyclictest10387-21sshd10:37:033
127299111,4cyclictest0-21swapper/310:11:203
127299110,5cyclictest6628-21systemd12:15:303
126799119,1cyclictest0-21swapper/210:55:072
126799116,1cyclictest1-21systemd11:37:022
126799113,0cyclictest0-21swapper/210:10:122
126799112,4cyclictest0-21swapper/210:48:152
126799110,10cyclictest0-21swapper/211:28:512
126799110,1cyclictest0-21swapper/209:30:182
126699119,1cyclictest698-21dbus-daemon09:29:421
126699118,2cyclictest19426-21sshd10:01:141
126699113,4cyclictest1591-21bash09:39:331
126699113,4cyclictest1591-21bash09:39:331
126699111,4cyclictest13775-21sshd10:44:101
126099119,2cyclictest9-21ksoftirqd/012:22:590
126099119,1cyclictest9-21ksoftirqd/011:54:400
126099119,1cyclictest9-21ksoftirqd/011:14:010
126099119,1cyclictest0-21swapper/012:27:450
126099119,1cyclictest0-21swapper/009:16:500
126099113,4cyclictest0-21swapper/011:50:260
1260991110,1cyclictest9-21ksoftirqd/009:40:510
1260991110,1cyclictest0-21swapper/010:07:070
126099110,11cyclictest0-21swapper/010:29:390
126099110,11cyclictest0-21swapper/010:29:390
126099110,10cyclictest27606-21sshd09:35:350
126099110,10cyclictest27606-21sshd09:35:350
130499107,2cyclictest698-21dbus-daemon10:59:447
130499103,1cyclictest698-21dbus-daemon11:55:377
130499102,7cyclictest879-21polkitd09:15:507
130499100,4cyclictest879-21polkitd09:22:507
130499100,4cyclictest879-21polkitd09:22:507
130499100,4cyclictest0-21swapper/711:46:417
130499100,4cyclictest0-21swapper/710:52:367
130499100,10cyclictest16641-21kworker/7:112:17:247
130499100,1cyclictest0-21swapper/711:06:087
130499100,1cyclictest0-21swapper/710:24:367
129699108,1cyclictest16272-21grepconf.sh09:50:586
129699107,1cyclictest65-21ksoftirqd/611:33:576
129699106,3cyclictest698-21dbus-daemon09:49:536
129699104,3cyclictest488-21systemd-journal09:40:226
129699104,3cyclictest488-21systemd-journal09:40:226
129699104,3cyclictest24358-21systemd09:35:166
129699103,4cyclictest14017-21bash11:48:096
129699103,4cyclictest0-21swapper/610:06:366
129699102,5cyclictest32176-21sshd09:22:376
129699102,5cyclictest32176-21sshd09:22:376
129699102,3cyclictest0-21swapper/610:37:196
129699100,9cyclictest4976-21kworker/6:009:12:156
129699100,10cyclictest21869-21kworker/6:411:26:396
128999108,1cyclictest622-21grepconf.sh09:42:445
128999108,1cyclictest0-21swapper/511:22:135
128999106,3cyclictest3926-21bash10:39:535
128999103,4cyclictest27510-21sshd10:02:085
128999102,2cyclictest13332-21sshd10:10:395
128999100,6cyclictest25407-21cp11:45:595
128999100,4cyclictest0-21swapper/510:57:125
128999100,10cyclictest0-21swapper/512:35:155
128999100,10cyclictest0-21swapper/511:42:145
127799103,1cyclictest18955-21sshd11:39:144
127799102,7cyclictest28833-21bash11:46:214
127799102,7cyclictest28717-21systemd09:12:154
127799102,7cyclictest1174-21sshd10:42:504
127799102,2cyclictest879-21polkitd09:34:144
127799102,2cyclictest717-21systemd-logind10:57:214
127799102,2cyclictest26716-21cp09:55:334
127799101,4cyclictest0-21swapper/409:52:044
127799100,4cyclictest717-21systemd-logind12:22:094
127799100,4cyclictest717-21systemd-logind12:03:164
127799100,4cyclictest315-21sshd12:11:404
127799100,4cyclictest0-21swapper/411:00:504
127799100,10cyclictest9934-21kworker/4:210:55:104
127799100,10cyclictest0-21swapper/411:33:154
127799100,1cyclictest0-21swapper/410:12:414
127299108,1cyclictest0-21swapper/311:30:173
127299103,7cyclictest0-21swapper/312:20:353
127299103,6cyclictest7006-21grepconf.sh09:56:413
127299103,4cyclictest11811-21grepconf.sh11:00:403
127299103,1cyclictest0-21swapper/310:21:183
127299102,5cyclictest879-21polkitd12:06:073
127299102,3cyclictest0-21swapper/309:12:163
127299100,4cyclictest4889-21sshd11:06:333
127299100,4cyclictest31133-21bash09:29:173
127299100,4cyclictest22708-21systemd-cgroups09:25:033
127299100,4cyclictest22708-21systemd-cgroups09:25:033
127299100,10cyclictest3546-21kworker/3:012:32:093
127299100,10cyclictest0-21swapper/312:27:383
126799109,1cyclictest0-21swapper/209:14:322
126799108,2cyclictest33-21ksoftirqd/209:46:232
126799105,4cyclictest698-21dbus-daemon11:24:502
126799102,4cyclictest717-21systemd-logind09:22:452
126799102,4cyclictest717-21systemd-logind09:22:452
126799102,4cyclictest27004-21taskset10:11:582
126799101,5cyclictest1-21systemd11:18:012
126799100,4cyclictest31250-21systemd11:52:562
126799100,10cyclictest28180-21kworker/2:209:55:552
126799100,10cyclictest0-21swapper/211:01:542
126799100,1cyclictest0-21swapper/210:04:592
126699106,1cyclictest17912-21kworker/1:112:29:191
126699103,4cyclictest9307-21bash11:38:171
126699103,4cyclictest4941-21bash12:18:251
126699103,4cyclictest1-21systemd09:57:571
126699102,7cyclictest698-21dbus-daemon11:08:031
126699102,5cyclictest21958-21bash09:35:011
126699100,4cyclictest698-21dbus-daemon10:09:321
126699100,10cyclictest0-21swapper/111:48:541
126699100,10cyclictest0-21swapper/111:22:481
126699100,10cyclictest0-21swapper/109:07:471
126099108,1cyclictest9-21ksoftirqd/011:36:190
126099107,3cyclictest9-21ksoftirqd/010:56:380
126099107,2cyclictest31085-21bash09:29:170
126099105,2cyclictest15045-21kill11:20:090
126099104,3cyclictest31709-21sshd09:49:240
126099104,3cyclictest0-21swapper/009:59:270
126099102,5cyclictest387-21jbd2/sda2-809:22:180
126099102,5cyclictest387-21jbd2/sda2-809:22:180
126099102,3cyclictest13986-21systemd-cgroups10:04:090
126099100,4cyclictest11594-21sshd12:12:490
126099100,4cyclictest0-21swapper/009:55:110
126099100,10cyclictest0-21swapper/011:57:380
13049997,1cyclictest0-21swapper/709:56:027
13049996,2cyclictest9638-21sshd11:44:377
13049993,6cyclictest0-21swapper/709:34:597
13049993,3cyclictest25957-21systemd-cgroups12:23:337
13049992,6cyclictest21433-21sshd10:31:277
13049992,1cyclictest698-21dbus-daemon09:47:187
13049990,8cyclictest22486-21kworker/7:311:04:447
13049990,4cyclictest27228-21sshd11:52:327
13049990,4cyclictest0-21swapper/711:24:167
13049990,0cyclictest0-21swapper/711:33:117
12969999,0cyclictest0-21swapper/609:41:406
12969998,1cyclictest65-21ksoftirqd/611:06:516
12969997,1cyclictest65-21ksoftirqd/612:07:376
12969995,3cyclictest0-21swapper/611:20:596
12969994,4cyclictest25927-21bash10:21:536
12969994,2cyclictest698-21dbus-daemon12:23:076
12969994,2cyclictest488-21systemd-journal12:18:126
12969993,3cyclictest0-21swapper/609:56:016
12969992,4cyclictest0-21swapper/611:11:096
12969991,5cyclictest0-21swapper/611:59:186
12969990,9cyclictest934-21kworker/6:310:49:366
12969990,9cyclictest0-21swapper/609:07:376
12969990,8cyclictest26227-21kworker/6:111:38:446
12969990,8cyclictest19848-21kworker/6:510:26:436
12969990,8cyclictest19848-21kworker/6:510:26:436
12969990,8cyclictest1862-21kworker/6:110:30:466
12969990,8cyclictest13587-21kworker/6:011:17:496
12969990,8cyclictest10959-21kworker/6:312:10:576
12969990,1cyclictest0-21swapper/612:00:586
12969990,0cyclictest0-21swapper/610:00:356
12899998,1cyclictest0-21swapper/510:31:375
12899997,1cyclictest11365-21grepconf.sh09:27:085
12899996,3cyclictest720-21in:imjournal12:07:355
12899996,2cyclictest698-21dbus-daemon09:50:515
12899995,4cyclictest0-21swapper/512:00:355
12899995,3cyclictest698-21dbus-daemon10:41:455
12899995,1cyclictest11741-21sshd11:32:135
12899994,1cyclictest717-21systemd-logind12:10:385
12899993,2cyclictest717-21systemd-logind10:26:185
12899993,2cyclictest717-21systemd-logind10:26:185
12899993,2cyclictest6809-21grepconf.sh11:28:415
12899992,5cyclictest3978-21cut08:05:395
12899991,4cyclictest0-21swapper/512:27:275
12899990,6cyclictest488-21systemd-journal09:20:135
12899990,0cyclictest0-21swapper/512:23:195
12779998,1cyclictest0-21swapper/407:21:004
12779996,2cyclictest698-21dbus-daemon12:34:344
12779993,1cyclictest7047-21sshd11:41:044
12779993,1cyclictest0-21swapper/411:52:184
12779992,6cyclictest26747-21cstates11:55:394
12779992,4cyclictest4305-21grepconf.sh09:26:204
12779992,1cyclictest31102-21sshd12:30:214
12779992,1cyclictest1126-21sshd10:46:034
12779991,3cyclictest0-21swapper/409:05:524
12779990,9cyclictest0-21swapper/409:18:464
12779990,8cyclictest22072-21kworker/4:110:35:304
12779990,4cyclictest1718-21sshd10:15:594
12729998,1cyclictest13646-21sshd10:44:093
12729996,2cyclictest698-21dbus-daemon10:29:113
12729996,2cyclictest698-21dbus-daemon10:29:113
12729994,1cyclictest0-21swapper/311:36:013
12729993,1cyclictest0-21swapper/309:30:493
12729993,1cyclictest0-21swapper/309:17:423
12729992,6cyclictest3264-21bash10:53:063
12729992,1cyclictest6419-21sshd11:34:563
12729990,5cyclictest1459-21systemd11:53:113
12729990,4cyclictest10519-21sshd10:30:283
12729990,4cyclictest0-21swapper/312:11:473
12729990,4cyclictest0-21swapper/311:56:033
12679999,0cyclictest0-21swapper/209:08:232
12679998,0cyclictest0-21swapper/209:42:362
12679997,1cyclictest33-21ksoftirqd/211:13:352
12679992,6cyclictest0-21swapper/209:52:202
12679992,4cyclictest754-21NetworkManager11:05:472
12679991,4cyclictest3481-21sshd10:56:232
12679990,5cyclictest720-21in:imjournal10:16:022
12679990,5cyclictest10415-21systemd-cgroups12:31:172
12679990,4cyclictest698-21dbus-daemon09:15:482
12679990,4cyclictest16300-21bash09:34:252
12679990,4cyclictest0-21swapper/211:55:362
12679990,0cyclictest0-21swapper/211:48:532
12679990,0cyclictest0-21swapper/210:31:382
12679990,0cyclictest0-21swapper/209:36:272
12679990,0cyclictest0-21swapper/209:36:272
12669999,0cyclictest0-21swapper/110:48:031
12669996,2cyclictest698-21dbus-daemon10:56:161
12669995,2cyclictest698-21dbus-daemon11:35:001
12669994,2cyclictest17026-21sshd11:01:061
12669993,4cyclictest698-21dbus-daemon10:11:051
12669993,3cyclictest717-21systemd-logind09:16:141
12669992,4cyclictest5469-21systemd09:13:161
12669992,3cyclictest4586-21systemd-cgroups10:53:151
12669992,3cyclictest3791-21sshd10:16:121
12669992,3cyclictest19038-21sshd11:42:181
12669991,4cyclictest1-21systemd12:31:171
12669990,9cyclictest0-21swapper/112:02:281
12669990,8cyclictest10207-21kworker/1:010:37:191
12609998,1cyclictest22211-21kworker/u16:312:07:430
12609994,2cyclictest0-21swapper/011:20:540
12609994,1cyclictest879-21polkitd11:04:060
12609993,2cyclictest10010-21grepconf.sh10:16:540
12609992,5cyclictest20886-21packagekitd12:30:490
12609992,5cyclictest13746-21kworker/u16:011:30:210
12609992,5cyclictest0-21swapper/010:13:040
12609992,3cyclictest0-21swapper/011:06:020
12609991,5cyclictest6508-21kworker/0:410:50:380
12609991,5cyclictest0-21swapper/012:03:110
12609990,9cyclictest0-21swapper/010:30:270
12609990,9cyclictest0-21swapper/009:10:410
10090290,0sleep20-21swapper/212:25:112
13049988,0cyclictest0-21swapper/712:10:427
13049987,1cyclictest0-21swapper/710:10:547
13049985,2cyclictest24651-21sshd10:41:527
13049985,2cyclictest12115-21cp11:13:357
13049985,2cyclictest1-21systemd12:31:457
13049983,5cyclictest721ktimersoftd/709:40:087
13049983,5cyclictest721ktimersoftd/709:40:087
13049983,2cyclictest0-21swapper/708:34:537
13049983,2cyclictest0-21swapper/707:57:497
13049982,6cyclictest0-21swapper/709:28:107
13049981,6cyclictest439-21sshd09:09:267
13049981,4cyclictest698-21dbus-daemon12:05:327
13049981,3cyclictest20930-21bash09:14:547
13049980,8cyclictest0-21swapper/712:26:427
13049980,8cyclictest0-21swapper/710:00:587
13049980,4cyclictest28567-21sshd10:25:367
13049980,4cyclictest28567-21sshd10:25:367
13049980,2cyclictest19445-21bash09:41:137
12969982,4cyclictest717-21systemd-logind10:11:116
12969980,7cyclictest9326-21kworker/6:410:44:416
12969980,3cyclictest32523-21sshd09:25:526
12899983,0cyclictest0-21swapper/511:07:525
12899980,0cyclictest0-21swapper/511:12:085
12899980,0cyclictest0-21swapper/509:36:215
12899980,0cyclictest0-21swapper/509:36:215
12779983,2cyclictest0-21swapper/408:46:364
12779982,5cyclictest29346-21sshd09:42:194
12729988,0cyclictest0-21swapper/307:45:513
12729988,0cyclictest0-21swapper/307:45:513
12729986,1cyclictest41-21ksoftirqd/310:56:533
12729983,5cyclictest0-21swapper/310:16:033
12729983,2cyclictest0-21swapper/307:12:093
12729980,7cyclictest20987-21kworker/3:210:05:563
12679986,1cyclictest1-21systemd11:42:242
12679983,2cyclictest0-21swapper/207:49:342
12679983,2cyclictest0-21swapper/207:49:342
12679983,1cyclictest717-21systemd-logind12:01:022
12679983,1cyclictest1752-21systemd-cgroups12:05:412
12679983,0cyclictest0-21swapper/208:26:352
12679982,5cyclictest698-21dbus-daemon11:31:592
12679982,3cyclictest698-21dbus-daemon12:20:002
12679982,3cyclictest5159-21systemd12:12:102
12679982,3cyclictest22141-21systemd-cgroups10:38:202
12669982,3cyclictest698-21dbus-daemon11:51:561
12669982,3cyclictest1-21systemd10:20:271
12669982,2cyclictest24700-21sshd12:10:511
12669981,3cyclictest1-21systemd10:31:301
12669980,8cyclictest30319-21kworker/1:111:16:041
12669980,7cyclictest29382-21systemd10:25:391
12669980,7cyclictest29382-21systemd10:25:391
12669980,4cyclictest7128-21bash12:06:031
12609985,2cyclictest15686-21kill11:41:570
12609982,3cyclictest698-21dbus-daemon10:23:500
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional