You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-27 - 14:17
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack2slot0.osadl.org (updated Sat Jul 27, 2024 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
149272880,0sleep00-21swapper/012:24:290
10352780,1sleep1241ktimersoftd/110:01:151
14302600,0sleep10-21swapper/111:28:381
6042520,0sleep00-21swapper/012:03:050
315202520,1sleep131519-21grep09:54:261
175362520,0sleep10-21swapper/109:59:421
137672520,0sleep10-21swapper/110:46:081
110322510,0sleep00-21swapper/010:02:180
283932500,0sleep30-21swapper/312:02:413
25342500,0sleep20-21swapper/211:08:132
151512500,0sleep30-21swapper/311:47:073
48072490,0sleep30-21swapper/309:21:283
27622490,0sleep20-21swapper/209:41:142
110502480,0sleep10-21swapper/112:35:311
13472450,0sleep00-21swapper/009:34:310
13472450,0sleep00-21swapper/009:34:310
197002340,0sleep30-21swapper/310:40:103
127223317,11sleep20-21swapper/207:05:022
29852287,7sleep10-21swapper/107:09:011
29182219,7sleep30-21swapper/307:08:113
190222210,0sleep1231rcuc/111:06:321
210152200,0sleep00-21swapper/012:25:000
12752197,7sleep00-21swapper/007:05:030
74922180,0sleep20-21swapper/211:40:372
181852180,1sleep2317999cyclictest11:24:232
181852180,1sleep2317999cyclictest11:24:232
87692170,0sleep20-21swapper/212:12:242
317899170,8cyclictest26162-21sshd11:10:241
317899170,16cyclictest20107-21sshd11:38:561
217712170,0sleep00-21swapper/012:13:350
33082160,0sleep10-21swapper/111:01:391
317899161,6cyclictest684-21polkitd11:53:021
317899160,15cyclictest6398-21lspci11:43:291
317899160,15cyclictest25534-21sshd11:22:061
317899160,15cyclictest25534-21sshd11:22:051
309242160,0sleep10-21swapper/110:21:091
275162160,1sleep1231rcuc/110:44:211
317899150,6cyclictest646-21dbus-daemon12:04:341
317899150,14cyclictest619-17sedispatch09:43:361
317899150,14cyclictest0-21swapper/109:38:561
19742150,0sleep20-21swapper/210:45:022
33642140,0sleep30-21swapper/310:51:443
318599140,1cyclictest616-17auditd10:45:223
317899143,6cyclictest646-21dbus-daemon12:06:551
317899141,6cyclictest648-21systemd-logind11:34:001
317899140,6cyclictest721-21gdbus10:29:431
317899140,6cyclictest1-21systemd12:23:281
317899140,5cyclictest28738-21sshd12:25:351
317899140,5cyclictest14741-21lspci09:29:091
317899140,13cyclictest5317-21sshd09:48:161
317899140,13cyclictest5317-21sshd09:48:161
317899140,13cyclictest0-21swapper/110:19:391
29512140,0sleep2311rcuc/209:34:412
29512140,0sleep2311rcuc/209:34:412
227152140,0sleep1231rcuc/109:10:051
185312140,0sleep20-21swapper/210:19:592
318599130,12cyclictest646-21dbus-daemon09:50:513
317999133,1cyclictest33-21ksoftirqd/210:00:362
317999130,12cyclictest646-21dbus-daemon09:20:292
317899139,3cyclictest0-21swapper/111:46:051
317899130,9cyclictest24308-21sshd12:10:531
317899130,6cyclictest684-21polkitd09:15:541
317899130,6cyclictest648-21systemd-logind11:57:051
317899130,6cyclictest646-21dbus-daemon09:33:281
317899130,6cyclictest646-21dbus-daemon09:33:281
317899130,6cyclictest25093-21rm09:23:351
317899130,6cyclictest24778-21grepconf.sh11:16:111
317899130,6cyclictest14959-21sshd10:56:161
317899130,6cyclictest14497-21grep12:30:111
317899130,5cyclictest964-21grep10:51:291
317899130,5cyclictest23190-21sshd10:37:091
317899130,5cyclictest18903-21sshd10:06:271
317899130,5cyclictest1615-21bash10:31:341
317899130,4cyclictest26059-21lspci12:16:481
317899130,12cyclictest0-21swapper/107:30:241
3177991311,1cyclictest646-21dbus-daemon09:37:200
317799130,1cyclictest646-21dbus-daemon10:07:310
153892130,0sleep00-21swapper/011:52:530
3185991210,1cyclictest25556-21sshd10:27:223
318599120,1cyclictest646-21dbus-daemon09:46:413
318599120,1cyclictest646-21dbus-daemon09:46:413
318599120,1cyclictest10231-21sshd09:42:013
317999128,1cyclictest33-21ksoftirqd/210:59:502
317999120,1cyclictest6454-21sshd11:26:092
317999120,1cyclictest12224-21lspci12:18:292
317999120,11cyclictest0-21swapper/211:48:382
317899120,6cyclictest25918-21sshd10:10:331
317899120,11cyclictest0-21swapper/107:10:351
3177991210,1cyclictest1747-21bash11:20:010
3177991210,1cyclictest1747-21bash11:20:000
317799120,11cyclictest19898-21latency_hist07:50:000
317799120,11cyclictest1-21systemd10:45:510
317799120,11cyclictest11193-21bash10:19:110
317799120,11cyclictest0-21swapper/011:28:110
317799120,11cyclictest0-21swapper/008:25:210
3185991110,0cyclictest0-21swapper/310:07:313
318599110,10cyclictest0-21swapper/312:37:013
318599110,10cyclictest0-21swapper/311:36:223
318599110,0cyclictest0-21swapper/312:13:523
317999119,1cyclictest15887-21lspci10:26:192
317999112,1cyclictest33-21ksoftirqd/211:33:032
317999111,1cyclictest33-21ksoftirqd/212:07:382
317999111,1cyclictest33-21ksoftirqd/211:38:032
317999111,1cyclictest33-21ksoftirqd/209:25:172
317999111,1cyclictest131rcu_sched10:35:232
317999110,1cyclictest18654-21bash11:58:572
317999110,10cyclictest0-21swapper/210:32:592
317899112,6cyclictest7216-21unixbench-2d07:15:241
317899110,8cyclictest29226-21proc_pri08:10:201
317799110,10cyclictest0-21swapper/009:42:310
317799110,0cyclictest0-21swapper/011:12:510
136892110,1sleep01-21systemd09:19:080
318599109,0cyclictest0-21swapper/311:28:123
318599109,0cyclictest0-21swapper/310:19:123
318599108,1cyclictest20092-21sshd11:12:513
318599100,0cyclictest0-21swapper/312:31:223
318599100,0cyclictest0-21swapper/309:11:503
318599100,0cyclictest0-21swapper/307:55:013
317999109,0cyclictest0-21swapper/212:35:592
317999109,0cyclictest0-21swapper/212:30:192
317999109,0cyclictest0-21swapper/212:01:292
317999109,0cyclictest0-21swapper/209:46:092
317999109,0cyclictest0-21swapper/209:46:082
317999103,1cyclictest33-21ksoftirqd/212:25:002
317999103,1cyclictest33-21ksoftirqd/211:15:412
317999102,1cyclictest33-21ksoftirqd/211:12:072
317999101,3cyclictest649-21avahi-daemon12:25:322
317999101,3cyclictest33-21ksoftirqd/210:12:562
317999101,2cyclictest33-21ksoftirqd/211:01:012
317999101,1cyclictest692-21NetworkManager10:09:552
317999101,1cyclictest33-21ksoftirqd/209:51:222
317999100,1cyclictest33-21ksoftirqd/210:40:042
317899100,9cyclictest0-21swapper/108:32:351
317899100,7cyclictest2493-21cat08:25:161
317899100,7cyclictest23049-21awk07:55:151
317899100,7cyclictest20572-21grepconf.sh09:09:281
317899100,6cyclictest0-21swapper/108:00:241
317899100,5cyclictest20768-21wc07:50:161
317899100,5cyclictest12779-21expr08:50:141
317799109,0cyclictest0-21swapper/010:56:310
317799109,0cyclictest0-21swapper/010:34:310
317799109,0cyclictest0-21swapper/009:51:210
317799108,1cyclictest31144-21sshd12:08:410
317799100,0cyclictest0-21swapper/011:43:310
317799100,0cyclictest0-21swapper/011:05:110
31859998,0cyclictest0-21swapper/311:56:223
31859998,0cyclictest0-21swapper/311:50:123
31859998,0cyclictest0-21swapper/309:31:113
31859998,0cyclictest0-21swapper/309:31:103
31859998,0cyclictest0-21swapper/308:02:213
31799998,0cyclictest33-21ksoftirqd/211:50:152
31799992,1cyclictest33-21ksoftirqd/210:21:092
31799992,1cyclictest33-21ksoftirqd/209:55:332
31799992,1cyclictest33-21ksoftirqd/209:15:132
31799992,1cyclictest33-21ksoftirqd/209:10:152
31799991,1cyclictest33-21ksoftirqd/210:52:542
31799991,1cyclictest131rcu_sched09:36:172
31789990,6cyclictest17160-21swap07:40:191
31789990,5cyclictest9313-21unixbench_singl07:20:191
31789990,5cyclictest8245-21expr08:40:141
31789990,5cyclictest428-21wc08:20:131
31789990,5cyclictest18539-21idleruntime07:45:151
31789990,5cyclictest17156-21proc_pri09:00:201
31789990,5cyclictest15230-21timerandwakeup07:35:201
31789990,5cyclictest14615-21if_eno108:55:141
31789990,5cyclictest10875-21open_files07:25:171
31789990,5cyclictest10168-21grep08:45:121
31789990,4cyclictest7108-21mailstats08:35:201
31779998,0cyclictest0-21swapper/010:40:410
31779998,0cyclictest0-21swapper/010:27:510
31779998,0cyclictest0-21swapper/009:47:110
31779998,0cyclictest0-21swapper/009:47:110
31779998,0cyclictest0-21swapper/009:23:310
31779997,1cyclictest9-21ksoftirqd/012:30:200
31779996,2cyclictest20032-21kworker/0:209:10:580
31779996,2cyclictest17265-21kworker/0:110:22:090
31779996,2cyclictest10666-21kworker/0:012:16:340
31859987,0cyclictest0-21swapper/312:25:423
31859987,0cyclictest0-21swapper/312:20:023
31859987,0cyclictest0-21swapper/310:56:313
31859986,1cyclictest27703-21sshd12:19:533
31859986,1cyclictest11735-21lspci11:32:233
31859985,2cyclictest700-21gdbus11:09:593
31859985,2cyclictest649-21avahi-daemon10:38:103
31859985,2cyclictest649-21avahi-daemon10:10:143
31859984,2cyclictest684-21polkitd10:31:173
31789982,5cyclictest26721-21cat08:05:141
31789980,5cyclictest30474-21expr08:15:141
31779986,2cyclictest24085-21kworker/0:411:37:000
31779985,2cyclictest649-21avahi-daemon11:04:570
31779985,2cyclictest649-21avahi-daemon10:10:050
31779985,2cyclictest646-21dbus-daemon11:30:590
31779980,4cyclictest30053-21sshd12:00:000
22187280,0sleep00-21swapper/010:53:410
31859976,0cyclictest0-21swapper/312:08:423
31859976,0cyclictest0-21swapper/309:37:213
31859975,1cyclictest24254-21lspci09:26:453
31859974,2cyclictest649-21avahi-daemon11:43:143
31859974,2cyclictest649-21avahi-daemon10:00:263
31859974,2cyclictest646-21dbus-daemon11:02:563
31859974,2cyclictest646-21dbus-daemon09:05:003
31859974,2cyclictest21069-21sshd09:56:393
31859974,2cyclictest13135-21kworker/u8:011:15:323
31859974,1cyclictest646-21dbus-daemon11:24:573
31859974,1cyclictest646-21dbus-daemon11:24:573
31859974,1cyclictest646-21dbus-daemon09:15:383
31859972,2cyclictest646-21dbus-daemon10:20:243
31859971,5cyclictest1-21systemd08:55:003
31799976,0cyclictest0-21swapper/209:09:182
31799976,0cyclictest0-21swapper/209:00:272
31779975,1cyclictest2203-21bash10:35:010
31779975,1cyclictest20995-21sshd12:36:260
31779975,1cyclictest18830-21lspci11:15:370
31779974,2cyclictest700-21gdbus09:55:530
31779974,2cyclictest12504-21sshd09:25:310
31859963,2cyclictest17299-21snmpd09:05:523
31859963,2cyclictest17299-21snmpd08:42:003
31859963,2cyclictest17299-21snmpd07:39:253
31799964,1cyclictest700-21gdbus08:45:002
31799964,1cyclictest33-21ksoftirqd/207:15:002
31799962,1cyclictest0-21swapper/208:12:332
31799961,2cyclictest33-21ksoftirqd/208:50:002
31799960,5cyclictest15635-21kworker/2:207:45:322
31799960,5cyclictest0-21swapper/207:57:572
31779966,0cyclictest15950-21kworker/0:009:09:400
31779965,0cyclictest0-21swapper/008:05:210
31779964,1cyclictest23397-21sshd11:45:010
31779964,1cyclictest15950-21kworker/0:009:04:340
31779963,2cyclictest17299-21snmpd08:17:470
31859954,0cyclictest0-21swapper/308:31:513
31859954,0cyclictest0-21swapper/307:16:103
31859953,1cyclictest684-21polkitd08:44:593
31859953,1cyclictest6555-21cat08:35:153
31859953,1cyclictest357-21cat08:20:113
31859953,1cyclictest2274-21sh08:25:143
31859953,1cyclictest18565-21cat07:45:163
31859953,1cyclictest17299-21snmpd08:57:193
31859953,1cyclictest17299-21snmpd08:10:173
31859953,1cyclictest17299-21snmpd08:05:053
31859953,1cyclictest17299-21snmpd07:50:053
31859953,1cyclictest17299-21snmpd07:42:013
31859953,1cyclictest17299-21snmpd07:34:043
31859953,1cyclictest17299-21snmpd07:10:103
31859953,1cyclictest1058-21sendmail08:15:313
31859953,1cyclictest10487-21cat07:25:143
31859951,1cyclictest1017-21runrttasks07:20:403
31799954,0cyclictest0-21swapper/207:27:182
31799953,1cyclictest7973-21/usr/sbin/munin07:20:102
31799953,1cyclictest2004-21cpu08:25:132
31799953,1cyclictest17299-21snmpd08:57:462
31799953,1cyclictest17299-21snmpd08:34:542
31799953,1cyclictest17299-21snmpd08:23:472
31799953,1cyclictest17299-21snmpd08:15:502
31799953,1cyclictest17299-21snmpd08:07:082
31799953,1cyclictest17299-21snmpd07:51:082
31799953,1cyclictest17299-21snmpd07:19:422
31799953,1cyclictest16082-21/usr/sbin/munin07:40:172
31799953,1cyclictest12121-21tr07:30:092
31799953,1cyclictest1053-21lldpd08:36:522
31799952,2cyclictest17299-21snmpd07:35:462
31799951,1cyclictest0-21swapper/208:51:222
31779954,0cyclictest0-21swapper/007:50:510
31779953,1cyclictest9881-21crond08:45:000
31779953,1cyclictest8424-21cat07:20:110
31779953,1cyclictest6557-21cat08:35:140
31779953,1cyclictest649-21avahi-daemon08:50:150
31779953,1cyclictest17299-21snmpd08:49:100
31779953,1cyclictest17299-21snmpd08:22:000
31779953,1cyclictest17299-21snmpd08:12:250
31779953,1cyclictest17299-21snmpd08:00:380
31779953,1cyclictest17299-21snmpd07:57:320
31779953,1cyclictest17299-21snmpd07:36:100
31779953,1cyclictest17299-21snmpd07:25:160
31779953,1cyclictest17299-21snmpd07:11:520
31779953,1cyclictest17143-21smart_sda07:40:190
31779953,1cyclictest12388-21grep07:30:120
31779953,1cyclictest1017-21runrttasks07:16:320
31779952,2cyclictest4153-21tr08:30:110
31779952,2cyclictest14441-21df_inode08:55:130
31799942,1cyclictest33-21ksoftirqd/208:00:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional