You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-11-22 - 08:19
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack2slot0.osadl.org (updated Fri Nov 22, 2024 00:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
60982960,0sleep06003-21sshd23:29:260
157402610,0sleep20-21swapper/223:08:102
318362570,1sleep231797-21sshd22:25:242
311992550,0sleep30-21swapper/323:19:123
174682550,0sleep30-21swapper/321:29:223
115472550,2sleep02409399cyclictest21:50:140
68472530,0sleep10-21swapper/123:04:031
270982530,0sleep30-21swapper/323:34:383
198992530,0sleep2311rcuc/223:11:412
153732530,0sleep30-21swapper/321:13:523
62342520,0sleep00-21swapper/023:16:400
323262520,0sleep00-21swapper/000:23:220
267972520,1sleep026777-21sshd00:15:560
257072510,0sleep20-21swapper/222:24:552
204062510,0sleep30-21swapper/322:55:453
141862510,0sleep00-21swapper/022:42:210
126222500,0sleep20-21swapper/221:31:562
56752490,0sleep10-21swapper/100:31:111
283932490,0sleep028394-21systemd-cgroups00:37:160
261632490,0sleep10-21swapper/100:03:041
260852490,0sleep20-21swapper/223:37:372
16222490,0sleep21620-21grepconf.sh23:57:282
257972470,0sleep025799-21bash22:34:160
173292470,0sleep10-21swapper/123:14:421
100992470,0sleep10-21swapper/122:05:171
268002460,0sleep10-21swapper/122:37:201
225542410,0sleep30-21swapper/321:35:593
325852390,0sleep00-21swapper/021:21:290
2391423523,7sleep00-21swapper/019:08:560
238062319,7sleep10-21swapper/119:07:331
2286722715,7sleep20-21swapper/219:05:152
2220422210,7sleep30-21swapper/319:05:043
62412180,1sleep36238-21lspci22:04:593
2409999180,16cyclictest616-17auditd23:22:321
84812170,0sleep20-21swapper/222:57:532
276222160,0sleep30-21swapper/300:30:063
186402160,1sleep118641-21bash00:08:451
179062160,0sleep30-21swapper/323:27:253
100882160,0sleep00-21swapper/019:50:210
100882160,0sleep00-21swapper/019:50:200
85572150,0sleep00-21swapper/022:14:160
70672150,0sleep30-21swapper/300:38:313
326282150,0sleep20-21swapper/222:10:222
315012150,0sleep20-21swapper/200:34:132
274222150,0sleep30-21swapper/322:28:063
232402150,0sleep00-21swapper/000:29:350
150402150,0sleep10-21swapper/123:17:341
83452140,0sleep20-21swapper/221:43:502
269942140,0sleep00-21swapper/022:03:520
24099991413,0cyclictest33050irq/27-ahci[00021:40:391
24099991413,0cyclictest27408-21lspci22:31:101
24099991413,0cyclictest11303-21lspci23:36:091
24111991311,1cyclictest14738-21sshd22:39:183
24104991311,1cyclictest646-21dbus-daemon00:23:562
2410499130,11cyclictest23527-21grep22:15:352
24099991312,0cyclictest31975-21lspci22:28:321
24099991312,0cyclictest20189-21lspci23:46:361
24099991311,1cyclictest17372-21systemd-cgroups21:29:211
2409399130,1cyclictest0-21swapper/021:17:480
204602130,0sleep020461-21systemd-cgroups23:33:590
288352120,0sleep10-21swapper/123:41:011
249762120,0sleep10-21swapper/123:09:051
24111991210,1cyclictest9522-21sshd21:46:583
24111991210,1cyclictest0-21swapper/322:49:473
2410499120,11cyclictest6404-21sshd00:38:262
2410499120,11cyclictest28039-21sshd00:06:262
2410499120,11cyclictest1044-21sshd21:21:352
2410499120,11cyclictest0-21swapper/222:48:042
2409999121,3cyclictest25-21ksoftirqd/121:37:291
24099991211,0cyclictest0-21swapper/121:46:011
2409999120,11cyclictest3524-21lspci23:54:311
2409999120,11cyclictest0-21swapper/122:58:321
2409399120,1cyclictest30555-21sshd23:47:380
2409399120,1cyclictest24289-21sshd00:09:170
2409399120,11cyclictest13145-21lspci22:08:380
2409399120,11cyclictest0-21swapper/021:28:580
192032120,0sleep20-21swapper/223:40:102
174592120,0sleep317456-21bash23:43:073
2411199119,1cyclictest15493-21sshd22:23:573
2411199110,10cyclictest0-21swapper/323:52:283
2411199110,10cyclictest0-21swapper/321:57:473
2411199110,10cyclictest0-21swapper/321:24:583
2411199110,0cyclictest0-21swapper/323:03:383
24104991110,0cyclictest0-21swapper/223:49:352
2410499110,0cyclictest0-21swapper/221:59:442
2409999119,1cyclictest0-21swapper/100:18:011
2409999114,1cyclictest25-21ksoftirqd/100:25:241
2409999111,3cyclictest670-21packagekitd22:49:481
2409999111,2cyclictest131rcu_sched21:51:551
24099991110,0cyclictest0-21swapper/123:57:321
24099991110,0cyclictest0-21swapper/122:40:111
24099991110,0cyclictest0-21swapper/122:01:411
24099991110,0cyclictest0-21swapper/121:15:511
24093991110,0cyclictest0-21swapper/021:10:480
2409399110,10cyclictest0-21swapper/023:04:470
2409399110,10cyclictest0-21swapper/022:23:180
2409399110,10cyclictest0-21swapper/000:04:280
2409399110,0cyclictest0-21swapper/023:50:380
2409399110,0cyclictest0-21swapper/021:58:170
2411199109,0cyclictest0-21swapper/323:55:283
2411199109,0cyclictest0-21swapper/323:46:283
2411199109,0cyclictest0-21swapper/300:23:483
2410499109,0cyclictest26875-21sshd23:18:452
2410499109,0cyclictest0-21swapper/222:52:252
2410499109,0cyclictest0-21swapper/222:06:242
2410499109,0cyclictest0-21swapper/220:30:152
2410499100,9cyclictest0-21swapper/219:48:352
2410499100,9cyclictest0-21swapper/219:13:352
2410499100,0cyclictest0-21swapper/221:35:452
2409999109,0cyclictest33050irq/27-ahci[00021:21:161
2409999109,0cyclictest0-21swapper/123:30:221
2409999109,0cyclictest0-21swapper/122:23:001
2409999109,0cyclictest0-21swapper/121:14:411
2409999109,0cyclictest0-21swapper/100:35:321
2409999104,3cyclictest11139-21sshd22:17:311
2409999103,1cyclictest25-21ksoftirqd/123:26:431
2409999103,1cyclictest25-21ksoftirqd/100:20:451
2409999101,3cyclictest131rcu_sched00:10:241
2409999101,1cyclictest25-21ksoftirqd/121:30:341
2409999100,0cyclictest0-21swapper/121:56:501
2409399109,0cyclictest0-21swapper/022:49:080
2409399109,0cyclictest0-21swapper/021:48:370
2409399108,1cyclictest28236-21lspci23:40:570
2409399108,1cyclictest1-21systemd00:12:180
2409399108,1cyclictest0-21swapper/023:56:380
2409399107,2cyclictest28108-21lspci21:42:380
2409399100,0cyclictest0-21swapper/022:26:580
399290,1sleep3395-21sshd22:44:163
30357290,1sleep0101ktimersoftd/022:56:460
241119998,0cyclictest0-21swapper/321:32:383
241119998,0cyclictest0-21swapper/300:28:373
241119997,1cyclictest22312-21sshd00:18:573
241119994,3cyclictest646-21dbus-daemon23:22:403
241049998,0cyclictest9272-21sshd00:14:162
241049998,0cyclictest11360-21lspci23:52:032
241049998,0cyclictest0-21swapper/223:03:442
241049998,0cyclictest0-21swapper/222:43:452
241049998,0cyclictest0-21swapper/222:37:352
241049998,0cyclictest0-21swapper/221:50:052
241049998,0cyclictest0-21swapper/220:52:342
241049997,1cyclictest23458-21sshd00:19:052
240999998,0cyclictest0-21swapper/120:07:111
240999990,2cyclictest121rcu_preempt22:11:571
240999990,1cyclictest681-21gdbus22:50:011
240939998,0cyclictest0-21swapper/021:09:370
240939997,1cyclictest0-21swapper/022:15:580
240939996,2cyclictest12430-21kworker/0:100:33:280
241119987,0cyclictest0-21swapper/323:39:473
241119987,0cyclictest0-21swapper/322:31:173
241119986,1cyclictest41-21ksoftirqd/323:10:083
241119986,1cyclictest29266-21lspci21:42:443
241119985,2cyclictest700-21gdbus00:00:423
241119985,2cyclictest649-21avahi-daemon00:11:113
241119985,2cyclictest646-21dbus-daemon21:16:223
241119985,2cyclictest32696-21sshd22:07:243
241119985,2cyclictest16098-21sshd22:18:003
241119985,1cyclictest649-21avahi-daemon00:08:543
241049987,0cyclictest0-21swapper/221:47:052
241049987,0cyclictest0-21swapper/219:33:352
241049986,1cyclictest27349-21bash23:31:252
241049986,1cyclictest2693-21lspci22:31:572
241049986,1cyclictest2201-21sshd22:04:352
241049986,1cyclictest17309-21sshd00:28:492
241049984,3cyclictest646-21dbus-daemon23:25:592
241049980,0cyclictest0-21swapper/221:08:452
240999987,0cyclictest0-21swapper/119:45:011
240939987,0cyclictest0-21swapper/023:22:480
240939987,0cyclictest0-21swapper/021:30:070
240939986,2cyclictest21150-21kworker/0:423:36:050
240939986,1cyclictest27127-21lspci23:06:000
240939985,2cyclictest649-21avahi-daemon23:13:430
240939985,2cyclictest649-21avahi-daemon22:52:220
240939985,2cyclictest649-21avahi-daemon21:37:310
240939985,2cyclictest10588-21sshd22:35:460
241119976,0cyclictest0-21swapper/320:05:173
241119975,1cyclictest700-21gdbus21:52:363
241119975,1cyclictest649-21avahi-daemon22:50:293
241119975,1cyclictest4500-21sshd23:06:593
241119975,1cyclictest41-21ksoftirqd/322:10:403
241049976,0cyclictest0-21swapper/200:01:352
241049975,1cyclictest6918-21lspci21:13:042
241049974,2cyclictest649-21avahi-daemon21:15:112
241049974,2cyclictest646-21dbus-daemon23:20:042
241049973,3cyclictest4922-21sshd21:25:032
240999975,1cyclictest25-21ksoftirqd/119:35:001
240939972,4cyclictest646-21dbus-daemon20:40:000
241119964,1cyclictest646-21dbus-daemon21:09:593
241119963,2cyclictest17299-21snmpd21:00:253
241119963,2cyclictest17299-21snmpd19:57:063
241119963,2cyclictest17299-21snmpd19:41:133
241119963,2cyclictest17299-21snmpd19:34:083
241119960,5cyclictest0-21swapper/320:29:563
241119960,0cyclictest0-21swapper/320:39:363
241049965,0cyclictest0-21swapper/220:43:052
241049960,5cyclictest0-21swapper/219:51:252
241049960,5cyclictest0-21swapper/219:51:252
241049960,5cyclictest0-21swapper/219:29:152
241049960,5cyclictest0-21swapper/219:24:552
240999964,1cyclictest26595-21pmu-power19:15:001
240999963,2cyclictest17299-21snmpd21:06:311
240999960,5cyclictest0-21swapper/121:02:511
240999960,5cyclictest0-21swapper/119:52:511
240999960,5cyclictest0-21swapper/119:52:501
240939964,1cyclictest31335-21tr20:45:110
240939964,1cyclictest17299-21snmpd19:36:380
240939960,5cyclictest0-21swapper/020:20:080
240939960,5cyclictest0-21swapper/019:40:270
29649250,1sleep0101ktimersoftd/020:40:130
241119954,0cyclictest0-21swapper/319:10:473
241119953,1cyclictest29614-21cat20:40:133
241119953,1cyclictest17299-21snmpd20:57:143
241119953,1cyclictest17299-21snmpd20:53:283
241119953,1cyclictest17299-21snmpd20:45:253
241119953,1cyclictest17299-21snmpd20:32:073
241119953,1cyclictest17299-21snmpd20:15:133
241119953,1cyclictest17299-21snmpd20:10:143
241119953,1cyclictest17299-21snmpd20:01:353
241119953,1cyclictest17299-21snmpd19:20:323
241119953,1cyclictest17299-21snmpd19:16:013
241119953,1cyclictest1049-21rpcbind19:50:313
241119953,1cyclictest1049-21rpcbind19:50:303
241119952,2cyclictest3019-21tail19:35:123
241119952,2cyclictest21528-21interrupts20:20:143
241049954,0cyclictest0-21swapper/220:49:352
241049954,0cyclictest0-21swapper/220:37:552
241049954,0cyclictest0-21swapper/220:01:242
241049953,1cyclictest5210-21cat19:40:162
241049953,1cyclictest21501-21cat20:20:142
241049953,1cyclictest17299-21snmpd20:58:382
241049953,1cyclictest17299-21snmpd20:26:212
241049953,1cyclictest17299-21snmpd20:15:252
241049953,1cyclictest17299-21snmpd20:14:162
241049953,1cyclictest17299-21snmpd19:35:112
241049953,1cyclictest17299-21snmpd19:15:102
241049953,1cyclictest1053-21lldpd20:05:202
241049952,2cyclictest11064-21cat19:55:112
241049950,0cyclictest0-21swapper/221:02:452
240999954,0cyclictest25-21ksoftirqd/120:19:591
240999953,1cyclictest29412-21cat19:20:141
240999953,1cyclictest24292-21/usr/sbin/munin19:10:181
240999953,1cyclictest18351-21awk20:10:231
240999953,1cyclictest17299-21snmpd20:51:521
240999953,1cyclictest17299-21snmpd20:48:521
240999953,1cyclictest17299-21snmpd20:41:001
240999953,1cyclictest17299-21snmpd20:36:401
240999953,1cyclictest17299-21snmpd20:32:491
240999953,1cyclictest17299-21snmpd20:27:001
240999953,1cyclictest17299-21snmpd20:23:281
240999953,1cyclictest17299-21snmpd20:02:531
240999953,1cyclictest17299-21snmpd19:55:061
240999953,1cyclictest17299-21snmpd19:40:041
240999953,1cyclictest17299-21snmpd19:38:051
240999953,1cyclictest0-21swapper/120:55:321
240999952,1cyclictest121rcu_preempt19:25:231
240939953,1cyclictest7207-21cat19:45:150
240939953,1cyclictest692-21NetworkManager19:10:010
240939953,1cyclictest649-21avahi-daemon20:10:130
240939953,1cyclictest443-21systemd-journal20:35:000
240939953,1cyclictest23531-21cat20:25:130
240939953,1cyclictest17299-21snmpd20:58:500
240939953,1cyclictest17299-21snmpd20:05:500
240939953,1cyclictest17299-21snmpd19:59:090
240939953,1cyclictest17299-21snmpd19:22:470
240939953,1cyclictest13347-21cat20:00:160
240939953,1cyclictest0-21swapper/020:50:130
240939952,2cyclictest5222-21df_inode21:00:120
240939952,2cyclictest17299-21snmpd19:27:080
241119942,1cyclictest31326-21gltestperf19:25:123
241119942,1cyclictest17299-21snmpd19:45:123
240939942,1cyclictest547-21cpu19:30:090
240939942,1cyclictest26659-21users19:15:010
240939941,2cyclictest646-21dbus-daemon20:15:000
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional