You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-11-22 - 08:10
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack1slot1.osadl.org (updated Fri Nov 22, 2024 00:45:19)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
80432234160,26sleep30-21swapper/319:08:003
78892231156,24sleep00-21swapper/019:06:000
80412214160,42sleep10-21swapper/119:07:581
78962200161,26sleep20-21swapper/219:06:052
146242870,2sleep121-21ksoftirqd/119:20:151
48692590,0sleep30-21swapper/321:52:323
8274991717,0cyclictest9-21ksoftirqd/023:14:210
136792160,0sleep10-21swapper/121:24:551
8274991515,0cyclictest9-21ksoftirqd/023:42:460
245842150,1sleep2271rcuc/223:36:272
828799140,0cyclictest0-21swapper/123:35:121
827499149,5cyclictest9-21ksoftirqd/022:34:520
827499149,3cyclictest9-21ksoftirqd/000:37:180
8274991414,0cyclictest9-21ksoftirqd/023:58:200
8274991414,0cyclictest9-21ksoftirqd/023:39:350
8274991414,0cyclictest9-21ksoftirqd/023:30:390
8274991414,0cyclictest9-21ksoftirqd/023:30:380
8274991414,0cyclictest9-21ksoftirqd/022:55:480
8274991414,0cyclictest9-21ksoftirqd/000:25:050
8274991413,1cyclictest9-21ksoftirqd/023:29:140
8274991413,1cyclictest9-21ksoftirqd/000:00:210
8274991313,0cyclictest9-21ksoftirqd/023:54:520
8274991313,0cyclictest9-21ksoftirqd/020:25:190
8274991313,0cyclictest9-21ksoftirqd/000:32:570
8274991313,0cyclictest9-21ksoftirqd/000:13:230
8274991313,0cyclictest9-21ksoftirqd/000:09:220
8274991312,1cyclictest9-21ksoftirqd/021:50:130
8274991312,1cyclictest9-21ksoftirqd/021:30:160
8274991312,1cyclictest9-21ksoftirqd/020:41:260
8274991212,0cyclictest9-21ksoftirqd/023:48:150
8274991212,0cyclictest9-21ksoftirqd/023:02:020
8274991212,0cyclictest9-21ksoftirqd/022:23:000
8274991212,0cyclictest9-21ksoftirqd/021:28:460
8274991212,0cyclictest9-21ksoftirqd/021:12:480
8274991212,0cyclictest9-21ksoftirqd/000:23:340
8274991211,1cyclictest9-21ksoftirqd/023:15:120
8274991211,1cyclictest9-21ksoftirqd/022:25:100
8274991211,1cyclictest9-21ksoftirqd/022:10:150
8274991211,1cyclictest9-21ksoftirqd/021:15:120
8274991211,1cyclictest9-21ksoftirqd/020:50:130
8274991211,1cyclictest9-21ksoftirqd/020:45:090
8274991211,1cyclictest9-21ksoftirqd/019:45:130
8303991111,0cyclictest0-21swapper/321:57:183
8303991111,0cyclictest0-21swapper/319:37:373
8303991110,1cyclictest35-21ksoftirqd/321:15:003
8303991110,1cyclictest10638-21kworker/3:121:30:233
829599119,1cyclictest28-21ksoftirqd/221:00:012
827499119,1cyclictest9-21ksoftirqd/020:20:190
827499119,1cyclictest9-21ksoftirqd/020:10:220
827499115,6cyclictest9-21ksoftirqd/022:45:100
827499115,6cyclictest9-21ksoftirqd/019:50:110
827499114,7cyclictest9-21ksoftirqd/022:50:230
827499113,8cyclictest9-21ksoftirqd/020:31:330
827499112,8cyclictest9-21ksoftirqd/023:05:170
8274991111,0cyclictest9-21ksoftirqd/021:41:380
8274991110,1cyclictest9-21ksoftirqd/022:00:140
8274991110,1cyclictest9-21ksoftirqd/021:20:110
8274991110,1cyclictest9-21ksoftirqd/021:00:120
8274991110,1cyclictest9-21ksoftirqd/019:40:130
8274991110,1cyclictest9-21ksoftirqd/019:20:150
8274991110,1cyclictest9-21ksoftirqd/000:16:290
8274991110,0cyclictest9-21ksoftirqd/023:24:000
830399109,1cyclictest35-21ksoftirqd/323:05:143
830399109,1cyclictest35-21ksoftirqd/321:50:003
830399109,1cyclictest35-21ksoftirqd/300:29:593
830399109,1cyclictest35-21ksoftirqd/300:20:003
830399108,1cyclictest35-21ksoftirqd/321:29:593
830399108,1cyclictest35-21ksoftirqd/320:24:593
8303991010,0cyclictest341rcuc/300:25:013
830399100,4cyclictest26645-21/usr/sbin/munin21:40:163
829599100,9cyclictest0-21swapper/200:04:202
827499109,1cyclictest9-21ksoftirqd/022:40:130
827499109,1cyclictest9-21ksoftirqd/022:40:130
827499109,1cyclictest9-21ksoftirqd/022:05:150
827499109,1cyclictest9-21ksoftirqd/021:57:250
827499109,1cyclictest9-21ksoftirqd/020:55:000
827499109,1cyclictest9-21ksoftirqd/020:35:140
827499109,1cyclictest9-21ksoftirqd/020:05:190
827499109,1cyclictest9-21ksoftirqd/020:05:180
827499109,1cyclictest9-21ksoftirqd/020:01:400
827499109,1cyclictest9-21ksoftirqd/019:55:160
827499109,1cyclictest9-21ksoftirqd/019:30:110
827499109,1cyclictest9-21ksoftirqd/019:25:180
827499108,1cyclictest11530-21/usr/sbin/munin19:15:130
827499102,7cyclictest9-21ksoftirqd/022:15:020
8274991010,0cyclictest9-21ksoftirqd/022:36:000
8274991010,0cyclictest9-21ksoftirqd/021:45:200
8274991010,0cyclictest9-21ksoftirqd/021:37:270
83039998,1cyclictest35-21ksoftirqd/323:30:013
83039998,1cyclictest35-21ksoftirqd/321:40:013
83039998,1cyclictest35-21ksoftirqd/321:25:003
83039998,1cyclictest35-21ksoftirqd/300:39:593
83039994,4cyclictest10650-21munin-node19:17:143
82959990,6cyclictest60950irq/123-eno100:10:172
82749998,1cyclictest9-21ksoftirqd/019:35:190
82749998,1cyclictest9-21ksoftirqd/019:10:150
83039987,1cyclictest35-21ksoftirqd/322:45:013
83039987,1cyclictest35-21ksoftirqd/322:45:003
83039987,1cyclictest35-21ksoftirqd/322:30:043
83039986,2cyclictest0-21swapper/322:17:233
83039986,1cyclictest793-21snmpd22:37:223
83039986,1cyclictest793-21snmpd20:51:573
83039986,1cyclictest35-21ksoftirqd/319:15:003
83039982,3cyclictest18173-21/usr/sbin/munin22:10:133
83039981,4cyclictest30401-21apt-get19:55:103
83039980,2cyclictest0-21swapper/300:05:193
83039980,1cyclictest0-21swapper/323:00:483
82959988,0cyclictest0-21swapper/221:51:582
82959986,1cyclictest793-21snmpd23:41:242
82959986,1cyclictest793-21snmpd23:11:162
82959986,1cyclictest793-21snmpd22:45:042
82959986,1cyclictest793-21snmpd22:40:342
82959986,1cyclictest793-21snmpd22:40:332
82959986,1cyclictest60950irq/123-eno121:35:202
82959986,1cyclictest28-21ksoftirqd/220:40:002
82959986,1cyclictest28-21ksoftirqd/220:20:012
82959985,1cyclictest0-21swapper/200:05:202
82959983,1cyclictest60950irq/123-eno123:15:122
82959982,3cyclictest254-21systemd-journal20:15:002
82879980,7cyclictest0-21swapper/123:05:011
82879980,5cyclictest0-21swapper/122:50:151
82879980,1cyclictest0-21swapper/122:45:111
82879980,1cyclictest0-21swapper/122:05:011
82749988,0cyclictest9-21ksoftirqd/021:05:040
82749988,0cyclictest9-21ksoftirqd/020:15:040
19280280,0sleep2271rcuc/219:30:142
83039976,1cyclictest35-21ksoftirqd/323:35:013
83039976,1cyclictest35-21ksoftirqd/323:35:003
83039976,1cyclictest35-21ksoftirqd/323:25:013
83039976,1cyclictest35-21ksoftirqd/322:50:173
83039976,1cyclictest35-21ksoftirqd/322:50:003
83039976,1cyclictest35-21ksoftirqd/322:25:003
83039976,1cyclictest35-21ksoftirqd/322:05:153
83039976,1cyclictest35-21ksoftirqd/319:29:593
83039975,1cyclictest793-21snmpd20:42:513
83039975,1cyclictest793-21snmpd20:30:413
83039975,1cyclictest793-21snmpd20:14:333
83039975,1cyclictest35-21ksoftirqd/319:44:593
83039974,1cyclictest254-21systemd-journal22:55:003
83039973,2cyclictest254-21systemd-journal20:55:013
83039972,5cyclictest24194-1kworker/u9:223:35:523
83039970,5cyclictest0-21swapper/300:04:243
83039970,2cyclictest1042-21hddtemp_smartct23:50:123
82959977,0cyclictest0-21swapper/221:18:302
82959976,1cyclictest60950irq/123-eno122:25:142
82959976,1cyclictest60950irq/123-eno122:10:132
82959976,1cyclictest60950irq/123-eno121:46:182
82959976,1cyclictest60950irq/123-eno120:25:162
82959976,1cyclictest60950irq/123-eno119:57:262
82959976,1cyclictest60950irq/123-eno100:34:592
82959976,1cyclictest60950irq/123-eno100:20:182
82959976,0cyclictest60950irq/123-eno122:05:142
82959976,0cyclictest60950irq/123-eno100:37:492
82959975,1cyclictest60950irq/123-eno123:55:152
82959975,1cyclictest60950irq/123-eno120:20:122
82959973,3cyclictest28-21ksoftirqd/219:40:142
82959973,2cyclictest570-21systemd-logind22:55:192
82959971,6cyclictest0-21swapper/222:32:332
82959971,3cyclictest742-21runrttasks21:12:242
82959971,2cyclictest1712-21ntpq20:00:202
82959971,1cyclictest0-21swapper/221:02:222
82959970,5cyclictest0-21swapper/219:10:122
82959970,1cyclictest18272-21runrttasks21:30:132
82879971,6cyclictest0-21swapper/120:33:481
82879971,6cyclictest0-21swapper/119:59:561
82879971,5cyclictest0-21swapper/121:25:121
82879971,3cyclictest0-21swapper/122:38:211
82879970,6cyclictest0-21swapper/122:15:141
82879970,6cyclictest0-21swapper/100:00:201
82879970,5cyclictest0-21swapper/123:50:091
82879970,5cyclictest0-21swapper/121:56:581
82879970,4cyclictest0-21swapper/121:44:141
82879970,2cyclictest0-21swapper/120:40:201
82879970,1cyclictest0-21swapper/123:55:481
82879970,1cyclictest0-21swapper/100:36:501
82879970,0cyclictest0-21swapper/122:55:141
82879970,0cyclictest0-21swapper/120:50:011
83039966,0cyclictest35-21ksoftirqd/321:15:143
83039966,0cyclictest35-21ksoftirqd/319:29:123
83039965,1cyclictest793-21snmpd20:38:383
83039965,1cyclictest5229-21ssh23:14:233
83039965,1cyclictest4225-21ssh23:55:033
83039965,1cyclictest35-21ksoftirqd/321:05:013
83039965,1cyclictest35-21ksoftirqd/320:20:003
83039965,1cyclictest28307-21ssh23:40:423
83039965,1cyclictest18512-21ssh00:11:103
83039965,1cyclictest1724-21ntpq20:00:203
83039965,1cyclictest1449-21ntpd19:50:343
83039961,3cyclictest0-21swapper/322:25:113
83039960,2cyclictest0-21swapper/323:46:513
83039960,2cyclictest0-21swapper/300:30:593
82959966,0cyclictest60950irq/123-eno123:45:062
82959966,0cyclictest60950irq/123-eno123:30:462
82959966,0cyclictest60950irq/123-eno123:30:462
82959966,0cyclictest60950irq/123-eno123:26:092
82959966,0cyclictest60950irq/123-eno123:05:182
82959966,0cyclictest60950irq/123-eno123:00:132
82959966,0cyclictest60950irq/123-eno122:50:182
82959966,0cyclictest60950irq/123-eno122:20:542
82959966,0cyclictest60950irq/123-eno121:40:522
82959966,0cyclictest60950irq/123-eno121:20:172
82959966,0cyclictest60950irq/123-eno121:05:112
82959966,0cyclictest60950irq/123-eno119:15:232
82959966,0cyclictest60950irq/123-eno100:25:062
82959966,0cyclictest60950irq/123-eno100:15:272
82959965,1cyclictest8337-21ssh21:56:132
82959965,1cyclictest60950irq/123-eno122:00:262
82959965,1cyclictest60950irq/123-eno121:25:052
82959965,1cyclictest60950irq/123-eno120:50:162
82959965,1cyclictest23348-21ssh22:15:182
82959965,1cyclictest20783-21ntpq20:40:172
82959965,0cyclictest60950irq/123-eno122:35:152
82959964,1cyclictest60950irq/123-eno123:50:082
82959963,2cyclictest14163-21tr19:20:122
82959962,3cyclictest557-21nscd23:20:022
82959962,1cyclictest254-21systemd-journal19:39:592
82959960,6cyclictest0-21swapper/220:48:222
82959960,1cyclictest0-21swapper/219:46:352
82879966,0cyclictest0-21swapper/100:21:291
82879961,5cyclictest0-21swapper/120:18:571
82879961,3cyclictest0-21swapper/121:37:071
82879960,6cyclictest0-21swapper/123:03:521
82879960,6cyclictest0-21swapper/120:00:341
82879960,6cyclictest0-21swapper/100:28:271
82879960,5cyclictest0-21swapper/122:10:541
82879960,5cyclictest0-21swapper/122:00:191
82879960,5cyclictest0-21swapper/120:50:181
82879960,5cyclictest0-21swapper/119:50:161
82879960,4cyclictest0-21swapper/121:10:121
82879960,4cyclictest0-21swapper/100:11:561
82879960,3cyclictest0-21swapper/121:05:121
82879960,3cyclictest0-21swapper/121:00:111
82879960,3cyclictest0-21swapper/100:15:111
82879960,2cyclictest0-21swapper/123:49:571
83039954,1cyclictest35-21ksoftirqd/320:25:123
83039954,1cyclictest35-21ksoftirqd/320:05:133
83039954,1cyclictest35-21ksoftirqd/320:05:123
83039954,1cyclictest15600-21unixbench_singl19:20:223
83039952,1cyclictest32378-21grep21:05:153
83039950,3cyclictest0-21swapper/323:17:203
83039950,2cyclictest0-21swapper/320:45:113
83039950,1cyclictest26064-21cstates19:45:153
83039950,1cyclictest0-21swapper/322:00:063
82959955,0cyclictest60950irq/123-eno120:30:012
82959953,1cyclictest16574-21cstates19:25:132
82959951,2cyclictest4060-21/usr/sbin/munin20:05:182
82959951,2cyclictest4060-21/usr/sbin/munin20:05:172
82959950,1cyclictest0-21swapper/219:50:112
82879951,2cyclictest0-21swapper/121:19:491
82879951,1cyclictest0-21swapper/121:50:141
82879950,5cyclictest0-21swapper/122:20:521
82879950,5cyclictest0-21swapper/121:33:561
82879950,5cyclictest0-21swapper/100:33:041
82879950,4cyclictest0-21swapper/122:31:051
82879950,4cyclictest0-21swapper/100:05:091
82879950,2cyclictest0-21swapper/122:43:591
82879950,2cyclictest0-21swapper/122:43:591
82879950,2cyclictest0-21swapper/119:40:151
82879950,1cyclictest0-21swapper/123:20:001
82879950,1cyclictest0-21swapper/123:15:111
82879950,1cyclictest0-21swapper/122:25:151
82879950,1cyclictest0-21swapper/121:45:161
82879950,0cyclictest0-21swapper/123:27:371
82879950,0cyclictest0-21swapper/120:25:101
82879950,0cyclictest0-21swapper/120:06:111
82879950,0cyclictest0-21swapper/120:06:101
82879950,0cyclictest0-21swapper/119:17:281
82879944,0cyclictest0-21swapper/120:14:571
82879944,0cyclictest0-21swapper/119:26:381
82879942,1cyclictest28226-21chrt23:40:311
82879941,1cyclictest0-21swapper/120:55:151
82879940,2cyclictest0-21swapper/123:30:211
82879940,2cyclictest0-21swapper/123:30:211
82879940,2cyclictest0-21swapper/123:10:101
82879940,2cyclictest0-21swapper/120:35:091
82879940,1cyclictest0-21swapper/120:20:131
82879940,1cyclictest0-21swapper/119:30:161
82879940,1cyclictest0-21swapper/119:10:121
82879940,0cyclictest0-21swapper/119:48:361
82879930,1cyclictest0-21swapper/119:35:171
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional