You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-11-25 - 10:00
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot6.osadl.org (updated Mon Nov 25, 2024 00:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2972621590,2sleep22635999cyclictest22:08:512
2972621590,2sleep22635999cyclictest22:08:512
1518911090,40ptp4l401ktimersoftd/319:53:513
182942710,2sleep20-21swapper/223:48:482
151891670,1ptp4l401ktimersoftd/301:24:423
151891670,1ptp4l401ktimersoftd/300:06:083
151891660,10ptp4l401ktimersoftd/300:14:433
26562650,6sleep22635999cyclictest22:15:342
81912640,3sleep12635499cyclictest00:13:481
151891640,1ptp4l401ktimersoftd/300:38:363
299262630,2sleep20-21swapper/223:24:472
260882634,9sleep00-21swapper/019:56:210
9412610,5sleep12635499cyclictest20:08:501
21592610,2sleep10-21swapper/100:44:441
151891610,1ptp4l401ktimersoftd/321:13:403
326472590,2sleep00-21swapper/020:08:410
152072550,1sleep20-21swapper/223:44:352
26354995427,9cyclictest25-21ksoftirqd/100:53:301
26354995427,4cyclictest25-21ksoftirqd/101:13:501
192352540,2sleep00-21swapper/001:04:100
26354995325,8cyclictest25-21ksoftirqd/123:48:401
26354995322,9cyclictest25-21ksoftirqd/100:03:411
26354995322,7cyclictest25-21ksoftirqd/123:28:421
225242530,4sleep222486-21ssh22:38:502
26354995224,5cyclictest25-21ksoftirqd/101:08:541
26354995224,4cyclictest25-21ksoftirqd/101:03:591
26354995223,4cyclictest25-21ksoftirqd/121:38:541
2635499516,9cyclictest25-21ksoftirqd/100:08:441
26354995123,7cyclictest25-21ksoftirqd/120:58:441
26354995123,4cyclictest25-21ksoftirqd/122:43:451
26354995023,8cyclictest25-21ksoftirqd/123:18:281
26354994935,4cyclictest25-21ksoftirqd/120:18:411
26354994924,4cyclictest25-21ksoftirqd/122:23:401
26354994924,4cyclictest25-21ksoftirqd/100:03:291
26354994923,8cyclictest25-21ksoftirqd/123:08:421
26354994923,4cyclictest25-21ksoftirqd/122:03:371
26354994923,10cyclictest25-21ksoftirqd/100:23:561
26354994922,5cyclictest25-21ksoftirqd/121:38:261
26354994920,9cyclictest25-21ksoftirqd/122:56:181
26354994920,6cyclictest25-21ksoftirqd/122:38:571
26354994823,4cyclictest25-21ksoftirqd/101:28:251
26354994822,8cyclictest25-21ksoftirqd/122:18:501
26354994822,8cyclictest25-21ksoftirqd/122:03:261
26354994821,7cyclictest25-21ksoftirqd/123:55:121
26354994821,7cyclictest25-21ksoftirqd/123:55:121
26354994820,5cyclictest25-21ksoftirqd/121:43:421
26354994820,11cyclictest25-21ksoftirqd/121:28:421
26354994820,11cyclictest25-21ksoftirqd/100:38:571
26354994723,4cyclictest25-21ksoftirqd/122:48:421
26354994723,10cyclictest25-21ksoftirqd/100:19:031
26354994721,9cyclictest25-21ksoftirqd/122:58:531
26354994721,4cyclictest25-21ksoftirqd/123:43:421
26354994720,5cyclictest25-21ksoftirqd/123:23:431
26354994718,6cyclictest25-21ksoftirqd/122:08:451
26354994718,6cyclictest25-21ksoftirqd/122:08:451
2635499467,5cyclictest25-21ksoftirqd/120:38:241
26354994634,3cyclictest25-21ksoftirqd/121:23:571
26354994623,4cyclictest25-21ksoftirqd/121:03:391
26354994623,4cyclictest25-21ksoftirqd/120:43:431
26354994623,4cyclictest25-21ksoftirqd/120:13:391
26354994623,3cyclictest25-21ksoftirqd/121:13:251
26354994622,4cyclictest25-21ksoftirqd/123:38:551
26354994622,4cyclictest25-21ksoftirqd/100:35:141
26354994621,9cyclictest25-21ksoftirqd/100:53:501
26354994620,10cyclictest25-21ksoftirqd/120:38:411
26354994619,7cyclictest25-21ksoftirqd/101:18:571
26354994618,10cyclictest25-21ksoftirqd/123:36:281
26354994618,10cyclictest25-21ksoftirqd/122:33:371
26354994616,9cyclictest25-21ksoftirqd/100:33:071
2635499460,8cyclictest14868-21sed22:28:551
131512460,2sleep20-21swapper/200:58:422
2635499456,3cyclictest25-21ksoftirqd/123:03:511
2635499455,7cyclictest25-21ksoftirqd/120:03:401
26354994522,4cyclictest25-21ksoftirqd/121:18:401
26354994517,11cyclictest25-21ksoftirqd/121:48:351
26354994516,4cyclictest25-21ksoftirqd/123:20:161
178622450,1sleep20-21swapper/223:11:222
2635499446,5cyclictest25-21ksoftirqd/120:23:421
2635499446,5cyclictest25-21ksoftirqd/120:23:421
26354994435,3cyclictest25-21ksoftirqd/119:58:451
26354994423,9cyclictest25-21ksoftirqd/121:13:441
26354994421,9cyclictest25-21ksoftirqd/120:48:541
26354994419,10cyclictest25-21ksoftirqd/122:13:471
26354994320,4cyclictest25-21ksoftirqd/100:59:151
151891430,1ptp4l401ktimersoftd/322:02:463
2635499425,8cyclictest25-21ksoftirqd/121:58:251
2635499425,3cyclictest25-21ksoftirqd/120:33:241
2600724221,11sleep125-21ksoftirqd/119:55:171
2635499414,5cyclictest25-21ksoftirqd/120:53:371
151891390,1ptp4l401ktimersoftd/322:22:133
151891390,1ptp4l401ktimersoftd/301:08:363
151891390,1ptp4l401ktimersoftd/301:02:333
151891380,1ptp4l401ktimersoftd/322:53:403
151891380,1ptp4l401ktimersoftd/322:48:523
151891380,1ptp4l401ktimersoftd/320:58:423
151891380,1ptp4l401ktimersoftd/320:53:393
151891380,1ptp4l401ktimersoftd/301:07:033
26348993727,5cyclictest9-21ksoftirqd/020:18:370
151891370,1ptp4l401ktimersoftd/323:32:473
151891370,1ptp4l401ktimersoftd/323:06:183
151891370,1ptp4l401ktimersoftd/321:03:403
151891370,1ptp4l401ktimersoftd/301:18:573
151891370,1ptp4l401ktimersoftd/300:21:443
151891370,14ptp4l401ktimersoftd/323:23:363
151891360,1ptp4l401ktimersoftd/323:15:503
151891360,1ptp4l401ktimersoftd/323:02:303
151891360,1ptp4l401ktimersoftd/320:32:153
151891360,1ptp4l401ktimersoftd/301:14:303
151891360,1ptp4l401ktimersoftd/300:28:423
26348993524,6cyclictest9-21ksoftirqd/022:18:420
26348993522,7cyclictest9-21ksoftirqd/023:43:400
259762352,20sleep21033-21snmpd19:54:532
151891350,0ptp4l401ktimersoftd/321:30:473
26348993417,5cyclictest9-21ksoftirqd/022:40:140
151891340,2ptp4l20134-21kworker/3:122:14:343
151891340,1ptp4l401ktimersoftd/322:27:103
151891340,1ptp4l401ktimersoftd/322:05:243
151891340,1ptp4l401ktimersoftd/300:46:393
151891340,1ptp4l401ktimersoftd/300:12:163
26369993320,10cyclictest41-21ksoftirqd/323:43:503
26359993328,3cyclictest33-21ksoftirqd/221:48:252
151891330,1ptp4l401ktimersoftd/323:55:163
151891330,1ptp4l401ktimersoftd/323:55:163
151891330,1ptp4l401ktimersoftd/322:39:523
151891330,1ptp4l401ktimersoftd/320:23:383
151891330,1ptp4l401ktimersoftd/320:23:383
151891330,1ptp4l401ktimersoftd/300:38:073
151891330,11ptp4l401ktimersoftd/300:55:413
26359993227,3cyclictest33-21ksoftirqd/222:58:272
26359993227,3cyclictest33-21ksoftirqd/200:28:292
26348993227,3cyclictest9-21ksoftirqd/000:56:390
151891320,1ptp4l401ktimersoftd/323:52:243
151891320,1ptp4l401ktimersoftd/322:46:183
151891320,1ptp4l401ktimersoftd/322:09:293
151891320,1ptp4l401ktimersoftd/322:09:293
151891320,1ptp4l401ktimersoftd/321:41:333
151891320,10ptp4l401ktimersoftd/321:53:443
26359993126,3cyclictest33-21ksoftirqd/200:03:282
26359993125,3cyclictest33-21ksoftirqd/200:53:302
26348993126,3cyclictest9-21ksoftirqd/021:48:250
26348993126,3cyclictest9-21ksoftirqd/020:08:230
151891310,1ptp4l401ktimersoftd/323:22:113
151891310,1ptp4l401ktimersoftd/322:36:463
151891310,1ptp4l401ktimersoftd/300:48:313
151891310,1ptp4l401ktimersoftd/300:24:463
151891310,0ptp4l401ktimersoftd/323:38:333
151891310,0ptp4l401ktimersoftd/321:37:033
26369993025,3cyclictest41-21ksoftirqd/320:48:243
26359993025,3cyclictest33-21ksoftirqd/223:03:282
26359993025,3cyclictest33-21ksoftirqd/221:23:252
26359993025,3cyclictest33-21ksoftirqd/220:58:242
26348993024,3cyclictest9-21ksoftirqd/023:28:470
151891300,1ptp4l401ktimersoftd/323:34:123
151891300,1ptp4l401ktimersoftd/322:30:043
151891300,1ptp4l401ktimersoftd/321:45:203
151891300,1ptp4l401ktimersoftd/320:50:063
151891300,1ptp4l401ktimersoftd/320:38:133
151891300,0ptp4l401ktimersoftd/300:01:573
26359992924,3cyclictest33-21ksoftirqd/223:13:462
26359992924,3cyclictest33-21ksoftirqd/221:58:462
26359992924,3cyclictest33-21ksoftirqd/220:33:242
26359992924,3cyclictest33-21ksoftirqd/201:28:302
26359992923,4cyclictest33-21ksoftirqd/201:13:592
26359992923,3cyclictest33-21ksoftirqd/200:08:402
26359992923,3cyclictest33-21ksoftirqd/200:08:042
26348992923,3cyclictest9-21ksoftirqd/022:28:440
26348992911,7cyclictest9-21ksoftirqd/020:58:250
26348992911,6cyclictest9-21ksoftirqd/022:43:430
2634899291,13cyclictest0-21swapper/022:54:390
26359992823,3cyclictest33-21ksoftirqd/223:58:282
26359992823,3cyclictest33-21ksoftirqd/223:58:282
26359992823,3cyclictest33-21ksoftirqd/222:48:462
26359992823,3cyclictest33-21ksoftirqd/221:23:472
26359992823,3cyclictest33-21ksoftirqd/220:08:362
26359992823,3cyclictest33-21ksoftirqd/200:38:412
26359992823,3cyclictest33-21ksoftirqd/200:33:292
26359992821,3cyclictest33-21ksoftirqd/222:48:282
26348992823,3cyclictest9-21ksoftirqd/001:28:300
26348992823,3cyclictest9-21ksoftirqd/000:53:300
26348992822,3cyclictest9-21ksoftirqd/022:53:270
26348992822,3cyclictest9-21ksoftirqd/020:23:370
26348992822,3cyclictest9-21ksoftirqd/020:23:370
26348992821,5cyclictest9-21ksoftirqd/023:14:200
26348992821,4cyclictest9-21ksoftirqd/000:33:430
26348992812,7cyclictest9-21ksoftirqd/001:01:320
26369992721,3cyclictest41-21ksoftirqd/321:18:463
26369992721,3cyclictest41-21ksoftirqd/320:08:403
26369992721,3cyclictest41-21ksoftirqd/320:00:473
26359992722,3cyclictest33-21ksoftirqd/222:33:422
26359992722,3cyclictest33-21ksoftirqd/222:03:442
26359992722,3cyclictest33-21ksoftirqd/200:53:402
26359992722,3cyclictest33-21ksoftirqd/200:38:302
26359992722,3cyclictest33-21ksoftirqd/200:18:302
26359992721,3cyclictest33-21ksoftirqd/222:23:442
26359992720,4cyclictest33-21ksoftirqd/223:03:392
26359992720,4cyclictest33-21ksoftirqd/220:13:362
26359992719,5cyclictest33-21ksoftirqd/221:43:252
2635999270,25cyclictest0-21swapper/220:43:242
26348992722,3cyclictest9-21ksoftirqd/023:23:400
26348992722,3cyclictest9-21ksoftirqd/023:03:280
26348992722,3cyclictest9-21ksoftirqd/022:28:260
26348992722,3cyclictest9-21ksoftirqd/021:18:430
26348992722,3cyclictest9-21ksoftirqd/020:03:230
26348992722,3cyclictest9-21ksoftirqd/001:09:010
26348992721,3cyclictest9-21ksoftirqd/021:48:430
26348992721,3cyclictest9-21ksoftirqd/000:03:390
26369992619,4cyclictest41-21ksoftirqd/321:12:153
26369992619,4cyclictest41-21ksoftirqd/320:39:363
26369992619,4cyclictest41-21ksoftirqd/320:23:023
26359992622,3cyclictest33-21ksoftirqd/223:18:502
26359992621,3cyclictest33-21ksoftirqd/221:28:452
26359992621,3cyclictest33-21ksoftirqd/220:03:232
26359992620,3cyclictest33-21ksoftirqd/223:41:472
26359992620,3cyclictest33-21ksoftirqd/220:04:002
26359992619,4cyclictest33-21ksoftirqd/221:07:452
26348992621,3cyclictest9-21ksoftirqd/000:08:470
26348992620,3cyclictest9-21ksoftirqd/022:38:270
26348992620,3cyclictest9-21ksoftirqd/021:53:450
26348992620,3cyclictest9-21ksoftirqd/000:23:430
26348992619,4cyclictest9-21ksoftirqd/021:04:580
26348992619,4cyclictest9-21ksoftirqd/020:51:410
26348992616,5cyclictest9-21ksoftirqd/023:48:410
26348992613,6cyclictest9-21ksoftirqd/000:38:400
151891260,1ptp4l401ktimersoftd/321:24:203
151891260,1ptp4l401ktimersoftd/320:06:183
26369992519,3cyclictest41-21ksoftirqd/321:48:433
2635999256,4cyclictest8579-21latency_hist22:23:272
26359992520,3cyclictest33-21ksoftirqd/221:08:352
26359992520,3cyclictest33-21ksoftirqd/220:43:522
26359992520,3cyclictest33-21ksoftirqd/220:28:232
26359992520,3cyclictest33-21ksoftirqd/220:28:232
26359992520,3cyclictest2080-1kworker/u9:100:48:162
26359992519,4cyclictest33-21ksoftirqd/220:18:462
26359992519,3cyclictest33-21ksoftirqd/221:38:262
26348992520,3cyclictest9-21ksoftirqd/023:38:480
26348992520,3cyclictest9-21ksoftirqd/022:13:440
26348992519,3cyclictest9-21ksoftirqd/023:33:470
26348992519,3cyclictest9-21ksoftirqd/021:23:500
26348992519,3cyclictest9-21ksoftirqd/020:59:440
26348992511,5cyclictest9-21ksoftirqd/022:08:460
26348992511,5cyclictest9-21ksoftirqd/022:08:460
26369992419,3cyclictest41-21ksoftirqd/323:08:463
26369992419,3cyclictest41-21ksoftirqd/320:13:423
2635999243,18cyclictest13450-21grep22:28:412
26359992419,3cyclictest33-21ksoftirqd/223:28:292
26359992418,3cyclictest33-21ksoftirqd/221:00:212
2635999241,20cyclictest8311-21munin-run23:38:282
26348992419,3cyclictest9-21ksoftirqd/023:19:010
26348992419,3cyclictest9-21ksoftirqd/021:13:440
26348992419,3cyclictest9-21ksoftirqd/020:43:430
26348992419,3cyclictest9-21ksoftirqd/001:18:520
26348992418,3cyclictest9-21ksoftirqd/021:36:010
26348992418,3cyclictest9-21ksoftirqd/021:28:450
26348992417,4cyclictest9-21ksoftirqd/000:46:240
26348992410,5cyclictest9-21ksoftirqd/023:04:050
26359992317,4cyclictest33-21ksoftirqd/200:18:502
26359992317,3cyclictest33-21ksoftirqd/201:20:552
26359992310,10cyclictest16486-21sed21:48:542
2635999230,21cyclictest0-21swapper/221:54:512
2635999230,21cyclictest0-21swapper/201:11:212
26348992318,3cyclictest9-21ksoftirqd/000:22:410
26348992318,3cyclictest9-21ksoftirqd/000:14:010
26348992317,3cyclictest9-21ksoftirqd/020:42:360
26348992317,3cyclictest9-21ksoftirqd/000:28:480
26348992314,5cyclictest25800-21apt-get01:13:420
26359992217,3cyclictest33-21ksoftirqd/201:04:002
26359992215,4cyclictest33-21ksoftirqd/221:14:592
2634899227,10cyclictest25748-1kworker/u9:223:58:450
2634899225,5cyclictest9-21ksoftirqd/022:02:150
26348992218,2cyclictest18992-21sed23:13:280
26348992217,3cyclictest9-21ksoftirqd/022:03:420
2635999210,20cyclictest0-21swapper/220:48:452
2635999210,20cyclictest0-21swapper/220:35:462
26348992116,3cyclictest9-21ksoftirqd/021:08:440
26348992115,3cyclictest9-21ksoftirqd/023:53:580
26348992115,3cyclictest9-21ksoftirqd/023:53:580
26348992115,3cyclictest9-21ksoftirqd/020:33:370
26348992115,3cyclictest9-21ksoftirqd/020:13:360
26348992014,4cyclictest9015-21/usr/sbin/munin20:28:360
26348991914,3cyclictest9-21ksoftirqd/021:38:440
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional