You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-04-03 - 11:25
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack8slot7.osadl.org (updated Thu Apr 03, 2025 00:43:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
27904992018,2cyclictest60250irq/125-lan00:40:012
27904991919,0cyclictest60250irq/125-lan21:46:102
27904991919,0cyclictest60250irq/125-lan00:11:312
27904991918,1cyclictest60250irq/125-lan23:43:272
27904991918,1cyclictest60250irq/125-lan22:22:202
27904991918,1cyclictest60250irq/125-lan21:00:172
27904991818,0cyclictest702-21snmpd22:30:372
27904991818,0cyclictest60250irq/125-lan23:55:332
27904991818,0cyclictest60250irq/125-lan23:53:342
27904991818,0cyclictest60250irq/125-lan23:35:332
27904991818,0cyclictest60250irq/125-lan22:35:192
27904991818,0cyclictest60250irq/125-lan21:22:082
27904991818,0cyclictest60250irq/125-lan00:34:312
27904991818,0cyclictest60250irq/125-lan00:09:162
27904991818,0cyclictest32484-21cat19:20:152
27904991817,1cyclictest60250irq/125-lan23:20:202
27904991817,1cyclictest60250irq/125-lan22:46:262
27904991817,1cyclictest60250irq/125-lan22:25:412
27904991817,1cyclictest60250irq/125-lan22:16:122
27904991817,1cyclictest60250irq/125-lan21:58:232
27904991817,1cyclictest60250irq/125-lan21:40:162
27904991817,1cyclictest60250irq/125-lan21:35:122
27904991817,1cyclictest60250irq/125-lan21:32:132
27904991817,1cyclictest60250irq/125-lan21:19:142
27909991717,0cyclictest329-21hwrng23:25:353
27904991717,0cyclictest702-21snmpd20:31:092
27904991717,0cyclictest60250irq/125-lan23:26:262
27904991717,0cyclictest60250irq/125-lan23:16:492
27904991717,0cyclictest60250irq/125-lan22:55:112
27904991717,0cyclictest60250irq/125-lan22:51:362
27904991717,0cyclictest60250irq/125-lan22:40:142
27904991717,0cyclictest60250irq/125-lan00:25:012
27904991717,0cyclictest60250irq/125-lan00:00:152
27904991716,1cyclictest60250irq/125-lan22:12:332
27904991716,1cyclictest60250irq/125-lan22:02:252
27904991716,1cyclictest60250irq/125-lan21:53:302
27904991716,1cyclictest60250irq/125-lan21:13:212
27904991716,1cyclictest60250irq/125-lan20:35:192
27904991716,1cyclictest60250irq/125-lan20:00:152
27904991716,1cyclictest60250irq/125-lan00:16:302
27904991715,1cyclictest60250irq/125-lan23:00:112
27909991616,0cyclictest702-21snmpd00:18:473
27904991616,0cyclictest60250irq/125-lan23:47:292
27904991616,0cyclictest60250irq/125-lan23:12:372
27904991616,0cyclictest60250irq/125-lan21:26:272
27904991616,0cyclictest60250irq/125-lan20:50:162
27904991616,0cyclictest60250irq/125-lan20:13:262
27904991615,1cyclictest60250irq/125-lan23:30:002
27904991615,1cyclictest60250irq/125-lan23:06:562
27904991615,1cyclictest60250irq/125-lan19:50:152
27904991615,1cyclictest60250irq/125-lan19:25:132
27904991615,1cyclictest60250irq/125-lan19:17:262
27904991615,1cyclictest60250irq/125-lan00:20:182
27909991515,0cyclictest329-21hwrng00:32:083
27904991515,0cyclictest60250irq/125-lan22:07:502
27904991515,0cyclictest60250irq/125-lan20:42:272
27904991515,0cyclictest60250irq/125-lan20:27:272
27904991515,0cyclictest60250irq/125-lan19:40:122
27904991515,0cyclictest60250irq/125-lan19:35:132
27904991514,1cyclictest60250irq/125-lan20:55:142
27909991414,0cyclictest329-21hwrng21:43:113
27909991414,0cyclictest329-21hwrng21:06:193
27909991414,0cyclictest329-21hwrng00:20:523
27909991414,0cyclictest2080-21cat19:25:153
27909991413,1cyclictest19359-21kworker/3:2+events00:25:493
27904991414,0cyclictest60250irq/125-lan19:55:182
27904991414,0cyclictest60250irq/125-lan19:30:162
27904991413,1cyclictest60250irq/125-lan20:45:162
27909991313,0cyclictest329-21hwrng21:21:403
27904991313,0cyclictest60250irq/125-lan19:45:162
27909991212,0cyclictest329-21hwrng23:42:593
27909991212,0cyclictest329-21hwrng22:00:353
27909991212,0cyclictest329-21hwrng21:36:013
27909991212,0cyclictest329-21hwrng21:34:593
27909991212,0cyclictest329-21hwrng19:56:413
27904991212,0cyclictest60250irq/125-lan20:09:252
27904991212,0cyclictest329-21hwrng21:07:202
27904991212,0cyclictest329-21hwrng19:14:422
27909991111,0cyclictest702-21snmpd22:27:403
27909991111,0cyclictest702-21snmpd20:10:173
27904991111,0cyclictest329-21hwrng20:15:072
27904991111,0cyclictest329-21hwrng20:15:062
2790999109,1cyclictest19359-21kworker/3:2+events00:05:353
27909991010,0cyclictest702-21snmpd21:10:193
27909991010,0cyclictest329-21hwrng23:50:093
27909991010,0cyclictest329-21hwrng23:24:333
27909991010,0cyclictest329-21hwrng21:50:213
27909991010,0cyclictest12049-21cat19:50:173
279099999,0cyclictest329-21hwrng23:15:203
279099999,0cyclictest329-21hwrng22:31:183
279099999,0cyclictest329-21hwrng21:18:363
278949999,0cyclictest329-21hwrng22:08:470
278949998,1cyclictest702-21snmpd20:52:480
279099988,0cyclictest702-21snmpd20:00:023
279099988,0cyclictest329-21hwrng23:12:163
279099988,0cyclictest329-21hwrng21:26:483
279099988,0cyclictest329-21hwrng00:12:413
279099987,1cyclictest702-21snmpd20:49:093
279099987,1cyclictest19359-21kworker/3:2+events23:45:423
278999988,0cyclictest702-21snmpd23:50:341
278999988,0cyclictest702-21snmpd22:46:131
278999988,0cyclictest702-21snmpd21:40:591
278999988,0cyclictest702-21snmpd21:30:401
278999988,0cyclictest329-21hwrng21:37:021
278999988,0cyclictest329-21hwrng21:04:151
278999988,0cyclictest329-21hwrng19:53:361
278999988,0cyclictest329-21hwrng00:00:231
278999986,2cyclictest702-21snmpd19:46:401
278949988,0cyclictest702-21snmpd23:05:290
278949988,0cyclictest702-21snmpd21:28:020
278949988,0cyclictest329-21hwrng22:03:390
278949988,0cyclictest329-21hwrng21:55:280
278949988,0cyclictest329-21hwrng21:37:020
278949988,0cyclictest329-21hwrng20:33:330
278949988,0cyclictest329-21hwrng19:56:410
278949988,0cyclictest329-21hwrng19:26:590
278949988,0cyclictest329-21hwrng19:24:550
278949988,0cyclictest329-21hwrng00:08:360
278949986,2cyclictest702-21snmpd23:41:240
279099977,0cyclictest702-21snmpd22:50:383
279099977,0cyclictest702-21snmpd22:22:103
279099977,0cyclictest702-21snmpd20:32:483
279099977,0cyclictest702-21snmpd19:33:433
279099977,0cyclictest329-21hwrng23:37:523
279099977,0cyclictest329-21hwrng23:08:103
279099977,0cyclictest329-21hwrng22:18:003
279099977,0cyclictest329-21hwrng19:39:163
279099977,0cyclictest329-21hwrng00:04:293
279099976,1cyclictest702-21snmpd20:21:533
279099976,1cyclictest702-21snmpd20:21:533
279099976,1cyclictest19359-21kworker/3:2+events19:40:183
279099970,3cyclictest0-21swapper/320:55:143
279049977,0cyclictest60250irq/125-lan20:20:152
279049977,0cyclictest60250irq/125-lan20:20:152
278999977,0cyclictest702-21snmpd23:27:061
278999977,0cyclictest702-21snmpd23:03:531
278999977,0cyclictest702-21snmpd20:59:431
278999977,0cyclictest329-21hwrng22:07:451
278999977,0cyclictest329-21hwrng20:28:261
278999977,0cyclictest329-21hwrng00:07:341
278999976,1cyclictest702-21snmpd23:18:361
278999976,1cyclictest702-21snmpd22:10:061
278999976,1cyclictest702-21snmpd19:39:541
278999976,1cyclictest702-21snmpd00:29:051
278999976,1cyclictest702-21snmpd00:19:471
278999976,1cyclictest4136-21cat23:20:141
278949977,0cyclictest702-21snmpd23:31:030
278949977,0cyclictest702-21snmpd22:10:090
278949977,0cyclictest329-21hwrng23:53:130
278949977,0cyclictest329-21hwrng23:29:400
278949977,0cyclictest329-21hwrng23:15:200
278949977,0cyclictest329-21hwrng22:56:540
278949977,0cyclictest329-21hwrng22:51:470
278949977,0cyclictest329-21hwrng21:54:260
278949977,0cyclictest329-21hwrng21:48:180
278949977,0cyclictest329-21hwrng21:10:250
278949977,0cyclictest329-21hwrng21:07:200
278949977,0cyclictest329-21hwrng20:35:360
278949977,0cyclictest329-21hwrng20:12:030
278949977,0cyclictest329-21hwrng20:08:580
278949977,0cyclictest329-21hwrng20:00:470
278949977,0cyclictest329-21hwrng19:49:310
278949977,0cyclictest329-21hwrng19:41:190
278949977,0cyclictest329-21hwrng19:35:100
278949977,0cyclictest329-21hwrng19:33:080
278949977,0cyclictest329-21hwrng00:39:180
278949977,0cyclictest329-21hwrng00:20:520
278949977,0cyclictest329-21hwrng00:10:380
278949976,1cyclictest7915-21cat21:40:160
278949976,1cyclictest702-21snmpd23:02:440
278949976,1cyclictest702-21snmpd20:24:230
278949976,1cyclictest702-21snmpd20:24:230
278949976,1cyclictest702-21snmpd19:11:330
278949976,1cyclictest25060-21cron00:20:000
278949975,2cyclictest702-21snmpd22:21:310
279099966,0cyclictest702-21snmpd22:05:573
279099966,0cyclictest702-21snmpd20:39:183
279099966,0cyclictest329-21hwrng21:55:283
279099966,0cyclictest329-21hwrng19:20:513
279099966,0cyclictest329-21hwrng19:17:453
279099966,0cyclictest329-21hwrng00:35:123
279099966,0cyclictest19359-21kworker/3:2+events22:58:433
279099965,1cyclictest702-21snmpd20:28:383
279099965,1cyclictest2872-21cat22:10:103
279099965,1cyclictest19359-21kworker/3:2+events22:44:393
279099965,1cyclictest19359-21kworker/3:2+events22:37:393
279099965,1cyclictest19359-21kworker/3:2+events20:07:193
279099965,1cyclictest19359-21kworker/3:2+events19:10:183
278999966,0cyclictest702-21snmpd23:35:241
278999966,0cyclictest702-21snmpd22:29:101
278999966,0cyclictest702-21snmpd22:24:251
278999966,0cyclictest702-21snmpd21:54:271
278999966,0cyclictest702-21snmpd20:02:111
278999966,0cyclictest702-21snmpd19:34:041
278999966,0cyclictest329-21hwrng22:42:341
278999966,0cyclictest329-21hwrng19:58:441
278999966,0cyclictest329-21hwrng19:11:381
278999965,1cyclictest7577-21cpuspeed_turbos22:15:131
278999965,1cyclictest702-21snmpd23:43:451
278999965,1cyclictest702-21snmpd21:18:271
278999965,1cyclictest702-21snmpd00:31:201
278999964,2cyclictest4922-21cat00:35:161
278949966,0cyclictest702-21snmpd23:49:370
278949966,0cyclictest702-21snmpd22:43:550
278949966,0cyclictest702-21snmpd22:26:340
278949966,0cyclictest329-21hwrng22:47:410
278949966,0cyclictest329-21hwrng19:51:340
278949966,0cyclictest329-21hwrng00:25:590
278949965,1cyclictest702-21snmpd20:47:050
278949964,2cyclictest702-21snmpd00:33:440
279099955,0cyclictest702-21snmpd22:47:523
279099955,0cyclictest702-21snmpd21:01:373
279099955,0cyclictest702-21snmpd20:19:173
279099955,0cyclictest702-21snmpd20:19:163
279099955,0cyclictest329-21hwrng20:42:463
279099954,1cyclictest19359-21kworker/3:2+events23:55:153
279099954,1cyclictest19359-21kworker/3:2+events23:30:573
279099954,1cyclictest19359-21kworker/3:2+events23:01:093
279099954,1cyclictest10065-21cat19:45:153
278999955,0cyclictest329-21hwrng23:45:021
278999955,0cyclictest329-21hwrng21:47:161
278999955,0cyclictest329-21hwrng20:18:111
278999955,0cyclictest329-21hwrng20:18:111
278999954,1cyclictest702-21snmpd23:56:281
278999954,1cyclictest702-21snmpd21:06:161
278999954,1cyclictest702-21snmpd20:22:531
278999954,1cyclictest702-21snmpd20:22:531
278999954,1cyclictest26319-21cpuspeed_turbos22:00:171
278999954,1cyclictest15304-21sh22:57:001
278949955,0cyclictest702-21snmpd21:01:060
278949955,0cyclictest702-21snmpd00:01:160
278949955,0cyclictest329-21hwrng23:59:220
278949955,0cyclictest329-21hwrng22:36:250
278949955,0cyclictest329-21hwrng22:30:170
278949954,1cyclictest702-21snmpd23:10:500
278949954,1cyclictest702-21snmpd22:16:390
278949954,1cyclictest6683-21turbostat21:00:010
278949954,1cyclictest151ktimers/020:25:170
278949953,2cyclictest17009-21ntp_states21:15:170
278949950,1cyclictest741-21munin-run20:45:010
279099943,1cyclictest3814-21ntpq20:50:213
279099943,1cyclictest19359-21kworker/3:2+events21:45:013
278999944,0cyclictest702-21snmpd20:48:151
278999944,0cyclictest702-21snmpd19:40:011
278999944,0cyclictest329-21hwrng23:06:071
278999944,0cyclictest329-21hwrng21:29:521
278999944,0cyclictest329-21hwrng21:11:261
278999944,0cyclictest329-21hwrng20:40:431
278999944,0cyclictest329-21hwrng20:36:371
278999944,0cyclictest329-21hwrng20:33:331
278999944,0cyclictest329-21hwrng19:16:451
278999944,0cyclictest329-21hwrng00:21:551
278999944,0cyclictest329-21hwrng00:10:381
278999943,1cyclictest702-21snmpd22:33:341
278999943,1cyclictest702-21snmpd20:50:031
278999943,1cyclictest702-21snmpd20:11:561
278999943,1cyclictest702-21snmpd19:25:181
278999942,2cyclictest702-21snmpd21:22:311
278999942,2cyclictest24264-21ssh21:57:481
278999942,2cyclictest12434-21diskstats23:30:121
278999940,1cyclictest0-21swapper/122:50:351
278999940,1cyclictest0-21swapper/119:20:121
278949944,0cyclictest702-21snmpd21:33:530
278949943,1cyclictest0-21swapper/019:15:210
278999933,0cyclictest329-21hwrng22:35:241
278999931,2cyclictest702-21snmpd20:05:021
278999931,2cyclictest26041-21sh23:10:041
278949932,1cyclictest21901-21hddtemp_smartct20:15:150
278949932,1cyclictest21901-21hddtemp_smartct20:15:150
278949932,1cyclictest151ktimers/023:35:070
278949931,2cyclictest3666-21apt-get23:20:120
278949930,2cyclictest707-21runrttasks21:20:080
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional