You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-27 - 14:20

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot6s.osadl.org (updated Sat Jul 27, 2024 00:43:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
24986992222,0cyclictest331-21hwrng21:41:400
25000991918,1cyclictest31500-21kworker/3:1+events21:11:553
24995991918,1cyclictest61550irq/125-lan23:23:302
24995991918,1cyclictest61550irq/125-lan22:28:392
24995991918,1cyclictest61550irq/125-lan21:50:212
24995991918,1cyclictest61550irq/125-lan21:49:582
24995991918,1cyclictest61550irq/125-lan21:20:152
24995991918,1cyclictest61550irq/125-lan00:30:142
24995991918,1cyclictest61550irq/125-lan00:29:462
24995991918,1cyclictest61550irq/125-lan00:17:112
25000991818,0cyclictest716-21snmpd22:18:153
25000991818,0cyclictest716-21snmpd21:39:293
25000991818,0cyclictest716-21snmpd19:42:293
25000991815,1cyclictest31500-21kworker/3:1+events21:57:573
24995991818,0cyclictest716-21snmpd23:30:582
24995991818,0cyclictest61550irq/125-lan23:43:142
24995991818,0cyclictest61550irq/125-lan23:17:062
24995991818,0cyclictest61550irq/125-lan22:31:392
24995991818,0cyclictest61550irq/125-lan22:10:142
24995991818,0cyclictest61550irq/125-lan22:00:102
24995991818,0cyclictest61550irq/125-lan21:40:222
24995991818,0cyclictest61550irq/125-lan19:30:132
24995991817,1cyclictest61550irq/125-lan23:55:142
24995991817,1cyclictest61550irq/125-lan23:50:232
24995991817,1cyclictest61550irq/125-lan23:39:102
24995991817,1cyclictest61550irq/125-lan23:13:222
24995991817,1cyclictest61550irq/125-lan23:00:132
24995991817,1cyclictest61550irq/125-lan23:00:132
24995991817,1cyclictest61550irq/125-lan22:50:172
24995991817,1cyclictest61550irq/125-lan22:20:122
24995991817,1cyclictest61550irq/125-lan22:17:272
24995991817,1cyclictest61550irq/125-lan21:28:182
24995991817,1cyclictest61550irq/125-lan21:05:002
24995991817,1cyclictest61550irq/125-lan19:35:232
24995991816,1cyclictest61550irq/125-lan22:45:072
25000991716,1cyclictest31500-21kworker/3:1+events21:53:363
24995991717,0cyclictest61550irq/125-lan23:45:152
24995991717,0cyclictest61550irq/125-lan23:27:102
24995991717,0cyclictest61550irq/125-lan22:41:072
24995991717,0cyclictest61550irq/125-lan22:35:192
24995991717,0cyclictest61550irq/125-lan22:05:142
24995991717,0cyclictest61550irq/125-lan21:35:122
24995991717,0cyclictest61550irq/125-lan21:18:142
24995991717,0cyclictest61550irq/125-lan19:21:322
24995991717,0cyclictest61550irq/125-lan19:10:142
24995991717,0cyclictest61550irq/125-lan00:14:582
24995991717,0cyclictest61550irq/125-lan00:05:542
24995991716,1cyclictest61550irq/125-lan21:58:252
24995991716,1cyclictest61550irq/125-lan00:35:192
24995991716,1cyclictest61550irq/125-lan00:22:262
25000991616,0cyclictest716-21snmpd21:28:173
25000991616,0cyclictest716-21snmpd20:57:283
25000991616,0cyclictest331-21hwrng23:30:133
25000991615,1cyclictest331-21hwrng23:45:363
25000991615,1cyclictest331-21hwrng00:21:263
25000991615,1cyclictest31500-21kworker/3:1+events23:43:593
24995991616,0cyclictest61550irq/125-lan22:56:402
24995991616,0cyclictest61550irq/125-lan21:30:252
24995991616,0cyclictest61550irq/125-lan21:12:482
24995991616,0cyclictest61550irq/125-lan00:01:382
24995991615,1cyclictest61550irq/125-lan23:09:422
24995991615,1cyclictest61550irq/125-lan20:45:192
24995991615,1cyclictest61550irq/125-lan20:05:112
25000991515,0cyclictest331-21hwrng23:52:453
25000991515,0cyclictest331-21hwrng23:22:013
25000991515,0cyclictest331-21hwrng23:11:483
25000991515,0cyclictest331-21hwrng22:13:253
25000991515,0cyclictest331-21hwrng21:20:103
25000991515,0cyclictest331-21hwrng20:41:163
25000991515,0cyclictest331-21hwrng00:38:493
25000991515,0cyclictest331-21hwrng00:13:133
25000991515,0cyclictest331-21hwrng00:06:033
25000991514,1cyclictest31500-21kworker/3:1+events22:38:053
25000991514,0cyclictest331-21hwrng23:00:313
25000991514,0cyclictest331-21hwrng23:00:313
24995991515,0cyclictest61550irq/125-lan19:40:242
24995991515,0cyclictest61550irq/125-lan19:15:132
24995991514,1cyclictest61550irq/125-lan20:50:102
24986991515,0cyclictest331-21hwrng21:16:040
25000991414,0cyclictest716-21snmpd20:05:353
25000991414,0cyclictest331-21hwrng23:56:503
25000991414,0cyclictest331-21hwrng23:27:093
25000991414,0cyclictest331-21hwrng23:15:533
25000991414,0cyclictest331-21hwrng23:06:403
25000991414,0cyclictest331-21hwrng22:55:243
25000991414,0cyclictest331-21hwrng22:50:173
25000991414,0cyclictest331-21hwrng22:43:083
25000991414,0cyclictest331-21hwrng22:26:443
25000991414,0cyclictest331-21hwrng22:24:413
25000991414,0cyclictest331-21hwrng21:46:483
25000991414,0cyclictest331-21hwrng21:42:423
25000991414,0cyclictest331-21hwrng20:47:243
25000991414,0cyclictest331-21hwrng20:01:193
25000991414,0cyclictest331-21hwrng19:27:323
25000991414,0cyclictest31500-21kworker/3:1+events21:17:313
24995991414,0cyclictest61550irq/125-lan20:40:122
24995991414,0cyclictest61550irq/125-lan20:33:322
24995991414,0cyclictest61550irq/125-lan19:25:202
24995991414,0cyclictest331-21hwrng20:38:112
24995991414,0cyclictest331-21hwrng20:28:582
24995991414,0cyclictest331-21hwrng20:10:322
24995991414,0cyclictest331-21hwrng19:50:042
24986991414,0cyclictest331-21hwrng00:39:510
24986991414,0cyclictest331-21hwrng00:23:280
25000991313,0cyclictest331-21hwrng22:46:113
25000991313,0cyclictest331-21hwrng21:34:303
25000991313,0cyclictest331-21hwrng19:30:363
24995991313,0cyclictest61550irq/125-lan19:45:182
24995991313,0cyclictest331-21hwrng21:08:542
24995991313,0cyclictest331-21hwrng20:16:412
24995991313,0cyclictest331-21hwrng19:59:172
24995991312,1cyclictest61550irq/125-lan20:55:122
24986991313,0cyclictest331-21hwrng23:39:260
24986991313,0cyclictest331-21hwrng23:22:010
24986991313,0cyclictest331-21hwrng22:23:390
24986991212,0cyclictest331-21hwrng23:56:500
24986991212,0cyclictest331-21hwrng23:34:200
24986991212,0cyclictest331-21hwrng20:01:190
25000991111,0cyclictest331-21hwrng22:06:153
24995991111,0cyclictest61550irq/125-lan20:20:322
24995991111,0cyclictest61550irq/125-lan20:00:222
24986991111,0cyclictest331-21hwrng21:11:590
24986991010,0cyclictest331-21hwrng22:34:550
24986991010,0cyclictest331-21hwrng22:28:470
24986991010,0cyclictest331-21hwrng20:25:540
24986991010,0cyclictest331-21hwrng20:13:370
24986991010,0cyclictest331-21hwrng19:50:030
250009999,0cyclictest331-21hwrng22:03:113
249869999,0cyclictest331-21hwrng22:18:320
249869999,0cyclictest331-21hwrng20:47:240
249869999,0cyclictest331-21hwrng20:38:110
249869998,1cyclictest716-21snmpd21:28:470
249869998,1cyclictest716-21snmpd19:11:550
250009988,0cyclictest716-21snmpd20:51:553
250009988,0cyclictest716-21snmpd20:11:303
250009988,0cyclictest331-21hwrng00:34:443
250009986,1cyclictest31500-21kworker/3:1+events19:16:373
249919988,0cyclictest716-21snmpd23:18:381
249919988,0cyclictest716-21snmpd23:03:211
249919988,0cyclictest716-21snmpd23:03:201
249919988,0cyclictest716-21snmpd21:48:541
249919988,0cyclictest716-21snmpd00:36:531
249919988,0cyclictest22314-21kworker/1:2+tpm_dev_wq19:56:161
249869988,0cyclictest716-21snmpd22:50:280
249869988,0cyclictest716-21snmpd22:43:310
249869988,0cyclictest716-21snmpd21:31:290
249869988,0cyclictest716-21snmpd19:30:310
249869988,0cyclictest331-21hwrng23:26:070
249869988,0cyclictest331-21hwrng22:13:260
249869988,0cyclictest331-21hwrng21:46:480
249869988,0cyclictest331-21hwrng20:41:160
249869988,0cyclictest331-21hwrng19:59:170
249869988,0cyclictest331-21hwrng19:25:290
249869987,1cyclictest716-21snmpd20:07:110
250009977,0cyclictest716-21snmpd21:04:043
250009976,1cyclictest3850-21kworker/3:2+events00:25:053
250009976,1cyclictest3850-21kworker/3:2+events00:15:593
250009976,1cyclictest3850-21kworker/3:2+events00:00:133
250009976,1cyclictest31500-21kworker/3:1+events23:35:133
250009976,1cyclictest31500-21kworker/3:1+events22:30:073
250009976,1cyclictest31500-21kworker/3:1+events20:35:193
250009976,1cyclictest31500-21kworker/3:1+events20:34:333
250009976,1cyclictest31500-21kworker/3:1+events20:20:193
250009976,1cyclictest31500-21kworker/3:1+events20:15:153
250009976,1cyclictest31500-21kworker/3:1+events19:55:253
250009976,1cyclictest31500-21kworker/3:1+events19:13:423
249919977,0cyclictest716-21snmpd23:38:511
249919977,0cyclictest716-21snmpd00:28:171
249919977,0cyclictest331-21hwrng19:19:201
249919977,0cyclictest331-21hwrng00:10:091
249919976,1cyclictest716-21snmpd23:53:421
249919976,1cyclictest716-21snmpd23:08:501
249919976,1cyclictest29528-21cat20:40:151
249869977,0cyclictest716-21snmpd22:48:140
249869977,0cyclictest716-21snmpd21:22:200
249869977,0cyclictest716-21snmpd00:26:440
249869977,0cyclictest716-21snmpd00:06:380
249869977,0cyclictest331-21hwrng23:47:370
249869977,0cyclictest331-21hwrng23:17:560
249869977,0cyclictest331-21hwrng22:57:270
249869977,0cyclictest331-21hwrng21:06:520
249869977,0cyclictest331-21hwrng21:00:430
249869977,0cyclictest331-21hwrng20:56:370
249869977,0cyclictest331-21hwrng20:53:330
249869977,0cyclictest331-21hwrng20:32:030
249869977,0cyclictest331-21hwrng19:38:480
249869977,0cyclictest331-21hwrng19:20:220
249869977,0cyclictest331-21hwrng00:17:190
249869976,1cyclictest716-21snmpd23:50:400
249869976,1cyclictest716-21snmpd23:11:080
249869976,1cyclictest21261-21cat21:50:140
250009966,0cyclictest31500-21kworker/3:1+events21:05:133
250009965,1cyclictest31500-21kworker/3:1+events20:25:113
250009965,1cyclictest31500-21kworker/3:1+events19:50:153
250009965,1cyclictest31500-21kworker/3:1+events19:45:193
250009965,1cyclictest31500-21kworker/3:1+events19:20:173
249919966,0cyclictest716-21snmpd23:40:031
249919966,0cyclictest716-21snmpd22:35:131
249919966,0cyclictest716-21snmpd22:28:051
249919966,0cyclictest716-21snmpd21:57:481
249919966,0cyclictest716-21snmpd20:21:031
249919966,0cyclictest716-21snmpd20:11:001
249919966,0cyclictest716-21snmpd19:29:461
249919966,0cyclictest716-21snmpd00:32:551
249919966,0cyclictest331-21hwrng19:40:511
249919965,1cyclictest716-21snmpd23:55:031
249919965,1cyclictest716-21snmpd22:48:161
249919965,1cyclictest716-21snmpd22:32:191
249919965,1cyclictest716-21snmpd22:10:331
249919965,1cyclictest716-21snmpd22:07:541
249919965,1cyclictest716-21snmpd20:39:031
249919965,1cyclictest716-21snmpd20:30:511
249919965,1cyclictest716-21snmpd19:53:471
249919965,1cyclictest716-21snmpd19:12:131
249919965,1cyclictest716-21snmpd00:16:311
249869966,0cyclictest716-21snmpd23:07:350
249869966,0cyclictest716-21snmpd19:46:020
249869966,0cyclictest716-21snmpd00:00:270
249869966,0cyclictest331-21hwrng20:20:470
249869966,0cyclictest331-21hwrng20:15:400
249869966,0cyclictest331-21hwrng19:40:510
249869966,0cyclictest331-21hwrng19:15:150
250009955,0cyclictest31500-21kworker/3:1+events19:35:113
249919955,0cyclictest716-21snmpd20:00:171
249919955,0cyclictest716-21snmpd00:00:331
249919955,0cyclictest19659-21turbostat23:49:551
249919954,1cyclictest716-21snmpd22:52:581
249919954,1cyclictest716-21snmpd22:43:521
249919953,2cyclictest9413-21ntpq21:10:171
249869954,1cyclictest716-21snmpd00:30:400
249919944,0cyclictest716-21snmpd19:20:551
249919944,0cyclictest331-21hwrng22:57:271
249919944,0cyclictest331-21hwrng22:21:371
249919944,0cyclictest331-21hwrng21:22:131
249919944,0cyclictest331-21hwrng20:59:411
249919943,1cyclictest716-21snmpd23:13:321
249919943,1cyclictest716-21snmpd21:06:101
249919943,1cyclictest716-21snmpd00:22:161
249919943,1cyclictest3508-21fschecks_count23:30:151
249919943,1cyclictest271ktimers/121:34:161
249919942,2cyclictest5877-21ssh21:35:551
249919942,2cyclictest28368-21ssh21:27:291
249919942,2cyclictest25514-21ssh23:20:241
249919942,2cyclictest21723-21ntpq21:50:211
249919942,2cyclictest16923-21fw_conntrack22:15:111
249919942,2cyclictest10591-21strings00:05:181
249869944,0cyclictest331-21hwrng22:35:570
249869943,1cyclictest716-21snmpd22:09:270
249869942,2cyclictest4439-21cat21:35:140
249869942,2cyclictest3428-21sh22:02:520
249919933,0cyclictest331-21hwrng21:01:441
249919933,0cyclictest331-21hwrng20:45:211
249919933,0cyclictest331-21hwrng19:31:381
249919932,1cyclictest7706-21ntpq19:45:171
249919932,1cyclictest3466-21cat19:35:151
249919932,1cyclictest32619-21ssh23:27:171
249919932,1cyclictest18958-21diskstats20:15:131
249919931,2cyclictest32382-21awk22:00:101
249919931,2cyclictest22850-21cut20:25:101
249919931,2cyclictest14016-21ssh21:15:011
249919930,3cyclictest0-21swapper/121:40:011
249919930,3cyclictest0-21swapper/120:06:371
249869932,1cyclictest151ktimers/023:40:190
249869932,1cyclictest151ktimers/021:55:010
249869932,1cyclictest0-21swapper/023:00:130
249869932,1cyclictest0-21swapper/023:00:120
249869932,1cyclictest0-21swapper/000:10:140
249919920,2cyclictest8338-21munin-node20:50:101
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional