You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-27 - 14:23

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #0, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot1s.osadl.org (updated Sat Jul 27, 2024 12:45:38)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1195099125124,0cyclictest29-21ksoftirqd/210:20:422
1198299119117,1cyclictest0-21swapper/707:39:537
1193699118118,0cyclictest3-21ksoftirqd/007:33:260
1193699115115,0cyclictest3-21ksoftirqd/012:05:460
1196399109108,1cyclictest0-21swapper/407:40:434
1195099109107,1cyclictest29-21ksoftirqd/209:24:442
11936998079,0cyclictest3-21ksoftirqd/009:16:500
11975994846,1cyclictest0-21swapper/610:20:426
11982994644,1cyclictest0-21swapper/708:48:307
11936994545,0cyclictest350ksoftirqd/011:12:490
11963994140,1cyclictest0-21swapper/407:33:264
11963993837,1cyclictest0-21swapper/412:05:464
1051323514,17sleep20-21swapper/207:05:152
1039623514,17sleep10-21swapper/107:05:131
11950993434,0cyclictest29-21ksoftirqd/207:13:532
1156823412,18sleep30-21swapper/307:07:333
1152923414,17sleep00-21swapper/007:06:580
961423311,18sleep70-21swapper/707:05:047
1142123110,18sleep50-21swapper/507:05:255
11975993029,1cyclictest0-21swapper/609:24:446
108632309,17sleep60-21swapper/607:05:196
962022513,8sleep40-21swapper/407:05:094
1194199210,20cyclictest0-21swapper/108:15:291
1197099180,2cyclictest0-21swapper/508:01:095
1197099170,16cyclictest0-21swapper/507:30:285
1198299160,1cyclictest0-21swapper/708:00:327
1198299160,13cyclictest0-21swapper/707:41:477
11936991614,1cyclictest7690-21sh12:35:550
1198299150,14cyclictest0-21swapper/710:28:027
1198299150,12cyclictest0-21swapper/708:43:187
11975991511,3cyclictest0-21swapper/610:25:486
11970991512,2cyclictest0-21swapper/511:46:035
1197099150,14cyclictest0-21swapper/512:26:485
1197099150,14cyclictest0-21swapper/511:55:035
1197099150,12cyclictest0-21swapper/512:20:035
1195799150,14cyclictest0-21swapper/311:05:153
1198299140,2cyclictest0-21swapper/709:05:327
11970991410,3cyclictest0-21swapper/507:46:325
11963991410,3cyclictest0-21swapper/411:45:184
1198299138,4cyclictest0-21swapper/710:44:027
11982991310,2cyclictest0-21swapper/711:28:037
11982991310,2cyclictest0-21swapper/710:20:477
11975991310,2cyclictest0-21swapper/608:22:176
11970991312,1cyclictest0-21swapper/509:41:175
11970991312,1cyclictest0-21swapper/508:53:175
11963991310,3cyclictest0-21swapper/408:56:474
1194199130,12cyclictest0-21swapper/111:20:221
1193699137,3cyclictest0-21swapper/010:25:000
1193699133,7cyclictest0-21swapper/008:09:470
11936991310,1cyclictest17633-21ssh09:46:450
11936991310,1cyclictest17633-21ssh09:46:450
11970991210,2cyclictest0-21swapper/507:53:475
11950991212,0cyclictest30554-21snmpd08:45:172
11950991211,1cyclictest30554-21snmpd10:11:182
1193699121,8cyclictest0-21swapper/011:15:470
1193699121,8cyclictest0-21swapper/010:30:000
11936991210,1cyclictest0-21swapper/011:05:000
1193699120,9cyclictest0-21swapper/012:24:590
1193699120,9cyclictest0-21swapper/010:50:000
1198299119,2cyclictest0-21swapper/708:18:477
1198299118,2cyclictest0-21swapper/708:30:187
11982991110,1cyclictest0-21swapper/710:19:177
1198299110,10cyclictest0-21swapper/707:55:027
1197599119,2cyclictest0-21swapper/609:47:036
1197599119,2cyclictest0-21swapper/609:47:036
1197099119,2cyclictest0-21swapper/510:14:175
1197099118,2cyclictest0-21swapper/512:31:105
11970991110,1cyclictest0-21swapper/507:22:175
1197099110,10cyclictest0-21swapper/510:48:295
11957991111,0cyclictest37-21ksoftirqd/307:39:533
11957991110,1cyclictest30554-21snmpd12:17:483
1194199119,1cyclictest0-21swapper/111:29:021
1194199114,6cyclictest8374-21rm12:37:001
1194199111,9cyclictest0-21swapper/111:44:591
1194199111,8cyclictest0-21swapper/109:45:001
1194199110,1cyclictest30318-21ssh10:28:521
1194199110,1cyclictest10169-21grep10:40:091
1194199110,10cyclictest22434-21ssh09:50:461
1194199110,10cyclictest17262-21ssh09:16:511
1193699118,2cyclictest0-21swapper/008:45:000
1193699112,8cyclictest0-21swapper/012:28:200
1193699111,9cyclictest0-21swapper/011:29:590
1193699111,9cyclictest0-21swapper/007:40:000
1193699111,7cyclictest11-21rcuc/012:19:590
1193699110,9cyclictest0-21swapper/009:59:060
1193699110,8cyclictest0-21swapper/009:52:370
1193699110,8cyclictest0-21swapper/008:25:180
1198299107,2cyclictest0-21swapper/711:46:337
1197599109,1cyclictest0-21swapper/607:22:326
1197599107,3cyclictest0-21swapper/608:19:326
1196399107,2cyclictest0-21swapper/410:25:174
1195799101,8cyclictest0-21swapper/309:35:453
1195099101,8cyclictest0-21swapper/208:20:202
1194199104,5cyclictest23517-21cpu08:35:121
1194199103,6cyclictest30554-21snmpd12:15:031
1194199103,6cyclictest11794-21sh10:10:311
1194199102,7cyclictest31485-21expr10:00:121
1194199102,7cyclictest11425-21fschecks_count08:10:161
1194199101,8cyclictest30554-21snmpd12:01:481
1194199101,8cyclictest1713650irq/39-eth010:55:071
1194199101,8cyclictest0-21swapper/111:55:161
1194199101,8cyclictest0-21swapper/110:45:251
1194199101,8cyclictest0-21swapper/110:30:181
1194199101,8cyclictest0-21swapper/109:45:501
1194199101,8cyclictest0-21swapper/109:45:501
1194199101,8cyclictest0-21swapper/109:15:001
1194199101,8cyclictest0-21swapper/109:10:001
1194199101,8cyclictest0-21swapper/107:55:161
1194199101,8cyclictest0-21swapper/107:45:141
1194199101,8cyclictest0-21swapper/107:35:111
1194199101,7cyclictest20130-21latency_hist07:25:001
11941991010,0cyclictest21-21ksoftirqd/110:20:371
1194199100,9cyclictest8350-21ssh09:39:131
1194199100,9cyclictest28987-21irqstats07:40:141
1194199100,9cyclictest28043-21cat12:25:191
1194199100,8cyclictest0-21swapper/111:05:161
1194199100,7cyclictest6281-21users10:05:251
1194199100,1cyclictest7498-21rm12:05:461
1194199100,1cyclictest5452-21expr11:35:111
1194199100,1cyclictest3045-21ssh09:34:321
1194199100,1cyclictest23501-21sh10:51:161
1194199100,1cyclictest23349-21expr07:30:101
1194199100,1cyclictest23252-21timerandwakeup12:20:251
1194199100,1cyclictest16567-21ssh11:15:121
1194199100,1cyclictest16434-21df_inode11:45:101
1194199100,1cyclictest0-21swapper/112:30:571
1194199100,1cyclictest0-21swapper/112:10:541
1194199100,1cyclictest0-21swapper/111:52:421
1194199100,1cyclictest0-21swapper/111:30:021
1194199100,1cyclictest0-21swapper/111:14:241
1194199100,1cyclictest0-21swapper/110:35:111
1194199100,1cyclictest0-21swapper/110:15:141
1194199100,1cyclictest0-21swapper/109:56:511
1194199100,1cyclictest0-21swapper/109:25:561
1194199100,1cyclictest0-21swapper/107:10:561
1193699107,2cyclictest0-21swapper/009:35:000
1193699106,1cyclictest22641-21mrtg07:30:000
1193699105,4cyclictest0-21swapper/011:44:540
1193699105,2cyclictest0-21swapper/010:16:490
1193699103,3cyclictest0-21swapper/008:39:150
1193699101,2cyclictest0-21swapper/012:05:000
11936991010,0cyclictest30554-21snmpd11:53:480
1193699100,9cyclictest0-21swapper/011:55:550
1193699100,9cyclictest0-21swapper/009:00:220
1193699100,8cyclictest0-21swapper/012:10:420
1193699100,8cyclictest0-21swapper/011:05:140
1193699100,8cyclictest0-21swapper/010:40:040
1193699100,7cyclictest4686-21mrtg11:34:590
1193699100,7cyclictest24801-21cut09:25:000
1193699100,7cyclictest0-21swapper/009:14:120
1193699100,3cyclictest0-21swapper/011:36:330
1193699100,1cyclictest0-21swapper/010:10:440
29460290,1sleep70-21swapper/711:56:297
12944290,1sleep70-21swapper/709:42:557
119829998,1cyclictest0-21swapper/711:51:177
119829998,1cyclictest0-21swapper/707:21:027
119829997,2cyclictest0-21swapper/712:35:337
119829991,2cyclictest0-21swapper/708:54:177
119759998,0cyclictest30554-21snmpd10:05:186
119759996,2cyclictest0-21swapper/609:36:346
119759990,8cyclictest0-21swapper/611:09:516
119759990,2cyclictest0-21swapper/608:05:176
119759990,2cyclictest0-21swapper/607:36:326
119709996,2cyclictest0-21swapper/510:27:105
119709990,2cyclictest0-21swapper/508:17:475
119639999,0cyclictest819-21cat12:30:174
119639996,2cyclictest0-21swapper/412:04:564
119639993,5cyclictest0-21swapper/411:58:334
119639993,3cyclictest0-21swapper/410:52:174
119639993,2cyclictest0-21swapper/412:13:024
119639991,7cyclictest0-21swapper/411:21:464
119579991,7cyclictest0-21swapper/311:35:143
119579991,7cyclictest0-21swapper/311:00:203
119579991,7cyclictest0-21swapper/309:00:003
119579990,8cyclictest0-21swapper/310:58:223
119509996,2cyclictest0-21swapper/211:16:402
119509991,7cyclictest0-21swapper/208:55:142
119509990,8cyclictest0-21swapper/211:51:542
119509990,8cyclictest0-21swapper/209:18:592
119419992,6cyclictest9045-21fschecks_time08:05:131
119419992,6cyclictest6744-21awk08:00:191
119419992,6cyclictest16616-21grep08:20:121
119419992,6cyclictest0-21swapper/109:20:111
119419990,8cyclictest31530-21diskstats08:50:101
119419990,8cyclictest2861-21crond07:55:001
119419990,8cyclictest18847-21expr08:25:151
119419990,1cyclictest32582-21ssh11:00:131
119419990,1cyclictest26803-21hddtemp_smartct08:40:171
119419990,1cyclictest20979-21diskstats07:25:121
119419990,1cyclictest1737-21fschecks_time08:55:131
119419990,1cyclictest0-21swapper/108:45:221
119419990,1cyclictest0-21swapper/107:15:001
119369998,1cyclictest0-21swapper/010:55:060
119369997,1cyclictest0-21swapper/008:10:270
119369996,1cyclictest0-21swapper/011:24:590
119369996,1cyclictest0-21swapper/010:05:230
119369995,1cyclictest21480-21df_inode10:50:130
119369995,1cyclictest0-21swapper/009:10:000
119369993,4cyclictest0-21swapper/011:45:480
119369993,1cyclictest0-21swapper/012:34:590
119369992,4cyclictest0-21swapper/007:40:270
119369991,7cyclictest0-21swapper/008:21:160
119369991,7cyclictest0-21swapper/007:15:130
119369991,6cyclictest3336-21perf09:00:000
119369990,8cyclictest0-21swapper/010:00:010
119369990,8cyclictest0-21swapper/009:25:010
119369990,8cyclictest0-21swapper/008:30:220
119369990,7cyclictest0-21swapper/010:30:140
119369990,7cyclictest0-21swapper/008:15:200
119369990,7cyclictest0-21swapper/008:04:410
119369990,7cyclictest0-21swapper/007:55:180
119369990,7cyclictest0-21swapper/007:45:270
119369990,7cyclictest0-21swapper/007:20:190
119369990,1cyclictest0-21swapper/009:45:000
119369990,1cyclictest0-21swapper/008:50:000
10324290,2sleep60-21swapper/611:10:086
7036280,1sleep70-21swapper/710:06:347
18779280,1sleep70-21swapper/709:48:327
18779280,1sleep70-21swapper/709:48:327
119829987,1cyclictest0-21swapper/707:14:327
119829985,3cyclictest0-21swapper/711:17:487
119829983,4cyclictest0-21swapper/711:08:487
119829980,7cyclictest0-21swapper/710:52:557
119829980,5cyclictest0-21swapper/709:38:487
119829980,2cyclictest0-21swapper/710:35:087
119829980,2cyclictest0-21swapper/709:31:107
119829980,2cyclictest0-21swapper/709:25:187
119829980,2cyclictest0-21swapper/709:21:037
119829980,1cyclictest0-21swapper/707:16:177
119759987,1cyclictest0-21swapper/610:31:036
119759987,1cyclictest0-21swapper/608:38:026
119759987,1cyclictest0-21swapper/607:54:026
119759987,1cyclictest0-21swapper/607:31:026
119759985,2cyclictest0-21swapper/611:25:036
119759983,4cyclictest0-21swapper/612:32:336
119759983,4cyclictest0-21swapper/611:01:186
119759983,4cyclictest0-21swapper/610:54:336
119759983,4cyclictest0-21swapper/608:14:476
119759982,4cyclictest0-21swapper/610:11:186
119759982,4cyclictest0-21swapper/610:00:176
119759981,6cyclictest0-21swapper/610:45:016
119759980,7cyclictest0-21swapper/609:30:156
119759980,5cyclictest0-21swapper/611:24:336
119759980,5cyclictest0-21swapper/608:55:476
119759980,2cyclictest0-21swapper/611:59:326
119759980,1cyclictest0-21swapper/612:06:486
119709986,2cyclictest0-21swapper/509:16:175
119709982,3cyclictest0-21swapper/509:11:325
119709981,6cyclictest0-21swapper/510:35:145
119709980,7cyclictest0-21swapper/511:40:215
119709980,7cyclictest0-21swapper/510:41:575
119709980,7cyclictest0-21swapper/508:58:325
119709980,5cyclictest0-21swapper/510:20:155
119709980,5cyclictest0-21swapper/509:59:175
119709980,5cyclictest0-21swapper/508:23:325
119709980,5cyclictest0-21swapper/508:09:475
119709980,2cyclictest0-21swapper/510:30:435
119639987,1cyclictest0-21swapper/409:57:474
119639983,4cyclictest0-21swapper/410:20:334
119639983,4cyclictest0-21swapper/410:06:024
119639982,5cyclictest0-21swapper/409:07:024
119639982,3cyclictest0-21swapper/410:33:324
119639981,6cyclictest0-21swapper/412:24:594
119639981,6cyclictest0-21swapper/409:39:194
119639981,6cyclictest0-21swapper/408:35:204
119639980,7cyclictest0-21swapper/411:35:234
119639980,2cyclictest0-21swapper/410:35:174
119639980,1cyclictest0-21swapper/412:27:324
119639980,1cyclictest0-21swapper/409:15:474
119579981,6cyclictest0-21swapper/312:25:143
119579981,6cyclictest0-21swapper/312:05:113
119579981,6cyclictest0-21swapper/311:55:143
119579981,6cyclictest0-21swapper/311:48:523
119579981,6cyclictest0-21swapper/311:15:113
119579981,6cyclictest0-21swapper/311:10:133
119579981,6cyclictest0-21swapper/310:45:033
119579981,6cyclictest0-21swapper/310:30:103
119579981,6cyclictest0-21swapper/310:20:273
119579981,6cyclictest0-21swapper/309:58:113
119579981,6cyclictest0-21swapper/309:50:143
119579981,6cyclictest0-21swapper/309:45:213
119579981,6cyclictest0-21swapper/309:45:213
119579981,6cyclictest0-21swapper/309:25:223
119579981,6cyclictest0-21swapper/309:15:233
119579981,6cyclictest0-21swapper/309:14:163
119579981,6cyclictest0-21swapper/309:00:233
119579981,6cyclictest0-21swapper/308:25:293
119579981,6cyclictest0-21swapper/308:20:233
119579981,6cyclictest0-21swapper/308:10:133
119579981,6cyclictest0-21swapper/307:50:123
119579981,6cyclictest0-21swapper/307:40:123
119579981,6cyclictest0-21swapper/307:30:153
119579981,6cyclictest0-21swapper/307:20:103
119579980,7cyclictest0-21swapper/312:32:323
119579980,7cyclictest0-21swapper/311:26:483
119579980,7cyclictest0-21swapper/310:44:033
119579980,7cyclictest0-21swapper/310:03:493
119579980,2cyclictest0-21swapper/310:05:523
119509983,4cyclictest0-21swapper/211:35:162
119509981,6cyclictest0-21swapper/212:01:402
119509981,6cyclictest0-21swapper/211:45:192
119509981,6cyclictest0-21swapper/211:40:472
119509981,6cyclictest0-21swapper/210:50:182
119509981,6cyclictest0-21swapper/210:05:152
119509981,6cyclictest0-21swapper/209:40:222
119509981,6cyclictest0-21swapper/209:35:222
119509981,6cyclictest0-21swapper/209:30:162
119509981,6cyclictest0-21swapper/208:15:002
119509981,6cyclictest0-21swapper/207:25:002
119509980,7cyclictest0-21swapper/211:05:012
119509980,7cyclictest0-21swapper/210:55:302
119509980,7cyclictest0-21swapper/210:29:412
119509980,7cyclictest0-21swapper/210:03:392
119509980,6cyclictest0-21swapper/211:24:222
119419981,6cyclictest0-21swapper/109:00:121
119419980,1cyclictest0-21swapper/108:30:121
119369981,6cyclictest0-21swapper/009:35:400
119369980,7cyclictest12650irq/19-ata_piix08:50:110
119369980,7cyclictest0-21swapper/007:50:060
119369980,6cyclictest0-21swapper/007:11:070
119369980,1cyclictest0-21swapper/010:35:060
28725270,1sleep60-21swapper/610:55:596
25394270,1sleep70-21swapper/708:36:347
119829975,1cyclictest11232-21ssh12:10:137
119829973,3cyclictest0-21swapper/711:11:187
119829972,4cyclictest0-21swapper/711:33:387
119829970,6cyclictest5282-21munin-node09:00:277
119829970,6cyclictest0-21swapper/712:25:127
119829970,6cyclictest0-21swapper/712:20:147
119829970,6cyclictest0-21swapper/712:15:037
119829970,6cyclictest0-21swapper/712:00:307
119829970,6cyclictest0-21swapper/711:40:147
119829970,6cyclictest0-21swapper/710:45:137
119829970,6cyclictest0-21swapper/710:31:427
119829970,6cyclictest0-21swapper/710:01:167
119829970,6cyclictest0-21swapper/709:16:307
119829970,6cyclictest0-21swapper/709:10:327
119829970,6cyclictest0-21swapper/707:50:147
119829970,6cyclictest0-21swapper/707:33:267
119829970,5cyclictest0-21swapper/711:00:327
119829970,4cyclictest0-21swapper/711:22:487
119829970,4cyclictest0-21swapper/710:58:327
119829970,4cyclictest0-21swapper/709:51:027
119759973,3cyclictest0-21swapper/611:45:146
119759972,4cyclictest0-21swapper/609:02:476
119759972,4cyclictest0-21swapper/607:46:476
119759971,5cyclictest0-21swapper/608:55:006
119759971,3cyclictest0-21swapper/609:05:476
119759970,6cyclictest0-21swapper/612:38:176
119759970,6cyclictest0-21swapper/612:16:176
119759970,6cyclictest0-21swapper/611:54:036
119759970,6cyclictest0-21swapper/611:35:296
119759970,6cyclictest0-21swapper/611:31:056
119759970,6cyclictest0-21swapper/609:50:466
119759970,6cyclictest0-21swapper/608:29:436
119759970,4cyclictest0-21swapper/612:11:186
119759970,4cyclictest0-21swapper/611:41:176
119759970,4cyclictest0-21swapper/609:17:476
119759970,4cyclictest0-21swapper/607:29:176
119759970,1cyclictest0-21swapper/611:19:076
119759970,1cyclictest0-21swapper/610:48:486
119759970,1cyclictest0-21swapper/609:40:336
119759970,1cyclictest0-21swapper/607:57:476
119709976,1cyclictest0-21swapper/511:20:155
119709974,3cyclictest0-21swapper/508:33:025
119709973,3cyclictest0-21swapper/509:45:155
119709973,3cyclictest0-21swapper/509:45:155
119709972,4cyclictest0-21swapper/511:30:165
119709972,4cyclictest0-21swapper/511:03:325
119709972,4cyclictest0-21swapper/510:08:325
119709972,4cyclictest0-21swapper/508:45:025
119709972,4cyclictest0-21swapper/507:35:135
119709971,5cyclictest0-21swapper/512:15:035
119709971,5cyclictest0-21swapper/511:29:595
119709971,4cyclictest0-21swapper/511:10:155
119709970,6cyclictest0-21swapper/512:08:585
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional