You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-04-02 - 04:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Wed Apr 02, 2025 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2277991100,7rtkit-daemon0-21swapper/120:05:261
817099944,33cyclictest0-21swapper/120:45:431
8170999438,11cyclictest14614-21cpuspeed_turbos21:30:311
8170999334,10cyclictest19061-21needreboot20:15:421
817099924,26cyclictest31966-21awk22:15:141
817099918,24cyclictest0-21swapper/118:05:241
227799880,4rtkit-daemon2276-21rtkit-daemon18:11:000
227799880,4rtkit-daemon2276-21rtkit-daemon18:11:000
817599845,10cyclictest1263-21runrttasks19:10:553
817599844,12cyclictest0-21swapper/318:00:453
817599834,14cyclictest0-21swapper/317:30:263
817599834,14cyclictest0-21swapper/317:30:263
817599825,61cyclictest0-21swapper/317:30:373
817599825,54cyclictest0-21swapper/321:25:363
817599825,11cyclictest0-21swapper/320:20:133
817399823,73cyclictest0-21swapper/220:25:462
817399823,73cyclictest0-21swapper/220:25:462
227799820,4rtkit-daemon2276-21rtkit-daemon22:23:580
817599815,14cyclictest0-21swapper/318:45:343
817599814,12cyclictest32401-21head18:15:383
817599814,12cyclictest31807-21runrttasks18:12:533
817599814,12cyclictest31807-21runrttasks18:12:533
8175998113,7cyclictest7150irq/45-ahci21:05:173
227799810,6rtkit-daemon2276-21rtkit-daemon18:51:361
227799810,6rtkit-daemon2276-21rtkit-daemon17:50:391
227799810,5rtkit-daemon2276-21rtkit-daemon19:45:421
227799810,4rtkit-daemon2276-21rtkit-daemon22:11:510
817599803,11cyclictest6649-21runrttasks21:10:303
817599803,11cyclictest6649-21runrttasks21:10:303
227799800,6rtkit-daemon2276-21rtkit-daemon22:48:351
227799800,6rtkit-daemon2276-21rtkit-daemon22:18:281
227799800,5rtkit-daemon2276-21rtkit-daemon22:35:281
227799800,5rtkit-daemon2276-21rtkit-daemon22:35:281
227799800,5rtkit-daemon2276-21rtkit-daemon19:36:421
227799800,5rtkit-daemon2276-21rtkit-daemon19:24:421
227799800,5rtkit-daemon2276-21rtkit-daemon19:05:430
227799800,5rtkit-daemon2276-21rtkit-daemon18:49:441
227799800,5rtkit-daemon2276-21rtkit-daemon18:30:371
227799800,5rtkit-daemon2276-21rtkit-daemon18:25:371
227799800,4rtkit-daemon2276-21rtkit-daemon22:30:431
227799800,4rtkit-daemon2276-21rtkit-daemon21:05:390
817599795,12cyclictest0-21swapper/318:43:283
817599794,12cyclictest0-21swapper/322:45:133
817599794,12cyclictest0-21swapper/322:45:133
817599794,10cyclictest24181-21crond21:55:153
817599794,10cyclictest24181-21crond21:55:153
8175997923,48cyclictest21108-21gltestperf19:05:483
817399793,8cyclictest15831-21timerandwakeup21:30:492
817399793,70cyclictest0-21swapper/219:45:482
227799790,6rtkit-daemon2276-21rtkit-daemon22:28:051
227799790,6rtkit-daemon2276-21rtkit-daemon21:53:521
227799790,6rtkit-daemon2276-21rtkit-daemon21:53:521
227799790,6rtkit-daemon2276-21rtkit-daemon19:59:191
227799790,6rtkit-daemon2276-21rtkit-daemon18:13:381
227799790,6rtkit-daemon2276-21rtkit-daemon18:13:381
227799790,6rtkit-daemon2276-21rtkit-daemon18:00:011
227799790,5rtkit-daemon2276-21rtkit-daemon22:44:351
227799790,5rtkit-daemon2276-21rtkit-daemon22:44:351
227799790,5rtkit-daemon2276-21rtkit-daemon21:07:381
227799790,5rtkit-daemon2276-21rtkit-daemon20:01:341
227799790,5rtkit-daemon2276-21rtkit-daemon19:40:271
227799790,5rtkit-daemon2276-21rtkit-daemon19:29:051
227799790,5rtkit-daemon2276-21rtkit-daemon19:15:051
227799790,5rtkit-daemon2276-21rtkit-daemon18:50:360
227799790,5rtkit-daemon2276-21rtkit-daemon18:16:531
227799790,4rtkit-daemon2276-21rtkit-daemon22:03:291
227799790,4rtkit-daemon2276-21rtkit-daemon21:48:371
227799790,4rtkit-daemon2276-21rtkit-daemon21:20:531
227799790,4rtkit-daemon2276-21rtkit-daemon20:39:550
227799790,4rtkit-daemon2276-21rtkit-daemon19:45:340
227799790,4rtkit-daemon2276-21rtkit-daemon19:17:350
817599785,12cyclictest0-21swapper/320:40:183
817399783,9cyclictest32664-21df_abs19:30:362
227799780,6rtkit-daemon2276-21rtkit-daemon20:44:321
227799780,6rtkit-daemon2276-21rtkit-daemon19:19:131
227799780,6rtkit-daemon2276-21rtkit-daemon18:21:071
227799780,5rtkit-daemon2276-21rtkit-daemon20:39:471
227799780,5rtkit-daemon2276-21rtkit-daemon19:51:411
227799780,5rtkit-daemon2276-21rtkit-daemon19:33:271
227799780,5rtkit-daemon2276-21rtkit-daemon18:45:370
227799780,5rtkit-daemon2276-21rtkit-daemon18:40:371
227799780,5rtkit-daemon2276-21rtkit-daemon17:48:011
227799780,5rtkit-daemon2276-21rtkit-daemon17:40:321
227799780,4rtkit-daemon2276-21rtkit-daemon22:53:121
227799780,4rtkit-daemon2276-21rtkit-daemon21:44:521
227799780,4rtkit-daemon2276-21rtkit-daemon20:51:171
227799780,4rtkit-daemon2276-21rtkit-daemon19:20:580
227799780,4rtkit-daemon2276-21rtkit-daemon18:58:211
227799780,4rtkit-daemon2276-21rtkit-daemon18:58:211
817599775,50cyclictest0-21swapper/320:55:303
817599774,15cyclictest0-21swapper/322:30:303
817599774,12cyclictest0-21swapper/322:10:293
817599774,12cyclictest0-21swapper/318:35:533
817599774,10cyclictest27470-21chrt18:05:343
8175997717,55cyclictest20302-21fschecks_count21:45:293
8175997714,54cyclictest23589-21cpuspeed_turbos20:30:323
8175997710,59cyclictest0-21swapper/321:05:393
8173997710,59cyclictest0-21swapper/218:35:572
227799770,6rtkit-daemon2276-21rtkit-daemon21:03:541
227799770,6rtkit-daemon2276-21rtkit-daemon18:35:371
227799770,5rtkit-daemon2276-21rtkit-daemon20:21:251
227799770,5rtkit-daemon2276-21rtkit-daemon20:21:251
227799770,5rtkit-daemon2276-21rtkit-daemon20:12:261
227799770,5rtkit-daemon2276-21rtkit-daemon19:04:211
227799770,5rtkit-daemon2276-21rtkit-daemon18:05:530
227799770,4rtkit-daemon2276-21rtkit-daemon22:53:420
227799770,4rtkit-daemon2276-21rtkit-daemon22:06:511
227799770,4rtkit-daemon2276-21rtkit-daemon21:11:461
227799770,4rtkit-daemon2276-21rtkit-daemon21:11:461
227799770,4rtkit-daemon2276-21rtkit-daemon20:31:101
227799770,4rtkit-daemon2276-21rtkit-daemon20:26:251
227799770,4rtkit-daemon2276-21rtkit-daemon20:26:251
227799770,4rtkit-daemon2276-21rtkit-daemon18:05:311
817599764,65cyclictest0-21swapper/319:25:353
817599764,12cyclictest0-21swapper/317:45:493
817599764,10cyclictest27217-21munin-run19:20:203
817599764,10cyclictest15706-21head17:40:383
817599763,65cyclictest14718-21cat20:05:473
817599763,64cyclictest752-21sshd22:15:373
817599763,12cyclictest0-21swapper/319:00:503
8175997618,50cyclictest25625-21grep21:55:383
817399764,8cyclictest1138-21snmpd21:54:212
817399764,8cyclictest1138-21snmpd21:54:212
817399763,9cyclictest26432-21grep18:00:522
817399763,67cyclictest0-21swapper/221:30:162
8173997611,42cyclictest30787-21awk20:50:172
227799760,4rtkit-daemon2276-21rtkit-daemon21:39:520
227799760,4rtkit-daemon2276-21rtkit-daemon21:27:301
227799760,4rtkit-daemon2276-21rtkit-daemon20:57:461
227799760,4rtkit-daemon2276-21rtkit-daemon19:10:211
817599757,59cyclictest0-21swapper/319:20:553
817599754,14cyclictest0-21swapper/322:25:423
817599753,12cyclictest0-21swapper/319:34:143
8175997527,40cyclictest3069-21fschecks_time19:35:403
8175997526,42cyclictest16670-21needreboot20:10:463
8175997525,44cyclictest1263-21runrttasks22:45:163
8175997522,46cyclictest0-21swapper/321:20:173
8175997517,49cyclictest23582-21gltestperf17:55:453
817399753,8cyclictest1263-21runrttasks18:40:322
817399753,66cyclictest0-21swapper/221:22:182
227799750,4rtkit-daemon2276-21rtkit-daemon22:21:131
817599743,13cyclictest0-21swapper/320:20:433
817599743,13cyclictest0-21swapper/320:20:433
817599743,10cyclictest17401-21taskset18:57:093
817599743,10cyclictest17401-21taskset18:57:093
8175997423,44cyclictest1263-21runrttasks22:39:533
8175997423,44cyclictest1263-21runrttasks22:39:533
8175997412,55cyclictest14784-21unixbench-2d18:50:553
817399747,59cyclictest0-21swapper/219:10:482
817399743,8cyclictest20035-21latency_hist19:05:232
817399743,8cyclictest15266-21latency_hist18:55:232
817399742,64cyclictest130781munin-node22:50:412
817599735,60cyclictest0-21swapper/320:44:403
817599735,13cyclictest0-21swapper/320:25:273
817599735,13cyclictest0-21swapper/320:25:273
817599734,63cyclictest0-21swapper/320:00:203
8175997330,34cyclictest15058-21fschecks_time21:30:363
8175997322,46cyclictest0-21swapper/321:45:163
8175997320,46cyclictest17526-21gltestperf21:35:383
8175997315,52cyclictest4244-21ntp_states18:25:483
817399735,60cyclictest26055-21nscd17:25:252
817399733,8cyclictest16820-21open_inodes18:55:512
817399733,8cyclictest16820-21open_inodes18:55:512
817399733,7cyclictest25856-21gltestperf19:15:412
8173997311,42cyclictest20279-21munin-node19:06:012
817599727,55cyclictest0-21swapper/322:05:153
817599726,58cyclictest0-21swapper/320:50:293
8175997222,43cyclictest1263-21runrttasks20:02:383
8175997220,45cyclictest7079-21unixbench_singl19:45:543
8175997220,44cyclictest21411-21latency17:50:493
8175997215,49cyclictest6550-21needreboot18:30:503
8175997214,50cyclictest1263-21runrttasks20:46:313
8175997210,53cyclictest0-21swapper/322:05:433
817399724,45cyclictest0-21swapper/220:31:392
817399723,62cyclictest28824-21find22:05:392
817399722,60cyclictest27601-21telnet19:20:352
8173997214,52cyclictest24851-21latency_hist18:00:252
227799720,5rtkit-daemon2276-21rtkit-daemon21:00:540
817599714,12cyclictest14186-21runrttasks17:35:493
817599714,12cyclictest0-21swapper/322:50:483
817599713,13cyclictest0-21swapper/318:21:393
8175997122,41cyclictest11475-21chrt21:23:033
817399714,62cyclictest0-21swapper/221:15:372
8173997132,32cyclictest3618-21tune2fs22:25:282
817399713,7cyclictest710-21munin-run20:55:172
817399713,7cyclictest6253-21latency_hist21:10:172
817399713,62cyclictest0-21swapper/217:35:152
817399713,60cyclictest1138-21snmpd20:17:272
227799710,4rtkit-daemon2276-21rtkit-daemon20:14:260
817399704,9cyclictest0-21swapper/218:25:332
817399704,58cyclictest0-21swapper/221:49:322
817399704,43cyclictest0-21swapper/218:15:472
817399703,60cyclictest0-21swapper/217:40:512
817399703,51cyclictest0-21swapper/222:35:252
817399703,51cyclictest0-21swapper/222:35:252
8173997013,50cyclictest0-21swapper/219:35:372
817599695,11cyclictest7741-21aten_r1power_en19:50:323
817599694,57cyclictest0-21swapper/319:45:213
817599694,12cyclictest0-21swapper/322:24:303
817399699,51cyclictest0-21swapper/219:42:202
817399694,59cyclictest0-21swapper/217:25:492
817399694,59cyclictest0-21swapper/217:25:492
817399694,58cyclictest0-21swapper/222:03:252
8173996930,33cyclictest30977-21missed_timers19:25:482
817399693,9cyclictest30058-21cpuspeed22:10:292
817399693,8cyclictest6434-21chrt18:30:482
817399693,7cyclictest15233-21latency_hist20:10:192
817399693,60cyclictest0-21swapper/222:15:312
817399693,58cyclictest1263-21runrttasks20:55:422
817399693,12cyclictest0-21swapper/217:50:362
817399692,8cyclictest10892-21runrttasks18:45:312
8173996912,47cyclictest20622-21crond20:25:182
8173996912,47cyclictest20622-21crond20:25:182
8173996910,42cyclictest12241-21latency_hist20:00:202
817399687,54cyclictest0-21swapper/220:12:352
817399685,56cyclictest0-21swapper/222:45:422
817399684,58cyclictest0-21swapper/221:01:402
817399684,58cyclictest0-21swapper/220:36:282
817399683,59cyclictest0-21swapper/222:30:492
817399683,58cyclictest0-21swapper/217:36:162
817399683,57cyclictest0-21swapper/221:42:462
8173996811,51cyclictest30566-21fschecks_time18:10:432
8173996811,51cyclictest30566-21fschecks_time18:10:432
227799680,4rtkit-daemon2276-21rtkit-daemon20:08:410
817399678,52cyclictest0-21swapper/218:24:502
817399674,56cyclictest0-21swapper/222:20:392
817399673,58cyclictest0-21swapper/219:50:512
817399673,58cyclictest0-21swapper/217:45:412
817399673,57cyclictest0-21swapper/221:10:422
817399673,57cyclictest0-21swapper/221:10:422
817399672,9cyclictest0-21swapper/221:55:262
817399668,49cyclictest0-21swapper/221:35:382
817399664,56cyclictest0-21swapper/222:44:322
817399664,56cyclictest0-21swapper/222:44:322
817399664,10cyclictest0-21swapper/220:05:142
817399663,10cyclictest0-21swapper/218:05:432
227799660,5rtkit-daemon2276-21rtkit-daemon22:39:500
227799660,5rtkit-daemon2276-21rtkit-daemon22:39:500
227799660,5rtkit-daemon2276-21rtkit-daemon21:45:220
227799660,5rtkit-daemon2276-21rtkit-daemon21:30:450
817599658,51cyclictest0-21swapper/317:25:263
817399653,55cyclictest0-21swapper/220:41:402
227799650,5rtkit-daemon2276-21rtkit-daemon18:21:370
227799650,5rtkit-daemon2276-21rtkit-daemon18:15:380
227799630,5rtkit-daemon32025-21iostat_ios20:50:390
227799630,5rtkit-daemon2276-21rtkit-daemon22:45:270
227799630,5rtkit-daemon2276-21rtkit-daemon20:25:330
227799630,5rtkit-daemon2276-21rtkit-daemon20:25:330
227799630,4rtkit-daemon2276-21rtkit-daemon20:55:390
227799620,4rtkit-daemon2276-21rtkit-daemon21:36:451
227799620,4rtkit-daemon2276-21rtkit-daemon17:41:020
227799610,5rtkit-daemon2276-21rtkit-daemon21:12:380
227799610,5rtkit-daemon2276-21rtkit-daemon21:12:380
227799600,5rtkit-daemon2276-21rtkit-daemon20:30:400
227799600,5rtkit-daemon2276-21rtkit-daemon18:27:300
227799590,9rtkit-daemon0-21swapper/121:55:290
8167995838,11cyclictest20622-21crond20:25:180
8167995838,11cyclictest20622-21crond20:25:180
227799580,4rtkit-daemon9120-21processes18:35:520
227799580,4rtkit-daemon10416-21cpuspeed_turbos19:55:340
817099574,46cyclictest0-21swapper/121:15:501
227799570,7rtkit-daemon0-21swapper/119:39:570
227799570,7rtkit-daemon0-21swapper/118:00:530
227799570,4rtkit-daemon23659-21interrupts19:10:430
227799560,5rtkit-daemon2276-21rtkit-daemon20:48:240
227799550,7rtkit-daemon0-21swapper/118:55:440
227799550,7rtkit-daemon0-21swapper/118:55:440
227799550,5rtkit-daemon2276-21rtkit-daemon22:19:280
227799550,5rtkit-daemon2276-21rtkit-daemon21:18:010
227799550,5rtkit-daemon2276-21rtkit-daemon19:34:120
227799550,4rtkit-daemon2276-21rtkit-daemon22:25:350
227799550,4rtkit-daemon2276-21rtkit-daemon19:50:410
227799550,4rtkit-daemon12601-21perl21:25:300
227799540,5rtkit-daemon2276-21rtkit-daemon20:02:260
227799540,4rtkit-daemon2276-21rtkit-daemon21:21:380
227799540,4rtkit-daemon2276-21rtkit-daemon17:51:390
816799536,40cyclictest0-21swapper/018:41:560
77732534,6sleep00-21swapper/017:20:560
227799530,4rtkit-daemon2276-21rtkit-daemon22:30:580
227799530,4rtkit-daemon2276-21rtkit-daemon22:08:140
227799530,4rtkit-daemon2276-21rtkit-daemon21:50:590
227799530,4rtkit-daemon2276-21rtkit-daemon21:50:590
227799530,4rtkit-daemon2276-21rtkit-daemon21:42:370
227799530,4rtkit-daemon2276-21rtkit-daemon20:41:470
227799530,4rtkit-daemon2276-21rtkit-daemon18:32:370
227799530,4rtkit-daemon2276-21rtkit-daemon17:46:310
103692536,40sleep10-21swapper/117:28:171
103692536,40sleep10-21swapper/117:28:171
817099525,28cyclictest0-21swapper/117:35:561
227799520,5rtkit-daemon2276-21rtkit-daemon17:56:010
227799520,4rtkit-daemon2276-21rtkit-daemon20:17:180
127382513,10sleep00-21swapper/017:33:040
227799500,5rtkit-daemon2276-21rtkit-daemon22:42:200
227799500,5rtkit-daemon2276-21rtkit-daemon22:42:200
227799500,5rtkit-daemon2276-21rtkit-daemon19:25:420
178842503,10sleep00-21swapper/019:00:330
817099483,27cyclictest0-21swapper/117:30:451
8170994818,12cyclictest0-21swapper/121:55:451
816799485,25cyclictest0-21swapper/017:40:020
816799474,26cyclictest0-21swapper/022:05:150
104252463,9sleep00-21swapper/017:29:010
104252463,9sleep00-21swapper/017:29:010
227799430,5rtkit-daemon2276-21rtkit-daemon19:40:420
817099394,30cyclictest0-21swapper/117:25:261
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional