You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-11-21 - 21:52

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack7slot7s.osadl.org (updated Thu Nov 21, 2024 12:43:59)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
32221210490,10sleep10-21swapper/107:09:001
31977210390,8sleep30-21swapper/307:05:493
3229128667,15sleep20-21swapper/207:09:532
3216828270,8sleep00-21swapper/007:08:190
3238499290,24cyclictest0-21swapper/009:19:040
3239199260,2cyclictest0-21swapper/211:25:202
3238499260,12cyclictest0-21swapper/010:15:170
3239499240,23cyclictest0-21swapper/309:20:143
3239199240,4cyclictest0-21swapper/211:55:282
3239199240,4cyclictest0-21swapper/211:55:272
3239499230,22cyclictest0-21swapper/312:20:323
3239199230,22cyclictest2697-21grep12:25:182
3239499226,6cyclictest20033-21awk08:59:593
326982210,0sleep00-21swapper/011:38:570
32391992120,1cyclictest0-21swapper/209:42:152
3239499202,2cyclictest0-21swapper/308:25:133
3238499207,7cyclictest19088-21munin-run07:49:590
3238499200,16cyclictest0-21swapper/010:08:490
3239199192,6cyclictest19308-21apt-get09:35:142
32384991918,1cyclictest0-21swapper/010:24:430
3238499190,8cyclictest0-21swapper/011:52:330
32394991810,2cyclictest2179-21wc08:20:233
32391991812,6cyclictest37850irq/131-snd_hda11:40:142
3239199180,18cyclictest0-21swapper/211:02:552
3238499182,5cyclictest13-21ksoftirqd/011:00:000
3238499180,17cyclictest0-21swapper/009:00:130
3239499179,2cyclictest16205-21grep07:40:263
3239499178,2cyclictest30561-21ssh09:45:133
3239199171,7cyclictest32232-21kworker/2:007:10:132
3239199170,16cyclictest24957-21sshd09:09:362
32389991714,3cyclictest25-21ksoftirqd/109:44:161
32384991710,2cyclictest24993-21cron09:10:000
3239499168,2cyclictest26210-21cat12:39:593
3239499167,2cyclictest31493-21tr08:15:173
3239199160,0cyclictest0-21swapper/210:15:512
3238999160,1cyclictest0-21swapper/110:49:171
3239499158,2cyclictest9812-21touch12:30:013
3239499158,2cyclictest5794-21grep10:50:263
3239499156,2cyclictest13049-21wc08:45:013
3239499150,13cyclictest0-21swapper/311:19:243
3239199151,1cyclictest8266-21apache_accesses10:25:112
32391991510,4cyclictest3437-21ssh09:50:002
3239199150,0cyclictest0-21swapper/212:23:432
3239199150,0cyclictest0-21swapper/208:13:432
3238999155,8cyclictest19263-21/usr/sbin/munin09:35:231
32389991515,0cyclictest0-21swapper/112:25:081
3238999150,1cyclictest0-21swapper/110:53:301
3238999150,15cyclictest0-21swapper/111:23:151
125902150,1sleep30-21swapper/312:10:273
32394991410,3cyclictest17153-21grep11:00:213
3239199141,13cyclictest37850irq/131-snd_hda10:20:572
32391991411,2cyclictest30282-21wc12:00:212
32391991411,2cyclictest21718-21cron11:55:002
32391991411,2cyclictest0-21swapper/210:37:552
32391991410,3cyclictest32503-21wc08:15:242
32391991410,3cyclictest19320-21head12:15:202
32391991410,3cyclictest15975-21cut10:00:252
32391991410,3cyclictest15975-21cut10:00:242
3239199140,1cyclictest0-21swapper/212:39:382
3239199140,1cyclictest0-21swapper/209:12:082
3239199140,14cyclictest0-21swapper/211:35:432
32389991410,2cyclictest16176-21head11:25:161
3238499144,9cyclictest15291-21awk08:50:000
32384991410,3cyclictest1998-21munin-plugin-st11:15:000
32384991410,2cyclictest24344-21grep08:00:190
3239499139,3cyclictest21632-21cat07:55:003
3239499139,3cyclictest14526-21head10:30:153
3239499139,2cyclictest22362-21grep11:30:193
32394991313,0cyclictest0-21swapper/311:35:543
32394991310,2cyclictest29149-21tr08:10:153
32394991310,2cyclictest19265-21sort12:15:193
32394991310,2cyclictest15519-21cat10:59:593
3239499130,1cyclictest0-21swapper/310:02:373
3239499130,1cyclictest0-21swapper/310:02:363
3239499130,12cyclictest0-21swapper/311:41:333
3239199139,3cyclictest11942-21grep07:35:002
3239199139,3cyclictest10412-21grep10:55:172
3239199132,1cyclictest15241-21ssh12:32:492
32391991310,2cyclictest3378-21idleruntime-cro08:25:002
32391991310,2cyclictest32169-21tune2fs09:15:202
32391991310,2cyclictest27679-21ls08:05:242
32391991310,2cyclictest27056-21grep10:40:282
32391991310,2cyclictest16215-21grep08:50:182
32391991310,2cyclictest14440-21wc07:40:002
3239199130,8cyclictest0-21swapper/209:20:132
3239199130,11cyclictest3715-21tr08:25:132
3238999139,3cyclictest25-21ksoftirqd/110:40:011
3238999138,3cyclictest10181-21ssh10:55:151
32389991310,2cyclictest24656-21grep10:10:161
3238999130,12cyclictest22451-21grep11:55:151
3238999130,12cyclictest22451-21grep11:55:141
3238999130,11cyclictest13761-21apache_processe09:30:101
3238499139,3cyclictest29515-21cat10:15:010
3238499139,3cyclictest2207-21wc08:20:240
3238499139,2cyclictest5127-21wc08:25:250
3238499139,2cyclictest20083-21ssh09:35:170
3238499138,3cyclictest30342-21wc08:10:270
3238499135,4cyclictest224-21systemd-journal11:55:150
3238499135,4cyclictest224-21systemd-journal11:55:150
3238499131,12cyclictest0-21swapper/011:05:150
32384991310,2cyclictest915-21sh08:20:000
32384991310,2cyclictest6296-21wc09:20:240
32384991310,2cyclictest23812-21cron07:59:590
32384991310,2cyclictest22334-21grep11:30:190
3238499130,1cyclictest0-21swapper/012:03:560
3239499129,2cyclictest4835-21wc07:20:003
3239499129,2cyclictest29903-21rm10:15:193
3239499129,2cyclictest28271-21ssh09:42:373
3239499129,2cyclictest26187-21grep10:10:263
3239499129,2cyclictest23748-21wc11:05:243
3239499129,2cyclictest14426-21wc08:45:213
3239499128,3cyclictest2522-21ssh09:17:113
3239499126,3cyclictest7744-21snmpd10:45:003
3239499123,5cyclictest0-21swapper/311:20:173
3239199129,2cyclictest5678-21grep07:20:162
3239199129,2cyclictest4293-21grep12:05:132
3239199129,2cyclictest24676-21tr10:10:152
3239199129,2cyclictest20011-21cron08:59:592
3239199129,2cyclictest16038-21cat07:40:262
3239199129,2cyclictest12361-21wc08:40:252
3239199129,2cyclictest10269-21cat09:55:212
3239199128,3cyclictest9914-21grep11:20:182
3239199128,3cyclictest11436-21wget12:10:182
3239199126,2cyclictest8724-21turbostat.cron09:55:012
3239199122,7cyclictest22209-21fschecks_count11:30:182
3239199121,1cyclictest0-21swapper/211:05:142
32391991210,1cyclictest15518-21grep10:30:252
3238999129,2cyclictest9092-21cut08:35:191
3238999129,2cyclictest32002-21grep08:15:191
3238999129,2cyclictest2850-21tr07:15:131
3238999129,2cyclictest26071-21grep10:40:171
3238999129,2cyclictest26002-21df09:10:151
3238999129,2cyclictest25724-21grep08:00:301
3238999129,2cyclictest21866-21grep11:30:161
3238999129,2cyclictest21737-21basename07:55:131
3238999129,2cyclictest19211-21head12:35:161
3238999129,2cyclictest17876-21ls12:34:591
3238999129,2cyclictest15822-21grep08:50:161
3238999128,3cyclictest9020-21grep07:25:261
3238999128,3cyclictest5746-21cron08:30:011
3238999128,3cyclictest3832-21grep11:15:241
3238999128,3cyclictest11557-21rm12:10:201
3238999125,3cyclictest224-21systemd-journal09:09:591
32389991212,0cyclictest0-21swapper/109:27:011
32389991211,1cyclictest0-21swapper/112:21:151
3238499129,2cyclictest8442-21cron11:20:000
3238499129,2cyclictest3572-21cron10:50:000
3238499129,2cyclictest27234-21grep09:10:260
3238499129,2cyclictest20948-21grep07:50:260
3238499129,2cyclictest1990-21basename12:25:140
3238499129,2cyclictest19875-21sed12:15:240
3238499129,2cyclictest11464-21cut08:40:150
3238499129,2cyclictest10329-21df07:30:150
3238499128,3cyclictest8171-21grep07:25:170
3238499128,3cyclictest390-21grep07:10:150
3238499128,3cyclictest14265-21wc10:00:010
3238499128,3cyclictest14048-21tr10:30:130
3238499128,3cyclictest13428-21grep07:35:200
3238499128,3cyclictest0-21swapper/012:39:280
3238499128,2cyclictest4288-21cut10:50:130
3238499128,2cyclictest18824-21ssh09:34:550
3238499128,2cyclictest17780-21grep11:00:260
3238499120,11cyclictest5852-21sed12:05:260
3238499120,0cyclictest0-21swapper/012:33:050
3239499118,2cyclictest9628-21tr08:35:223
3239499118,2cyclictest8883-21df_inode10:25:163
3239499118,2cyclictest6988-21taskset07:23:083
3239499118,2cyclictest6856-21ssh10:23:343
3239499118,2cyclictest6259-21cut08:30:153
3239499118,2cyclictest4202-21taskset09:50:233
3239499118,2cyclictest28892-21cat11:10:213
3239499118,2cyclictest26145-21taskset08:04:143
3239499118,2cyclictest26007-21ssh09:10:143
3239499118,2cyclictest22087-21ssh10:36:293
3239499118,2cyclictest22020-21ssh11:55:053
3239499118,2cyclictest22020-21ssh11:55:053
3239499118,2cyclictest21936-21ssh09:36:213
3239499118,2cyclictest19102-21wc07:50:003
3239499118,2cyclictest17890-21ssh11:26:093
3239499118,2cyclictest17367-21sed11:50:353
3239499118,2cyclictest14448-21ssh09:30:143
3239499118,2cyclictest13707-21sh11:48:423
3239499118,2cyclictest12772-21ssh09:58:093
3239499118,2cyclictest11146-21cut12:30:223
3239499118,2cyclictest10458-21grep07:30:163
3239499118,2cyclictest10284-21sh09:25:023
3239499117,3cyclictest28123-21grep08:05:293
3239499110,10cyclictest31701-21ssh12:01:033
3239499110,10cyclictest19858-21grep10:05:143
3239199119,1cyclictest9999-21ls11:45:242
3239199118,2cyclictest7487-21cat08:30:252
3239199118,2cyclictest5660-21ssh10:50:262
3239199118,2cyclictest4768-21basename07:19:592
3239199118,2cyclictest3270-21tail11:15:192
3239199118,2cyclictest25580-21chrt08:00:292
3239199118,2cyclictest21794-21cut07:55:132
3239199118,2cyclictest20588-21head10:05:172
3239199110,7cyclictest224-21systemd-journal08:40:012
3238999118,2cyclictest6726-21tr08:30:171
3238999118,2cyclictest5054-21uname12:05:181
3238999118,2cyclictest4493-21df_inode09:50:231
3238999118,2cyclictest31760-21ssh10:15:371
3238999118,2cyclictest29377-21ssh11:10:231
3238999118,2cyclictest28467-21sort11:35:211
3238999118,2cyclictest2675-21ssh09:49:051
3238999118,2cyclictest24414-21ssh11:05:381
3238999118,2cyclictest2359-21cron09:16:591
3238999118,2cyclictest22853-21ssh12:17:411
3238999118,2cyclictest20097-21head07:50:171
3238999118,2cyclictest17637-21sh10:33:111
3238999118,2cyclictest16201-21cut11:00:141
3238999118,2cyclictest14994-21expr07:40:151
3238999118,2cyclictest14850-21sed08:45:271
3238999118,2cyclictest14789-21tr10:00:151
3238999118,2cyclictest14789-21tr10:00:141
3238999118,2cyclictest12326-21ssh11:47:121
3238999118,2cyclictest11147-21ssh09:55:411
3238999118,2cyclictest10117-21expr07:30:151
3238999116,2cyclictest224-21systemd-journal10:30:011
3238999112,8cyclictest7158-21awk07:25:001
3238999110,11cyclictest0-21swapper/108:55:161
3238499119,1cyclictest8711-21cron09:55:000
3238499119,1cyclictest15974-21grep10:00:250
3238499119,1cyclictest15974-21grep10:00:240
3238499118,2cyclictest9908-21grep11:20:180
3238499118,2cyclictest32707-21ssh09:45:510
3238499118,2cyclictest28693-21sh09:43:090
3238499118,2cyclictest28368-21ssh10:42:310
3238499118,2cyclictest14915-21ssh12:12:080
3238499118,2cyclictest13519-21ssh11:48:290
3238499118,2cyclictest1100-21ssh12:24:490
3238499117,3cyclictest8240-21wc08:35:010
3238499111,8cyclictest7744-21snmpd10:25:110
3238499110,9cyclictest0-21swapper/008:55:130
3239499108,1cyclictest4749-21cut12:05:173
3239499108,1cyclictest24808-21taskset09:07:383
3239499108,1cyclictest20763-21expr09:00:143
3239499108,1cyclictest17598-21taskset08:54:333
3239499108,1cyclictest12295-21cut07:35:133
3239499107,2cyclictest7637-21tr07:25:153
3239499107,2cyclictest25254-21ssh10:40:133
3239499107,2cyclictest21708-21taskset07:55:113
3239499107,2cyclictest1844-21sed07:10:273
3239199108,1cyclictest73662sleep207:25:042
3239199108,1cyclictest211362sleep207:51:072
3239199108,1cyclictest14001-21basename08:45:172
3239199108,1cyclictest10584-21chrt09:25:282
3239199103,1cyclictest284322sh11:10:062
3239199100,9cyclictest707-21sh10:46:132
3239199100,9cyclictest17394-21expr07:45:152
3239199100,9cyclictest15206-21run-parts09:30:212
3238999108,1cyclictest4702-21ssh09:20:011
3238999108,1cyclictest29478-21expr12:00:161
3238999108,1cyclictest20632-21cut09:00:141
3238999108,1cyclictest20473-21ssh10:05:161
3238999108,1cyclictest15350-21ssh11:50:111
3238999108,1cyclictest12205-21wc08:40:241
3238999107,2cyclictest5008-21ssh10:20:561
3238999107,2cyclictest477-21cat07:10:151
3238999107,2cyclictest29123-21grep08:10:151
3238999107,2cyclictest19040-21taskset07:49:431
3238999107,2cyclictest14178-21chrt07:38:281
3238999107,2cyclictest1328-21cut08:20:181
3238999100,9cyclictest283592sleep108:07:101
3238999100,9cyclictest1669-21ssh11:40:081
3238499108,1cyclictest2659-21chrt11:40:180
3238499108,1cyclictest17302-21chrt11:25:280
3238499108,1cyclictest15175-21dnf07:40:160
3238499108,1cyclictest11954-21ssh09:27:420
3238499108,1cyclictest104412sleep008:39:220
3238499107,2cyclictest5179-21grep07:20:140
3238499107,2cyclictest3241-21apache208:50:180
3238499107,2cyclictest2860-21grep07:15:130
3238499102,6cyclictest21255-21users10:35:270
323919996,2cyclictest20325-21sed09:00:002
323849997,1cyclictest26449-21taskset08:05:080
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional