You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-11-23 - 20:57

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7s.osadl.org (updated Sat Nov 23, 2024 12:43:08)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
835372995743,11cyclictest266-21systemd-journal08:30:570
835374995531,21cyclictest856405-21munin-plugin-st08:20:012
835374995131,16cyclictest4310-21cups-browsed11:24:392
835374994840,5cyclictest868414-21sendmail09:00:012
835374994840,5cyclictest868414-21sendmail09:00:012
835374994839,5cyclictest926482-21systemd-run10:35:012
835374994733,11cyclictest0-21swapper/207:40:012
835374994521,21cyclictest911348-21sh10:10:582
83537499451,25cyclictest901842-21sh09:55:552
835373994536,5cyclictest865428-21systemd-run08:50:011
835373994529,13cyclictest0-21swapper/112:40:011
835374994437,4cyclictest884239-21kworker/u8:2-xprtiod10:30:012
835374994436,5cyclictest422-21dbus-daemon11:30:022
835374994423,17cyclictest869551-21kworker/u8:8-rpciod09:50:022
83537499442,15cyclictest852873-21ntpq08:05:532
835374994334,5cyclictest4310-21cups-browsed11:00:132
835374994333,7cyclictest4282-21cupsd10:40:142
835374994322,19cyclictest1001386-21switchtime12:16:022
83537499432,14cyclictest904907-21ntpq10:00:502
83537499432,14cyclictest904907-21ntpq10:00:502
835372994312,14cyclictest951928-21ssh11:10:520
83537499425,27cyclictest914557-21ssh10:15:532
835374994234,5cyclictest959-21mta-sts-daemon07:15:492
835374994233,6cyclictest1007722-21latency_hist12:25:032
835374994233,6cyclictest1007722-21latency_hist12:25:032
83537499422,14cyclictest1012943-21ntpq12:30:562
83537499422,14cyclictest1008936-21ntpq12:25:512
835374994221,18cyclictest933792-21gcc10:45:482
835374994210,6cyclictest871409-21diskmemload10:09:482
83537399423,32cyclictest997254-21ssh12:10:571
835372994235,4cyclictest0-21swapper/012:25:020
835372994235,4cyclictest0-21swapper/012:25:020
835372994231,8cyclictest932638-21munin-run10:45:010
835374994118,19cyclictest0-21swapper/211:48:142
83537499411,15cyclictest866262-21ntpq08:50:502
83537499410,10cyclictest96506650ssh11:30:392
83537499410,10cyclictest96506650ssh11:30:392
83537399413,6cyclictest854304-21ntpq08:10:511
835373994132,6cyclictest941350-21timerandwakeup10:56:001
835373994123,15cyclictest943387-21kworker/u8:4-xprtiod11:15:531
83537399412,15cyclictest879252-21ntpq09:20:541
835373994118,19cyclictest0-21swapper/109:15:461
835373994110,29cyclictest987260-21ssh11:58:491
835372994126,6cyclictest4310-21cups-browsed10:12:570
835372994114,21cyclictest959212-21ssh11:20:510
835372994110,11cyclictest0-21swapper/010:00:500
835372994110,11cyclictest0-21swapper/010:00:500
83537499403,31cyclictest872846-21grep09:11:032
835374994023,14cyclictest0-21swapper/210:40:012
83537499402,13cyclictest973373-21ntpq11:40:492
83537499402,13cyclictest835855-21diskstats07:10:412
835374994020,17cyclictest891763-21latency09:40:452
835374994013,3cyclictest0-21swapper/211:15:542
835374994012,2cyclictest0-21swapper/211:50:552
83537399402,7cyclictest835583-21/usr/sbin/munin07:11:021
83537399402,21cyclictest911199-21ssh10:10:521
83537399402,16cyclictest924370-21ntpq10:30:571
835372994032,5cyclictest972795-21aten_r2power_po11:40:390
835372994032,5cyclictest941464-21unixbench-2d10:56:010
835372994031,7cyclictest865420-21sh08:50:010
835372994030,7cyclictest1012762-21needreboot12:30:500
835374993931,5cyclictest863916-21munin-plugin-st08:45:012
835374993931,5cyclictest862395-21cron08:40:012
835374993921,15cyclictest987861-21cron12:00:012
835374993912,6cyclictest871409-21diskmemload11:13:542
83537499391,15cyclictest854293-21ntpq08:10:512
83537499391,13cyclictest860332-21ntpq08:30:532
83537399397,4cyclictest988385-21ssh12:00:351
83537399392,6cyclictest885451-21ntpq09:31:031
83537399392,6cyclictest837742-21ntpq07:15:481
835373993921,15cyclictest271ktimers/109:35:511
835373993917,19cyclictest453-21systemd-logind07:30:021
83537399391,12cyclictest969011-21/usr/sbin/munin11:35:441
83537399391,11cyclictest973399-21ntpq11:40:501
83537399391,10cyclictest930959-21ntp_states10:40:541
835372993933,3cyclictest57-21kcompactd011:15:500
835372993930,5cyclictest976089-21kworker/u8:1+xprtiod11:46:020
835372993923,11cyclictest151ktimers/009:40:490
835374993830,5cyclictest887438-21cron09:35:012
835374993829,6cyclictest266-21systemd-journal07:10:022
83537499382,13cyclictest888667-21ssh09:35:502
835374993821,14cyclictest955-21mta-sts-daemon11:36:402
835374993817,18cyclictest0-21swapper/212:00:412
835374993815,3cyclictest0-21swapper/212:35:522
835374993813,2cyclictest0-21swapper/209:20:482
835374993812,2cyclictest0-21swapper/211:05:412
835374993811,8cyclictest422-21dbus-daemon08:05:022
83537499381,13cyclictest940976-21ntpq10:55:522
83537499381,13cyclictest858413-21diskstats08:25:402
83537499381,11cyclictest997081-21awk12:10:512
83537399387,4cyclictest1007982-21ssh12:25:161
83537399385,14cyclictest944717-21ssh11:00:541
83537399384,4cyclictest842286-21ntpq07:30:521
83537399384,15cyclictest948257-21ssh11:05:491
835373993829,5cyclictest4310-21cups-browsed11:30:211
835373993829,5cyclictest4310-21cups-browsed11:30:211
835373993825,11cyclictest0-21swapper/111:20:381
83537399381,9cyclictest850868-21cpuspeed08:00:411
835373993815,20cyclictest957-21mta-sts-daemon12:18:131
83537399381,14cyclictest927678-21ntp_states10:35:571
83537399381,11cyclictest963794-21ssh11:29:061
83537399381,10cyclictest850018-21sshd07:55:561
835372993828,7cyclictest1-21systemd12:15:020
83537299382,32cyclictest901660-21ssh09:55:480
83537499373,8cyclictest591-21sshd07:30:512
83537499371,13cyclictest993246-21ssh12:05:562
83537499371,13cyclictest936855-21df10:50:442
83537499371,13cyclictest897663-21ssh09:50:412
835374993710,5cyclictest870892-21ntpq09:05:552
835374993710,2cyclictest0-21swapper/209:20:022
83537399377,4cyclictest867411-21/usr/sbin/munin08:55:421
83537399377,4cyclictest867411-21/usr/sbin/munin08:55:421
83537399376,12cyclictest271ktimers/110:00:531
83537399376,12cyclictest271ktimers/110:00:531
83537399374,11cyclictest981360-21ssh11:50:531
83537399373,8cyclictest901741-21ntpq09:55:511
83537399373,7cyclictest951904-21ssh11:10:521
835373993731,3cyclictest0-21swapper/107:20:511
835373993729,5cyclictest918437-21unixbench_singl10:21:031
835373993729,5cyclictest916645-21munin-run10:20:011
83537399372,7cyclictest846859-21ntpq07:45:541
83537399372,18cyclictest907998-21ssh10:05:491
83537399371,9cyclictest976502-21ssh11:45:281
83537399371,9cyclictest855824-21ntpq08:15:551
835373993713,20cyclictest0-21swapper/112:30:521
83537399371,12cyclictest937451-21ntpq10:50:591
83537399371,12cyclictest893753-21ssh09:44:091
83537399371,12cyclictest844912-21df_inode07:40:411
835373993711,22cyclictest0-21swapper/109:10:391
83537399371,11cyclictest861808-21ntpq08:35:531
83537399371,11cyclictest858858-21ntpq08:25:511
83537399371,10cyclictest921108-21ntpq10:25:491
835372993720,4cyclictest171rcu_preempt07:20:480
835374993616,17cyclictest0-21swapper/207:30:022
83537399366,4cyclictest853337-21unixbench_singl08:06:001
83537399363,9cyclictest895184-21ntpq09:45:501
83537399362,5cyclictest848284-21ntpq07:50:481
83537399361,9cyclictest932918-21ssh10:45:111
83537399361,9cyclictest899886-21ssh09:53:231
83537399361,11cyclictest657-21snmpd09:25:511
83537399361,11cyclictest1004028-21ssh12:20:141
83537399361,11cyclictest1004028-21ssh12:20:141
83537399361,10cyclictest869031-21/usr/sbin/munin09:00:461
83537399361,10cyclictest857879-21users08:21:011
83537299363,25cyclictest1001069-21ssh12:15:530
835372993628,5cyclictest947072-21systemd-run11:05:020
83537499353,7cyclictest917861-21ntpq10:20:522
835374993525,7cyclictest881915-21gltestperf09:25:422
83537499351,14cyclictest846937-21ps07:45:582
835374993510,6cyclictest847779-21/usr/sbin/munin07:50:382
83537399352,6cyclictest843861-21ntpq07:35:531
83537399351,9cyclictest866364-21ntpq08:50:551
83537399351,8cyclictest992209-21ssh12:05:191
835373993512,19cyclictest0-21swapper/108:40:391
83537399350,9cyclictest860286-21ntpq08:30:501
835372993527,6cyclictest422-21dbus-daemon12:05:590
835372993526,7cyclictest859521-21latency_hist08:30:020
835372993518,12cyclictest12450irq/32-eth008:40:510
835374993429,2cyclictest0-21swapper/208:00:012
83537499342,13cyclictest869308-21ntpq09:00:522
835374993413,4cyclictest0-21swapper/208:20:542
83537499341,13cyclictest864836-21ntpq08:45:512
83537399341,11cyclictest870792-21ntpq09:05:491
835372993427,5cyclictest840446-21fschecks_time07:25:430
835372993425,6cyclictest777-21ntpd12:35:520
835372993425,6cyclictest421-21avahi-daemon10:15:290
835372993424,7cyclictest151ktimers/009:31:040
835372993419,3cyclictest171rcu_preempt07:40:470
835374993326,4cyclictest845914-21sh07:45:012
83537499331,6cyclictest839813-21grep07:21:012
83537299337,4cyclictest0-21swapper/008:15:530
83537299337,12cyclictest14-21ksoftirqd/009:25:480
835372993327,4cyclictest989751-21unixbench_multi12:01:030
835372993324,7cyclictest918181-21switchtime10:21:010
835372993324,6cyclictest421-21avahi-daemon10:35:190
835372993317,3cyclictest171rcu_preempt11:34:580
835372993317,3cyclictest171rcu_preempt11:34:580
835372993314,2cyclictest171rcu_preempt07:10:520
835372993311,3cyclictest171rcu_preempt11:38:430
835373993214,15cyclictest0-21swapper/107:10:031
83537299328,12cyclictest171rcu_preempt12:29:140
835372993225,5cyclictest443-21rsyslogd09:00:520
835372993224,4cyclictest0-21swapper/010:25:510
835372993220,8cyclictest12450irq/32-eth009:35:490
835372993219,9cyclictest12450irq/32-eth010:45:550
835372993215,11cyclictest12450irq/32-eth011:55:540
83537299318,6cyclictest0-21swapper/009:50:140
835372993123,6cyclictest777-21ntpd09:13:230
835372993115,3cyclictest171rcu_preempt07:20:010
83537299307,5cyclictest151ktimers/011:55:010
83537299304,7cyclictest14-21ksoftirqd/008:05:510
83537299304,4cyclictest14-21ksoftirqd/011:09:270
835372993024,3cyclictest0-21swapper/009:15:510
835372993024,3cyclictest0-21swapper/009:00:010
835372993024,3cyclictest0-21swapper/009:00:010
83537299302,3cyclictest0-21swapper/007:45:530
835372993022,6cyclictest910037-21ssh10:10:010
835372993021,6cyclictest777-21ntpd10:30:580
835372993019,8cyclictest1-21systemd10:55:020
835372993013,7cyclictest777-21ntpd08:00:420
83537299301,23cyclictest879171-21ssh09:20:510
835372992922,5cyclictest777-21ntpd11:26:330
835372992918,3cyclictest171rcu_preempt08:20:540
835372992915,3cyclictest171rcu_preempt07:55:510
835372992912,3cyclictest171rcu_preempt07:30:550
835372992822,3cyclictest0-21swapper/009:10:020
835372992716,5cyclictest171rcu_preempt08:35:570
835372992714,3cyclictest171rcu_preempt08:10:510
83537299269,3cyclictest171rcu_preempt07:35:520
83537299261,9cyclictest14-21ksoftirqd/009:45:500
83537299261,4cyclictest848385-21ntpq07:50:540
835372992610,3cyclictest171rcu_preempt08:50:530
83537299237,3cyclictest171rcu_preempt07:10:030
83537599211,3cyclictest0-21swapper/310:00:493
83537599211,3cyclictest0-21swapper/310:00:493
83537599211,15cyclictest0-21swapper/311:35:533
83537599201,4cyclictest0-21swapper/312:20:503
83537599201,4cyclictest0-21swapper/312:20:503
83537599201,3cyclictest0-21swapper/311:15:543
83537599201,3cyclictest0-21swapper/309:35:553
83537599201,3cyclictest0-21swapper/308:05:553
83537599200,3cyclictest0-21swapper/311:03:333
83537599200,3cyclictest0-21swapper/309:50:533
83537599191,6cyclictest0-21swapper/310:55:493
83537599191,4cyclictest0-21swapper/311:32:363
83537599191,4cyclictest0-21swapper/311:32:363
83537599191,3cyclictest0-21swapper/312:25:543
83537599191,3cyclictest0-21swapper/312:05:493
83537599191,3cyclictest0-21swapper/310:25:543
83537599191,3cyclictest0-21swapper/310:20:543
83537599191,3cyclictest0-21swapper/308:15:573
83537599191,14cyclictest0-21swapper/312:00:563
83537599191,14cyclictest0-21swapper/311:50:543
83537599191,14cyclictest0-21swapper/310:40:483
83537599191,13cyclictest0-21swapper/312:10:513
83537599191,13cyclictest0-21swapper/310:15:533
83537599191,13cyclictest0-21swapper/309:15:543
83537599191,13cyclictest0-21swapper/308:20:553
83537599191,13cyclictest0-21swapper/307:35:523
83537599191,12cyclictest0-21swapper/307:45:553
83537599190,3cyclictest0-21swapper/311:56:213
83537599190,3cyclictest0-21swapper/311:40:493
83537599190,3cyclictest0-21swapper/311:05:433
83537599190,3cyclictest0-21swapper/310:35:513
83537599190,3cyclictest0-21swapper/309:55:553
83537599190,3cyclictest0-21swapper/309:30:283
83537599190,3cyclictest0-21swapper/309:25:513
83537599190,3cyclictest0-21swapper/308:10:443
83537599190,3cyclictest0-21swapper/307:30:563
83537599190,2cyclictest0-21swapper/308:30:503
83537599190,2cyclictest0-21swapper/307:10:573
83537599181,4cyclictest0-21swapper/310:30:563
83537599181,4cyclictest0-21swapper/308:40:483
83537599181,3cyclictest0-21swapper/311:20:483
83537599181,3cyclictest0-21swapper/311:10:313
83537599181,3cyclictest0-21swapper/310:45:473
83537599181,3cyclictest0-21swapper/310:10:533
83537599181,3cyclictest0-21swapper/309:40:513
83537599181,3cyclictest0-21swapper/307:15:503
83537599181,13cyclictest0-21swapper/308:55:483
83537599181,13cyclictest0-21swapper/308:55:483
83537599181,13cyclictest0-21swapper/307:20:533
83537599181,12cyclictest0-21swapper/308:35:533
83537599181,12cyclictest0-21swapper/307:40:503
83537599181,11cyclictest0-21swapper/309:05:493
83537599180,4cyclictest0-21swapper/312:15:323
83537599180,4cyclictest0-21swapper/310:05:493
83537599180,4cyclictest0-21swapper/309:20:523
83537599180,3cyclictest0-21swapper/312:35:513
83537599180,3cyclictest0-21swapper/312:30:533
83537599180,3cyclictest0-21swapper/311:45:553
83537599180,3cyclictest0-21swapper/310:50:463
83537599180,3cyclictest0-21swapper/309:45:453
83537599180,3cyclictest0-21swapper/309:10:503
83537599180,3cyclictest0-21swapper/309:00:503
83537599180,3cyclictest0-21swapper/308:25:473
83537599180,3cyclictest0-21swapper/307:25:543
83537599180,2cyclictest0-21swapper/308:50:503
83537599180,2cyclictest0-21swapper/307:50:533
83537599171,3cyclictest0-21swapper/311:26:213
83537599171,3cyclictest0-21swapper/308:45:473
83537599171,3cyclictest0-21swapper/308:00:413
83537599171,3cyclictest0-21swapper/307:10:033
83537599170,3cyclictest0-21swapper/307:55:473
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional