You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-11-25 - 14:38

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack3slot6s.osadl.org (updated Mon Nov 25, 2024 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
20739212196,20sleep00-21swapper/007:06:510
20812211595,15sleep10-21swapper/107:07:481
20255210277,6sleep30-21swapper/307:05:253
20853210089,6sleep20-21swapper/207:08:202
260652860,0sleep20-21swapper/208:40:152
130742860,0sleep00-21swapper/011:00:160
317342720,0sleep30-21swapper/311:54:313
286762690,0sleep10-21swapper/109:34:441
100472680,0sleep30-21swapper/310:24:163
76562620,4sleep02100999cyclictest11:29:020
78092610,0sleep30-21swapper/311:29:183
21011993214,16cyclictest0-21swapper/211:45:112
2101199321,29cyclictest0-21swapper/210:05:112
315962290,1sleep10-21swapper/112:27:311
220482250,2sleep337-21rcuc/311:44:133
2101199220,20cyclictest0-21swapper/209:50:072
2101199212,2cyclictest0-21swapper/210:46:052
2101199210,19cyclictest0-21swapper/211:05:112
2101299201,3cyclictest2392-21ssh12:30:293
2101199200,2cyclictest0-21swapper/208:10:122
21010992017,2cyclictest21730-21kworker/u8:112:37:041
21010992016,3cyclictest26382-21kworker/u8:111:53:041
2100999200,18cyclictest0-21swapper/010:00:110
32702190,0sleep00-21swapper/011:24:540
21012991916,2cyclictest30717-21kworker/u8:311:23:043
21011991916,2cyclictest2886-21kworker/u8:209:38:042
21011991916,2cyclictest1551-21kworker/u8:109:42:052
21011991916,2cyclictest12283-21kworker/u8:109:21:052
21012991815,2cyclictest32336-21kworker/u8:210:47:043
21012991815,2cyclictest2886-21kworker/u8:209:58:043
21012991815,2cyclictest21730-21kworker/u8:112:29:053
21012991815,2cyclictest19545-21kworker/u8:208:46:043
21011991815,2cyclictest32336-21kworker/u8:211:04:042
21011991815,2cyclictest2886-21kworker/u8:209:56:042
21011991815,2cyclictest27078-21kworker/u8:210:26:042
21011991815,2cyclictest27078-21kworker/u8:210:10:032
21011991813,3cyclictest22497-21rm12:18:132
2101199180,14cyclictest0-21swapper/212:00:042
2100999180,2cyclictest5128-21diskmemload09:55:110
21012991714,2cyclictest32439-21kworker/u8:212:06:053
21012991714,2cyclictest32336-21kworker/u8:211:02:053
21012991714,2cyclictest2886-21kworker/u8:209:26:033
2101299170,15cyclictest5128-21diskmemload11:05:113
21011991714,2cyclictest5508-21kworker/u8:009:14:042
21011991714,2cyclictest337-21kworker/u8:010:17:042
21011991714,2cyclictest32336-21kworker/u8:211:10:032
21011991714,2cyclictest25287-21kworker/u8:207:28:042
21011991714,2cyclictest2103-21kworker/u8:212:32:052
21011991714,2cyclictest19864-21kworker/u8:210:36:042
21011991714,2cyclictest16395-21kworker/u8:312:21:052
21011991714,2cyclictest1551-21kworker/u8:109:49:052
21011991714,2cyclictest15007-21kworker/u8:108:24:052
21011991714,2cyclictest12283-21kworker/u8:109:19:042
21011991714,2cyclictest11585-21kworker/u8:008:18:042
2101199171,13cyclictest0-21swapper/208:45:252
21010991714,2cyclictest6008-21kworker/u8:110:52:051
21010991714,2cyclictest32336-21kworker/u8:211:01:031
2101099170,16cyclictest0-21swapper/111:05:111
21012991613,2cyclictest6008-21kworker/u8:110:44:053
21012991613,2cyclictest6008-21kworker/u8:110:44:053
21012991613,2cyclictest3837-21kworker/u8:111:36:043
21012991613,2cyclictest3837-21kworker/u8:111:30:053
21012991613,2cyclictest32336-21kworker/u8:210:51:053
21012991613,2cyclictest2886-21kworker/u8:210:01:043
21012991613,2cyclictest2886-21kworker/u8:209:20:053
21012991613,2cyclictest16063-21kworker/u8:011:18:043
21012991613,2cyclictest16063-21kworker/u8:011:13:043
2101299161,13cyclictest5128-21diskmemload10:32:193
2101299161,13cyclictest27299-21apt-get07:25:103
21011991613,2cyclictest6008-21kworker/u8:110:54:052
21011991613,2cyclictest32439-21kworker/u8:212:08:052
21011991613,2cyclictest32439-21kworker/u8:211:58:042
21011991613,2cyclictest26382-21kworker/u8:111:54:042
21011991613,2cyclictest25287-21kworker/u8:207:59:042
2101199161,13cyclictest5128-21diskmemload10:21:592
2101199160,3cyclictest26454-21sh09:31:092
2101199160,11cyclictest0-21swapper/210:43:052
2101199160,11cyclictest0-21swapper/210:43:042
21010991613,2cyclictest3837-21kworker/u8:111:35:051
21010991613,2cyclictest25287-21kworker/u8:207:27:051
21010991611,4cyclictest21730-21kworker/u8:112:19:041
2101099160,14cyclictest0-21swapper/112:10:141
2100999161,13cyclictest0-21swapper/009:40:150
57062151,3sleep05842-21munin-node0
21012991512,2cyclictest19864-21kworker/u8:210:35:053
2101299150,13cyclictest0-21swapper/312:23:353
2101299150,13cyclictest0-21swapper/309:38:263
2101299150,13cyclictest0-21swapper/309:12:553
21011991512,2cyclictest19362-21kworker/u8:007:11:052
2101199151,12cyclictest20522-21ssh11:41:482
2101199150,2cyclictest0-21swapper/210:31:192
21010991512,2cyclictest19362-21kworker/u8:007:13:041
21010991512,2cyclictest12225-21kworker/u8:010:04:051
2101099150,3cyclictest9422-21chrt08:00:111
2101099150,3cyclictest0-21swapper/112:30:191
2101099150,2cyclictest0-21swapper/110:46:051
2100999151,3cyclictest16035-21ssh11:37:140
2100999151,12cyclictest3024-21apt-get07:45:160
2100999150,2cyclictest0-21swapper/012:30:440
2100999150,13cyclictest5128-21diskmemload11:30:210
21012991411,2cyclictest7612-21ssh12:02:143
21012991411,2cyclictest3558-21snmpd09:19:553
21012991411,2cyclictest2886-21kworker/u8:209:30:043
21012991411,2cyclictest26382-21kworker/u8:111:49:043
21012991411,2cyclictest10448-21munin-node3
21012991411,2cyclictest0-21swapper/308:05:173
21012991411,2cyclictest0-21swapper/307:45:393
2101299140,2cyclictest21225-21apt-get07:10:103
2101199142,7cyclictest0-21swapper/207:55:012
21011991411,2cyclictest5128-21diskmemload12:36:192
21011991411,2cyclictest2886-21kworker/u8:209:04:052
21011991411,2cyclictest27633-21kworker/u8:008:53:032
21011991411,2cyclictest0-21swapper/210:58:092
21011991411,2cyclictest0-21swapper/208:00:182
2101199140,2cyclictest0-21swapper/212:26:482
2101199140,2cyclictest0-21swapper/212:10:292
2101199140,2cyclictest0-21swapper/211:35:272
2101199140,2cyclictest0-21swapper/211:26:052
2101199140,11cyclictest0-21swapper/208:06:052
21010991411,2cyclictest6130-21kworker/u8:012:05:051
21010991411,2cyclictest5508-21kworker/u8:009:16:041
21010991411,2cyclictest27078-21kworker/u8:210:11:051
21010991411,2cyclictest0-21swapper/109:45:311
2101099140,3cyclictest0-21swapper/110:20:211
2101099140,2cyclictest27298-21ssh10:08:241
2101099140,12cyclictest14802-21df_inode09:55:131
2101099140,12cyclictest0-21swapper/112:22:041
2101099140,12cyclictest0-21swapper/111:46:021
2101099140,12cyclictest0-21swapper/111:30:271
2101099140,12cyclictest0-21swapper/111:12:281
2101099140,12cyclictest0-21swapper/110:36:121
2101099140,12cyclictest0-21swapper/108:05:191
21009991411,2cyclictest0-21swapper/012:28:440
21009991411,2cyclictest0-21swapper/012:05:160
21009991411,2cyclictest0-21swapper/011:16:240
2100999140,3cyclictest0-21swapper/011:48:290
2100999140,13cyclictest0-21swapper/010:55:340
2100999140,12cyclictest5128-21diskmemload11:59:040
2100999140,12cyclictest5128-21diskmemload11:11:470
2100999140,12cyclictest17939-21sh09:22:440
2100999140,12cyclictest0-21swapper/010:30:010
2100999140,12cyclictest0-21swapper/008:40:000
136342140,2sleep011-21rcuc/010:27:220
53342130,2sleep10-21swapper/109:43:541
2101299139,3cyclictest25287-21kworker/u8:208:04:043
21012991310,2cyclictest2103-21kworker/u8:212:35:033
21012991310,2cyclictest11585-21kworker/u8:008:36:053
21012991310,2cyclictest0-21swapper/312:10:473
21012991310,2cyclictest0-21swapper/310:55:463
21012991310,2cyclictest0-21swapper/310:17:103
21012991310,2cyclictest0-21swapper/310:10:153
21012991310,2cyclictest0-21swapper/309:48:363
21012991310,2cyclictest0-21swapper/309:42:163
21012991310,2cyclictest0-21swapper/307:15:063
2101299130,2cyclictest0-21swapper/312:15:153
2101299130,2cyclictest0-21swapper/310:25:273
2101299130,2cyclictest0-21swapper/308:25:163
2101299130,12cyclictest0-21swapper/311:55:053
2101299130,12cyclictest0-21swapper/310:09:253
21011991310,2cyclictest27633-21kworker/u8:008:58:052
21011991310,2cyclictest0-21swapper/209:27:002
2101199130,2cyclictest0-21swapper/208:27:032
2101199130,2cyclictest0-21swapper/207:45:462
2101199130,2cyclictest0-21swapper/207:40:122
2101199130,2cyclictest0-21swapper/207:40:122
2101199130,2cyclictest0-21swapper/207:35:052
2101199130,1cyclictest0-21swapper/211:33:192
2101199130,1cyclictest0-21swapper/211:23:492
2101199130,12cyclictest0-21swapper/208:39:052
21010991310,2cyclictest6008-21kworker/u8:110:30:041
21010991310,2cyclictest5128-21diskmemload10:40:121
21010991310,2cyclictest5128-21diskmemload10:40:111
21010991310,2cyclictest5128-21diskmemload09:51:271
21010991310,2cyclictest27633-21kworker/u8:009:02:051
21010991310,2cyclictest0-21swapper/111:27:381
21010991310,2cyclictest0-21swapper/109:25:231
21010991310,2cyclictest0-21swapper/109:05:161
2101099130,2cyclictest0-21swapper/111:58:591
2101099130,2cyclictest0-21swapper/111:22:441
2101099130,2cyclictest0-21swapper/109:35:111
2101099130,2cyclictest0-21swapper/109:20:161
2101099130,12cyclictest0-21swapper/112:00:231
2101099130,12cyclictest0-21swapper/110:58:091
2101099130,12cyclictest0-21swapper/110:29:341
2101099130,12cyclictest0-21swapper/110:19:041
2101099130,12cyclictest0-21swapper/107:45:291
2101099130,12cyclictest0-21swapper/107:30:051
2101099130,12cyclictest0-21swapper/107:20:111
2100999138,3cyclictest0-21swapper/012:10:280
21009991310,2cyclictest5128-21diskmemload09:12:380
21009991310,2cyclictest0-21swapper/010:10:240
21009991310,2cyclictest0-21swapper/009:16:580
2100999130,2cyclictest0-21swapper/011:50:260
2100999130,2cyclictest0-21swapper/011:05:120
2100999130,2cyclictest0-21swapper/010:50:170
2100999130,2cyclictest0-21swapper/010:46:400
2100999130,2cyclictest0-21swapper/010:20:120
2100999130,2cyclictest0-21swapper/010:06:170
2100999130,2cyclictest0-21swapper/009:51:320
2100999130,2cyclictest0-21swapper/009:46:000
2100999130,2cyclictest0-21swapper/008:45:180
2100999130,2cyclictest0-21swapper/008:15:180
2100999130,2cyclictest0-21swapper/008:05:120
2100999130,2cyclictest0-21swapper/007:10:110
2100999130,12cyclictest0-21swapper/012:15:330
2100999130,12cyclictest0-21swapper/011:42:170
2100999130,12cyclictest0-21swapper/010:35:520
2100999130,12cyclictest0-21swapper/010:15:270
2100999130,12cyclictest0-21swapper/009:25:420
2100999130,12cyclictest0-21swapper/007:40:150
2100999130,12cyclictest0-21swapper/007:40:150
2100999130,11cyclictest31416-21munin-node0
134582130,2sleep30-21swapper/308:10:123
2101299129,2cyclictest31406-21kworker/u8:107:40:053
2101299129,2cyclictest31406-21kworker/u8:107:40:043
2101299129,2cyclictest2886-21kworker/u8:209:06:033
2101299129,2cyclictest27633-21kworker/u8:009:03:033
2101299129,2cyclictest0-21swapper/307:59:273
2101199129,2cyclictest0-21swapper/211:16:192
2101199129,2cyclictest0-21swapper/208:30:212
2101199120,2cyclictest0-21swapper/210:00:052
2101099129,2cyclictest27633-21kworker/u8:008:59:051
2101099129,2cyclictest19362-21kworker/u8:007:15:041
2101099129,2cyclictest0-21swapper/108:45:141
2101099129,2cyclictest0-21swapper/107:35:271
2101099120,2cyclictest0-21swapper/111:19:251
2101099120,11cyclictest5128-21diskmemload11:40:031
2101099120,11cyclictest0-21swapper/109:10:411
2101099120,11cyclictest0-21swapper/108:25:161
2100999129,2cyclictest0-21swapper/012:20:260
2100999129,2cyclictest0-21swapper/010:40:100
2100999129,2cyclictest0-21swapper/010:40:100
2100999129,2cyclictest0-21swapper/009:30:120
2100999129,2cyclictest0-21swapper/008:20:180
2100999129,2cyclictest0-21swapper/007:15:030
2100999120,11cyclictest0-21swapper/012:35:120
2100999120,11cyclictest0-21swapper/009:35:120
2100999120,11cyclictest0-21swapper/009:00:180
2100999120,11cyclictest0-21swapper/008:10:140
2100999120,11cyclictest0-21swapper/007:20:150
2101299118,2cyclictest19545-21kworker/u8:208:50:053
2101299118,2cyclictest19545-21kworker/u8:208:44:053
2101299118,2cyclictest19362-21kworker/u8:007:24:043
2101299118,2cyclictest15007-21kworker/u8:108:15:043
2101199110,1cyclictest0-21swapper/209:05:132
2101099118,2cyclictest5499-21kworker/u8:107:54:031
2101099118,2cyclictest0-21swapper/108:40:181
2101099118,2cyclictest0-21swapper/107:55:291
2101099118,2cyclictest0-21swapper/107:40:121
2101099118,2cyclictest0-21swapper/107:40:121
2101099110,3cyclictest17497-21munin-node1
2101099110,3cyclictest0-21swapper/108:10:161
2101099110,2cyclictest0-21swapper/108:35:201
2100999111,5cyclictest29168-21copy07:30:000
2100999111,3cyclictest30247-21iostat_ios08:50:150
2100999110,2cyclictest0-21swapper/009:05:190
294302100,2sleep30-21swapper/307:30:133
2101299107,2cyclictest5499-21kworker/u8:107:51:043
2101199107,2cyclictest0-21swapper/207:30:262
2101199107,2cyclictest0-21swapper/207:15:392
2101199100,9cyclictest0-21swapper/207:23:052
2101099100,8cyclictest0-21swapper/108:50:231
2100999105,3cyclictest7678-21tr07:55:150
158822100,2sleep10-21swapper/108:15:141
210129996,2cyclictest11585-21kworker/u8:008:20:043
210129991,6cyclictest912-21latency_hist09:00:003
210109996,2cyclictest19545-21kworker/u8:208:30:051
210099996,2cyclictest0-21swapper/008:56:270
210099996,2cyclictest0-21swapper/008:25:140
210099996,2cyclictest0-21swapper/007:50:150
210099996,2cyclictest0-21swapper/007:30:120
210099994,3cyclictest21842-21df08:30:160
210099994,3cyclictest10744-21unixbench_multi08:00:260
210129984,2cyclictest22036-21tune2fs08:30:173
210129983,3cyclictest31652-21tr07:35:183
210099983,3cyclictest23982-21grep08:35:160
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional