You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-11-22 - 13:55
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot4.osadl.org (updated Fri Nov 22, 2024 00:43:35)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1953599772,68cyclictest27017-21/usr/sbin/munin18:01:262
1953599762,68cyclictest27608-21/usr/sbin/munin16:36:272
1953599752,67cyclictest6437-21/usr/sbin/munin17:06:292
1953599752,67cyclictest6437-21/usr/sbin/munin17:06:292
1953599752,67cyclictest4562-21/usr/sbin/munin17:01:172
1953599752,66cyclictest28890-21/usr/sbin/munin18:06:202
1953599752,33cyclictest27656-21taskset20:31:172
1953599732,65cyclictest23868-21/usr/sbin/munin16:26:362
1953599732,31cyclictest21988-21ls18:46:302
1953599724,62cyclictest0-21swapper/221:30:302
1953599716,59cyclictest2775-21aten_rbpower_po16:56:162
1953599712,63cyclictest667-21runrttasks20:11:432
1953599712,63cyclictest4004-21/usr/sbin/munin19:56:262
1953599712,63cyclictest4004-21/usr/sbin/munin19:56:262
1953599712,34cyclictest21997-21/usr/sbin/munin16:21:302
1953599703,62cyclictest16109-21ssh21:04:182
1953599703,36cyclictest3517-21runrttasks19:55:292
1953599693,60cyclictest6401-21ssh20:46:522
1953599693,60cyclictest24342-21snmpd20:53:562
1953599693,60cyclictest24342-21snmpd20:53:562
1953599692,61cyclictest4935-21sh18:21:332
1953599692,61cyclictest4935-21sh18:21:332
1953599692,61cyclictest31352-21/usr/sbin/munin16:46:352
1953599689,53cyclictest0-21swapper/220:22:022
1953599683,59cyclictest20130-21/usr/sbin/munin16:16:172
1953599683,58cyclictest11170-21/usr/sbin/munin18:31:222
1953599683,27cyclictest25970-21ssh18:52:152
1953599682,61cyclictest31167-21fschecks_time18:11:192
1953599682,60cyclictest29476-21/usr/sbin/munin16:41:362
1953599682,60cyclictest25739-21/usr/sbin/munin16:31:362
1953599682,60cyclictest18591-21sshd19:29:102
19535996810,52cyclictest0-21swapper/218:36:192
1953599674,57cyclictest0-21swapper/221:23:282
1953599672,59cyclictest9435-21diskstats19:16:182
1953599672,59cyclictest19462-21kworker/2:221:34:272
1953599672,59cyclictest19462-21kworker/2:221:08:112
1953599672,34cyclictest5291-21ssh19:10:332
1953599672,34cyclictest5291-21ssh19:10:332
1953599669,51cyclictest0-21swapper/219:39:462
1953599664,56cyclictest0-21swapper/218:42:442
1953599663,56cyclictest19612-21/usr/sbin/munin19:31:122
1953599662,58cyclictest827-21/usr/sbin/munin16:51:362
1953599662,58cyclictest4647-21switchtime21:36:312
1953599662,58cyclictest30942-21timerandwakeup19:46:312
1953599662,58cyclictest29314-21ssh19:45:272
1953599662,58cyclictest1314-21mailstats18:16:312
1953599662,32cyclictest32743-21ssh19:01:542
19535996610,50cyclictest0-21swapper/221:45:372
1953599657,52cyclictest0-21swapper/220:03:162
1953599655,54cyclictest0-21swapper/221:15:062
1953599655,54cyclictest0-21swapper/221:15:062
1953599654,55cyclictest0-21swapper/220:36:332
1953599654,55cyclictest0-21swapper/218:26:412
1953599653,57cyclictest0-21swapper/220:06:112
1953599653,56cyclictest13667-21sendmail_mailst19:21:302
1953599652,57cyclictest2046-21iostat_ios20:41:182
1953599652,57cyclictest17876-21grep20:16:202
1953599647,26cyclictest0-21swapper/219:12:262
1953599645,53cyclictest0-21swapper/221:16:482
1953599645,53cyclictest0-21swapper/220:57:362
1953599645,53cyclictest0-21swapper/220:29:142
1953599645,53cyclictest0-21swapper/218:57:152
1925125811,16sleep30-21swapper/316:15:443
1953599574,48cyclictest0-21swapper/218:00:392
1952799572,5cyclictest2685-21kworker/1:121:20:591
1907725712,16sleep20-21swapper/216:13:382
1952799563,47cyclictest588-21irqbalance21:36:301
1952799563,46cyclictest0-21swapper/118:56:041
19522995523,27cyclictest1626-21unixbench_multi18:16:360
1952799543,45cyclictest0-21swapper/120:24:591
1952799534,43cyclictest0-21swapper/120:21:011
1952799534,42cyclictest0-21swapper/118:37:201
19527995310,16cyclictest0-21swapper/118:59:091
1952799524,6cyclictest0-21swapper/119:45:021
1952799522,44cyclictest25334-21ssh20:26:511
1952299524,42cyclictest0-21swapper/021:41:300
1952799514,43cyclictest0-21swapper/121:12:001
1952799514,43cyclictest0-21swapper/121:12:001
1952799514,43cyclictest0-21swapper/120:11:221
1952799513,43cyclictest0-21swapper/118:46:431
1952799512,43cyclictest10304-21rm20:06:011
1952799504,41cyclictest1290-21ssh19:04:131
1952799503,8cyclictest0-21swapper/117:51:071
173572500,5sleep317356-21sshd17:35:023
1953599493,40cyclictest17988-21fschecks_time17:36:192
1953599492,41cyclictest12483-21idleruntime17:21:222
1952799497,36cyclictest0-21swapper/119:12:431
1952799494,39cyclictest0-21swapper/121:00:501
1952799494,39cyclictest0-21swapper/119:32:581
1952799493,41cyclictest0-21swapper/121:30:401
19527994914,30cyclictest13307-21latency19:21:221
19527994912,31cyclictest0-21swapper/120:07:491
19527994910,33cyclictest0-21swapper/119:36:131
1952799484,38cyclictest0-21swapper/118:21:241
1952799484,38cyclictest0-21swapper/118:21:241
1952799484,38cyclictest0-21swapper/117:21:341
1952799484,37cyclictest0-21swapper/120:46:491
1952799483,40cyclictest0-21swapper/118:43:241
1952799483,39cyclictest588-21irqbalance21:31:501
19527994811,31cyclictest0-21swapper/120:32:071
1952299484,38cyclictest0-21swapper/019:56:350
1952299484,38cyclictest0-21swapper/019:56:350
1952299484,20cyclictest0-21swapper/021:21:330
1952299482,20cyclictest15150-21grep18:36:360
19522994815,29cyclictest18196-21switchtime20:16:260
1954399477,34cyclictest0-21swapper/318:36:063
1954399475,36cyclictest21801-21/usr/sbin/munin20:21:323
1953599475,36cyclictest16038-21cut17:31:172
1953599473,38cyclictest8616-21fschecks_time17:11:192
19535994713,28cyclictest24272-21awk17:51:312
1952799478,33cyclictest0-21swapper/119:16:061
1952799476,36cyclictest1137-21hwlatdetect19:51:171
1952799474,37cyclictest0-21swapper/117:11:181
1952799474,36cyclictest0-21swapper/119:48:321
1952799474,36cyclictest0-21swapper/119:26:141
1952799472,39cyclictest2685-21kworker/1:120:42:311
1952299473,8cyclictest28182-21switchtime20:31:280
1954399464,37cyclictest0-21swapper/320:41:253
1953599463,37cyclictest22205-21/usr/sbin/munin17:46:282
1953599463,37cyclictest19717-21entropy17:41:172
1953599463,37cyclictest10710-21kernelversion17:16:252
1953599462,38cyclictest15068-21unixbench-2d17:26:352
1952799464,36cyclictest0-21swapper/121:21:461
1952799464,36cyclictest0-21swapper/121:01:081
1952799464,36cyclictest0-21swapper/120:51:481
1952799464,36cyclictest0-21swapper/120:51:481
1952799464,36cyclictest0-21swapper/120:36:071
1952799464,36cyclictest0-21swapper/119:06:451
1952799464,36cyclictest0-21swapper/119:06:451
1952799464,36cyclictest0-21swapper/118:16:571
1952799464,36cyclictest0-21swapper/117:56:241
1952799464,36cyclictest0-21swapper/116:21:031
1952799464,16cyclictest0-21swapper/119:58:131
1952799464,16cyclictest0-21swapper/119:58:131
1952799463,37cyclictest0-21swapper/121:07:041
1952299467,32cyclictest0-21swapper/020:36:240
1952299464,37cyclictest0-21swapper/019:24:020
1952299464,36cyclictest0-21swapper/021:06:210
1952299464,36cyclictest0-21swapper/020:56:270
1952299464,36cyclictest0-21swapper/018:28:550
1954399454,36cyclictest0-21swapper/321:16:333
1952799457,34cyclictest0-21swapper/117:41:231
1952799455,34cyclictest0-21swapper/117:46:301
1952799454,36cyclictest0-21swapper/121:41:131
1952799454,36cyclictest0-21swapper/117:16:341
1952799454,16cyclictest0-21swapper/118:27:281
1952799453,37cyclictest0-21swapper/118:31:541
1952799453,36cyclictest0-21swapper/117:31:171
19527994512,28cyclictest18886-21unixbench_singl17:36:361
1952299456,33cyclictest0-21swapper/019:16:530
1952299454,36cyclictest0-21swapper/021:36:490
1952299454,36cyclictest0-21swapper/019:13:430
153092453,8sleep00-21swapper/021:02:110
1954399444,13cyclictest0-21swapper/318:51:533
1952799444,36cyclictest0-21swapper/118:06:221
1952799444,35cyclictest0-21swapper/117:03:511
1952799444,35cyclictest0-21swapper/116:43:381
1952799444,35cyclictest0-21swapper/116:26:301
1952799444,35cyclictest0-21swapper/116:24:091
1952799443,36cyclictest0-21swapper/117:06:251
1952799443,36cyclictest0-21swapper/117:06:251
1952799443,35cyclictest0-21swapper/116:37:141
1952299445,33cyclictest0-21swapper/019:06:260
1952299445,33cyclictest0-21swapper/019:06:260
1952299444,35cyclictest0-21swapper/021:17:470
1952299444,35cyclictest0-21swapper/020:46:240
1952299444,35cyclictest0-21swapper/020:26:280
1952299444,34cyclictest0-21swapper/020:01:360
1952299444,34cyclictest0-21swapper/018:51:360
137602443,8sleep00-21swapper/018:36:010
62152433,8sleep30-21swapper/319:58:553
62152433,8sleep30-21swapper/319:58:553
1954399437,31cyclictest0-21swapper/319:16:503
1952799434,34cyclictest0-21swapper/116:59:211
1952799434,34cyclictest0-21swapper/116:46:221
1952799432,35cyclictest2484-21munin-run16:56:061
1952299434,33cyclictest0-21swapper/020:06:320
36812423,8sleep00-21swapper/020:43:400
1954399424,33cyclictest0-21swapper/321:26:353
1952799424,7cyclictest0-21swapper/117:26:181
1952799424,34cyclictest0-21swapper/118:04:341
1952799422,35cyclictest27397-21systemd-cgroups16:36:061
1952299424,33cyclictest0-21swapper/021:31:340
1952299423,34cyclictest0-21swapper/019:41:330
78822413,8sleep00-21swapper/017:08:320
78822413,8sleep00-21swapper/017:08:320
284762413,8sleep30-21swapper/319:43:223
1954399414,31cyclictest0-21swapper/319:14:133
19543994131,6cyclictest37-21ksoftirqd/318:31:033
19522994119,7cyclictest29973-21iostat_ios16:41:230
309072403,8sleep00-21swapper/019:00:560
3002403,8sleep30-21swapper/320:38:483
19543994028,7cyclictest15890-21sh19:26:023
1952799403,33cyclictest0-21swapper/118:15:111
17212403,8sleep00-21swapper/019:05:190
53872393,7sleep00-21swapper/018:22:080
53872393,7sleep00-21swapper/018:22:080
1954399394,30cyclictest0-21swapper/318:36:043
96532383,7sleep30-21swapper/317:12:213
41182383,8sleep00-21swapper/016:58:260
290292383,8sleep00-21swapper/016:38:260
254952383,8sleep00-21swapper/016:30:500
42242373,8sleep30-21swapper/316:59:383
318382373,28sleep30-21swapper/316:46:263
238712373,28sleep00-21swapper/018:50:380
23762374,5sleep30-21swapper/319:06:143
23762374,5sleep30-21swapper/319:06:143
233602373,7sleep00-21swapper/016:22:410
217092373,8sleep00-21swapper/016:20:190
19543993725,8cyclictest26896-21/usr/sbin/munin21:21:253
187072373,7sleep30-21swapper/319:29:293
252252363,7sleep30-21swapper/316:27:353
19543993625,7cyclictest1816-21grep21:31:293
19543993624,7cyclictest20507-21ssh19:31:283
19543993623,9cyclictest27131-21/usr/sbin/munin20:31:143
19543993623,8cyclictest301-21wget18:16:153
19543993620,11cyclictest598-21gdbus21:06:003
1952299364,28cyclictest0-21swapper/021:27:480
19522993625,7cyclictest31377-21grep16:46:190
1925923613,18sleep10-21swapper/116:15:501
159762363,28sleep00-21swapper/020:13:370
155382363,7sleep30-21swapper/317:30:363
322812353,7sleep00-21swapper/018:14:230
1954399359,21cyclictest0-21swapper/318:23:313
1954399359,21cyclictest0-21swapper/318:23:313
1954399354,26cyclictest0-21swapper/316:36:533
1954399353,27cyclictest0-21swapper/318:41:063
19543993514,7cyclictest206512cut21:11:163
19543993514,7cyclictest206512cut21:11:163
1952299354,27cyclictest0-21swapper/019:35:480
19522993525,6cyclictest12348-21fschecks_time17:21:200
19522993523,8cyclictest31141-21grep19:46:330
19522993523,7cyclictest27559-21ls18:01:210
19522993523,7cyclictest20498-21/usr/sbin/munin20:21:290
19522993522,8cyclictest25444-21uniq17:56:190
19522993522,8cyclictest21611-21grep21:11:350
19522993522,8cyclictest21611-21grep21:11:350
1910223512,17sleep00-21swapper/016:13:560
318972343,5sleep30-21swapper/319:48:293
1954399344,26cyclictest0-21swapper/321:39:183
1954399344,26cyclictest0-21swapper/320:47:163
1954399344,26cyclictest0-21swapper/319:37:093
1954399343,26cyclictest0-21swapper/318:58:163
19543993423,7cyclictest1900-21grep16:51:363
19543993423,7cyclictest14248-21tune2fs20:11:173
19543993421,8cyclictest21418-21basename17:46:143
19522993422,7cyclictest26810-21cat16:31:360
19522993413,16cyclictest20733-21unixbench_multi17:41:340
1954399335,24cyclictest0-21swapper/320:19:353
1954399334,24cyclictest0-21swapper/321:44:093
1954399334,24cyclictest0-21swapper/320:29:053
1954399334,24cyclictest0-21swapper/320:03:323
1954399333,25cyclictest0-21swapper/317:39:373
19543993322,7cyclictest10785-21fschecks_count20:06:143
19543993321,7cyclictest26473-21tr16:31:283
19543993321,7cyclictest25264-21cpu17:56:163
1952299334,25cyclictest0-21swapper/017:02:460
1952299334,24cyclictest0-21swapper/018:06:470
1952299333,25cyclictest0-21swapper/017:39:170
19522993321,8cyclictest18021-21cat18:41:200
308202323,7sleep30-21swapper/316:42:323
230302324,8sleep30-21swapper/318:48:313
1954399324,24cyclictest0-21swapper/320:52:243
1954399324,24cyclictest0-21swapper/320:52:243
1954399324,23cyclictest0-21swapper/320:56:323
1954399323,25cyclictest0-21swapper/318:05:413
1954399323,24cyclictest0-21swapper/319:53:043
19543993221,7cyclictest29528-21missed_timers18:06:253
1952299324,24cyclictest0-21swapper/019:40:180
1952299323,24cyclictest11839-21crond17:21:040
1952299323,24cyclictest0-21swapper/019:51:110
1952299322,24cyclictest9549-21head17:11:360
1954399314,22cyclictest0-21swapper/319:01:093
19543993121,5cyclictest37-21ksoftirqd/317:26:043
1952299314,23cyclictest0-21swapper/020:52:280
1952299314,23cyclictest0-21swapper/020:52:280
1952299314,23cyclictest0-21swapper/019:27:310
1952299313,24cyclictest0-21swapper/017:31:170
1952299313,24cyclictest0-21swapper/016:53:460
1952299311,25cyclictest14940-21sort17:26:330
1954399304,22cyclictest0-21swapper/316:22:383
1954399304,12cyclictest0-21swapper/317:03:563
19543993019,7cyclictest18118-21timerandwakeup21:06:283
19543993018,7cyclictest31980-21awk18:11:353
1952299303,21cyclictest21610-21taskset17:46:180
106722302,5sleep310690-21iostat_ios17:16:243
1954399293,22cyclictest0-21swapper/317:41:123
1954399293,21cyclictest0-21swapper/316:16:083
19543992918,7cyclictest667-21runrttasks17:51:213
1952299294,21cyclictest0-21swapper/017:51:090
1954399284,20cyclictest0-21swapper/317:07:283
1954399284,20cyclictest0-21swapper/317:07:283
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional