You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-27 - 14:22
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1.osadl.org (updated Sat Jul 27, 2024 12:44:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
838821600,2sleep30-21swapper/311:55:043
838821600,2sleep30-21swapper/311:55:043
1343921550,3sleep121-21ksoftirqd/107:10:191
1343921550,3sleep121-21ksoftirqd/107:10:191
870321460,3sleep20-21swapper/212:28:552
870321460,3sleep20-21swapper/212:28:552
1204021390,2sleep00-21swapper/009:31:350
1204021390,2sleep00-21swapper/009:31:350
2316621350,3sleep20-21swapper/210:22:402
2316621350,3sleep20-21swapper/210:22:402
947021300,4sleep00-21swapper/010:45:170
2904621140,3sleep00-21swapper/011:41:510
2904621140,3sleep00-21swapper/011:41:510
2074521100,4sleep00-21swapper/011:33:390
2074521100,4sleep00-21swapper/011:33:390
915921010,2chrt0-21swapper/009:28:530
915921010,2chrt0-21swapper/009:28:530
260952900,3sleep00-21swapper/012:13:100
260952900,3sleep00-21swapper/012:13:100
48672890,4chrt4869-21awk11:50:270
48672890,4chrt4869-21awk11:50:270
263062820,2sleep30-21swapper/309:10:243
263062820,2sleep30-21swapper/309:10:243
293732760,3chrt0-21swapper/211:08:342
293732760,3chrt0-21swapper/211:08:342
143312710,10sleep012-21ksoftirqd/007:10:300
143312710,10sleep012-21ksoftirqd/007:10:300
21532670,3sleep00-21swapper/009:58:350
38142630,3chrt0-21swapper/210:00:182
38142630,3chrt0-21swapper/210:00:182
168272610,3chrt0-21swapper/310:53:443
168272610,3chrt0-21swapper/310:53:443
323292570,3sleep30-21swapper/310:33:513
323292570,3sleep30-21swapper/310:33:513
24922570,3chrt0-21swapper/309:59:103
14052995618,30cyclictest58950irq/55-eth011:15:130
14052995421,25cyclictest59050irq/56-eth011:45:130
14052995421,25cyclictest59050irq/56-eth011:45:130
123822540,2sleep012391-21sh12:32:200
123822540,2sleep012391-21sh12:32:200
255612530,2sleep225661-21ssh09:10:162
255612530,2sleep225661-21ssh09:10:162
57772490,8sleep121-21ksoftirqd/109:25:091
57772490,8sleep121-21ksoftirqd/109:25:091
30672470,3chrt0-21swapper/309:20:373
30672470,3chrt0-21swapper/309:20:373
171802450,2sleep017339-21grep07:20:160
171802450,2sleep017339-21grep07:20:160
260282440,3sleep10-21swapper/111:39:271
260282440,3sleep10-21swapper/111:39:271
266762430,3sleep00-21swapper/011:40:100
266762430,3sleep00-21swapper/011:40:100
190162430,2sleep00-21swapper/012:39:540
190162430,2sleep00-21swapper/012:39:540
190162430,2sleep00-21swapper/012:39:540
18712430,3chrt0-21swapper/312:20:523
18712430,3chrt0-21swapper/312:20:523
124722430,2sleep20-21swapper/210:48:362
171782420,3chrt0-21swapper/312:37:123
171782420,3chrt0-21swapper/312:37:123
171782420,3chrt0-21swapper/312:37:123
211702400,3sleep30-21swapper/310:20:203
211702400,3sleep30-21swapper/310:20:203
258782390,2sleep30-21swapper/311:04:453
258782390,2sleep30-21swapper/311:04:453
213532390,3sleep10-21swapper/109:42:491
213532390,3sleep10-21swapper/109:42:491
240482380,3chrt23631-21/usr/sbin/munin09:05:202
240482380,3chrt23631-21/usr/sbin/munin09:05:202
1405499381,27cyclictest32690-21ssh12:20:142
1405499381,27cyclictest32690-21ssh12:20:142
143092370,4sleep00-21swapper/010:12:140
143092370,4sleep00-21swapper/010:12:140
1405399373,3cyclictest131rcu_preempt09:50:131
1405399373,3cyclictest131rcu_preempt09:50:131
132562370,2sleep013284-21ntp_states11:25:250
132562370,2sleep013284-21ntp_states11:25:250
111132370,2sleep10-21swapper/110:46:141
110012350,3sleep30-21swapper/311:23:193
110012350,3sleep30-21swapper/311:23:193
321432340,2sleep032155-21ssh11:10:420
321432340,2sleep032155-21ssh11:10:420
1405499341,2cyclictest131rcu_preempt10:55:162
1405499341,2cyclictest131rcu_preempt10:55:162
249482330,3sleep20-21swapper/210:25:182
249482330,3sleep20-21swapper/210:25:182
1405499331,13cyclictest3954-21ssh11:50:172
1405499331,13cyclictest3954-21ssh11:50:172
1405399321,2cyclictest131rcu_preempt12:10:141
1405399321,2cyclictest131rcu_preempt12:10:141
85602310,2sleep08556-21ntp_states11:20:250
85602310,2sleep08556-21ntp_states11:20:250
37292310,3sleep30-21swapper/311:15:223
282912310,3sleep014049-21cyclictest10:29:130
282912310,3sleep014049-21cyclictest10:29:130
182072310,4sleep227-21ksoftirqd/212:38:442
182072310,4sleep227-21ksoftirqd/212:38:442
182072310,4sleep227-21ksoftirqd/212:38:442
1405499316,16cyclictest27-21ksoftirqd/208:35:152
1405499316,16cyclictest27-21ksoftirqd/208:35:152
51812300,2sleep00-21swapper/010:40:150
51812300,2sleep00-21swapper/010:40:150
51752300,2sleep121-21ksoftirqd/110:01:171
51752300,2sleep121-21ksoftirqd/110:01:171
9872290,2sleep0997-21sh09:19:300
9872290,2sleep0997-21sh09:19:300
186182290,2sleep00-21swapper/010:17:120
186182290,2sleep00-21swapper/010:17:120
67722280,2sleep06783-21sh12:26:050
67722280,2sleep06783-21sh12:26:050
14053992815,6cyclictest0-21swapper/111:25:131
14053992815,6cyclictest0-21swapper/111:25:131
49892270,2sleep00-21swapper/010:40:110
49892270,2sleep00-21swapper/010:40:110
207652270,2sleep020776-21ssh09:41:520
207652270,2sleep020776-21ssh09:41:520
172582270,3sleep00-21swapper/008:45:290
1405499271,2cyclictest131rcu_preempt10:15:142
1405499271,2cyclictest131rcu_preempt10:15:142
1405499261,3cyclictest131rcu_preempt07:35:112
1405499261,3cyclictest131rcu_preempt07:35:112
14052992620,5cyclictest59050irq/56-eth012:05:150
14052992620,5cyclictest59050irq/56-eth012:05:150
14052992617,7cyclictest28226-21ssh09:12:510
14052992617,7cyclictest28226-21ssh09:12:510
14052992617,6cyclictest58950irq/55-eth011:05:150
14052992617,6cyclictest58950irq/55-eth011:05:150
14052992613,10cyclictest19298-21ssh10:55:440
14052992613,10cyclictest19298-21ssh10:55:440
304002250,3chrt0-21swapper/012:17:200
304002250,3chrt0-21swapper/012:17:200
14052992511,12cyclictest0-21swapper/009:05:110
14052992511,12cyclictest0-21swapper/009:05:110
53682240,3sleep00-21swapper/008:15:200
53682240,3sleep00-21swapper/008:15:200
234392240,3sleep00-21swapper/011:00:320
234392240,3sleep00-21swapper/011:00:320
176802240,2sleep20-21swapper/211:30:202
176802240,2sleep20-21swapper/211:30:202
14053992416,6cyclictest6083-21cat08:15:321
14053992416,6cyclictest6083-21cat08:15:321
14052992418,4cyclictest29950irq/49-vc409:26:470
14052992418,4cyclictest29950irq/49-vc409:26:470
14052992416,6cyclictest58950irq/55-eth007:45:110
14052992414,8cyclictest19933-21df08:55:160
14052992414,8cyclictest19933-21df08:55:160
133032245,12sleep20-21swapper/207:10:132
133032245,12sleep20-21swapper/207:10:132
1405499236,4cyclictest131rcu_preempt09:28:472
1405499236,4cyclictest131rcu_preempt09:28:472
14054992312,8cyclictest7683-21apt-get10:05:132
14053992313,8cyclictest32180-21ssh09:17:151
14053992313,8cyclictest32180-21ssh09:17:151
14053992313,8cyclictest13747-21df_inode10:50:181
14053992313,8cyclictest13747-21df_inode10:50:181
14052992313,8cyclictest58950irq/55-eth009:35:140
14052992313,8cyclictest58950irq/55-eth009:35:140
161432220,3chrt0-21swapper/109:36:221
161432220,3chrt0-21swapper/109:36:221
1405499222,13cyclictest26775-21ssh11:40:142
1405499222,13cyclictest26775-21ssh11:40:142
1405399221,5cyclictest21-21ksoftirqd/109:15:061
1405399221,5cyclictest21-21ksoftirqd/109:15:061
14053992213,7cyclictest20816-21ssh12:07:251
14053992213,7cyclictest20816-21ssh12:07:251
14053992213,7cyclictest20140-21ssh11:32:461
14053992213,7cyclictest20140-21ssh11:32:461
1405299223,14cyclictest10626-21apt-get08:30:130
1405299223,14cyclictest10626-21apt-get08:30:130
1405299222,16cyclictest381-21snmpd07:55:120
1405299222,16cyclictest381-21snmpd07:55:120
1405299222,16cyclictest20571-21apt-get10:20:140
1405299222,16cyclictest20571-21apt-get10:20:140
14052992216,4cyclictest25432-21ssh09:47:210
14052992216,4cyclictest25432-21ssh09:47:210
14052992216,4cyclictest11650-21apt10:10:020
1405299221,13cyclictest13640-21ssh10:50:170
1405299221,13cyclictest13640-21ssh10:50:170
14052992210,10cyclictest3357-21ssh10:00:130
14052992210,10cyclictest3357-21ssh10:00:130
132882220,15sleep30-21swapper/307:10:103
132882220,15sleep30-21swapper/307:10:103
214142210,3sleep30-21swapper/312:08:193
214142210,3sleep30-21swapper/312:08:193
1405499218,11cyclictest9406-21gzip08:25:232
1405499218,11cyclictest9406-21gzip08:25:232
14054992113,6cyclictest456-21sensors_temp08:00:322
14054992113,6cyclictest456-21sensors_temp08:00:322
14054992112,7cyclictest1303-21ssh11:46:492
14054992112,7cyclictest1303-21ssh11:46:492
14054992111,8cyclictest18890-21apt-get07:25:132
14054992111,8cyclictest18890-21apt-get07:25:132
1405399213,6cyclictest21-21ksoftirqd/107:40:171
14053992114,6cyclictest2209-21ssh09:58:411
14053992113,6cyclictest30376-21ssh12:17:181
14053992113,6cyclictest30376-21ssh12:17:181
14053992111,5cyclictest14689-21rm12:35:161
14053992111,5cyclictest14689-21rm12:35:161
14053992111,5cyclictest14689-21rm12:35:161
14052992114,6cyclictest12-21ksoftirqd/011:55:140
14052992114,6cyclictest12-21ksoftirqd/011:55:140
1837622012,4sleep117868-21/usr/sbin/munin10:55:241
1837622012,4sleep117868-21/usr/sbin/munin10:55:241
1405499209,9cyclictest30720-21/usr/sbin/munin09:15:262
1405499209,9cyclictest30720-21/usr/sbin/munin09:15:262
1405499209,9cyclictest26170-21ssh09:48:422
1405499209,9cyclictest26170-21ssh09:48:422
1405499204,3cyclictest131rcu_preempt12:10:082
1405499204,3cyclictest131rcu_preempt12:10:082
1405499201,4cyclictest0-21swapper/211:59:402
1405499201,4cyclictest0-21swapper/211:59:402
1405499201,14cyclictest16920-21latency_hist11:30:122
1405499201,14cyclictest16920-21latency_hist11:30:122
1405499200,15cyclictest14324-21rm09:35:142
1405499200,15cyclictest14324-21rm09:35:142
1405399203,6cyclictest21-21ksoftirqd/110:09:091
14053992012,5cyclictest1067-21proc_pri12:20:241
14053992012,5cyclictest1067-21proc_pri12:20:241
1405299209,9cyclictest30697-21sh09:54:140
1405299209,9cyclictest30697-21sh09:54:140
1405299207,9cyclictest3924-21ntpq08:10:240
1405299207,9cyclictest3924-21ntpq08:10:240
1405299203,14cyclictest29057-21diskmemload10:30:130
1405299203,14cyclictest29057-21diskmemload10:30:130
1405299203,12cyclictest19619-21/usr/sbin/munin07:25:240
1405299203,12cyclictest19619-21/usr/sbin/munin07:25:240
1405599193,10cyclictest0-21swapper/308:20:143
1405599192,11cyclictest0-21swapper/310:00:153
1405599192,11cyclictest0-21swapper/310:00:153
1405599191,11cyclictest0-21swapper/312:10:163
1405599191,11cyclictest0-21swapper/312:10:163
1405499199,8cyclictest1803-21df_inode09:20:182
1405499199,8cyclictest1803-21df_inode09:20:182
1405499191,9cyclictest308872sh10:31:212
1405499191,9cyclictest308872sh10:31:212
14054991910,7cyclictest19385-21/usr/sbin/munin09:40:232
14054991910,7cyclictest19385-21/usr/sbin/munin09:40:232
14054991910,7cyclictest18188-21tune2fs08:50:162
14054991910,7cyclictest12956-21ssh12:33:102
14054991910,7cyclictest12956-21ssh12:33:102
1405399198,9cyclictest5033-21apt-get12:25:151
1405399198,9cyclictest5033-21apt-get12:25:151
1405399194,3cyclictest131rcu_preempt11:05:451
1405399194,3cyclictest131rcu_preempt11:05:451
14053991910,7cyclictest14543-21latency_hist12:35:101
14053991910,7cyclictest14543-21latency_hist12:35:101
14053991910,7cyclictest11841-21users08:30:301
14053991910,7cyclictest11841-21users08:30:301
1405299197,10cyclictest32673-21apt-get12:20:140
1405299197,10cyclictest32673-21apt-get12:20:140
1405299191,9cyclictest2159-21proc_pri08:05:250
1405299191,9cyclictest2159-21proc_pri08:05:250
1405299191,9cyclictest15407-21fschecks_time07:15:190
1405299191,9cyclictest15407-21fschecks_time07:15:190
14052991913,4cyclictest29950irq/49-vc409:26:470
14052991913,4cyclictest29950irq/49-vc409:26:470
1405299191,15cyclictest2620-21ssh09:20:270
1405299191,15cyclictest2620-21ssh09:20:270
1405299191,15cyclictest15634-21taskset08:41:240
1405299191,15cyclictest15634-21taskset08:41:240
14052991910,6cyclictest13417-21/usr/sbin/munin12:00:270
14052991910,6cyclictest13417-21/usr/sbin/munin12:00:270
219512180,4sleep30-21swapper/307:30:343
219512180,4sleep30-21swapper/307:30:343
1405599183,10cyclictest0-21swapper/308:15:173
1405599183,10cyclictest0-21swapper/308:15:173
1405599182,11cyclictest0-21swapper/311:50:083
1405599182,11cyclictest0-21swapper/311:50:083
1405599182,10cyclictest0-21swapper/308:35:163
1405599182,10cyclictest0-21swapper/308:35:163
1405499189,3cyclictest27-21ksoftirqd/212:14:172
1405499189,3cyclictest27-21ksoftirqd/212:14:172
1405499187,3cyclictest27-21ksoftirqd/211:00:292
1405499187,3cyclictest27-21ksoftirqd/211:00:292
1405499186,10cyclictest13441-21dpkg12:00:152
1405499186,10cyclictest13441-21dpkg12:00:152
1405499184,3cyclictest131rcu_preempt10:00:032
1405499183,3cyclictest131rcu_preempt08:31:332
1405499183,3cyclictest131rcu_preempt08:31:332
1405499182,13cyclictest23295-21apt-get09:05:102
1405499182,13cyclictest23295-21apt-get09:05:102
1405499181,5cyclictest3016-21apt08:10:022
1405499181,5cyclictest3016-21apt08:10:022
1405499181,15cyclictest3628-21ls08:10:192
1405499181,15cyclictest3628-21ls08:10:192
1405499181,14cyclictest27230-21ssh09:50:142
1405499181,14cyclictest27230-21ssh09:50:142
14054991811,4cyclictest23577-21sh11:35:492
14054991811,4cyclictest23577-21sh11:35:492
14054991810,6cyclictest8604-21pluginstate11:20:262
14054991810,6cyclictest8604-21pluginstate11:20:262
14054991810,6cyclictest31068-21ls11:10:192
14054991810,6cyclictest31068-21ls11:10:192
14054991810,6cyclictest28407-21ls07:50:162
14054991810,6cyclictest28407-21ls07:50:162
1405399189,7cyclictest31375-21vmstat07:55:261
1405399189,7cyclictest31375-21vmstat07:55:261
1405399188,8cyclictest7152-21sed09:25:311
1405399188,8cyclictest7152-21sed09:25:311
1405399188,8cyclictest3488-21ssh11:50:021
1405399188,8cyclictest3488-21ssh11:50:021
1405399188,8cyclictest2417-21ssh10:35:511
1405399188,8cyclictest2417-21ssh10:35:511
1405399188,8cyclictest20799-21cat07:30:151
1405399188,8cyclictest20799-21cat07:30:151
1405399186,7cyclictest1348-21ntpd08:40:161
1405399186,7cyclictest1348-21ntpd08:40:161
1405399182,13cyclictest28278-21dpkg07:50:121
1405399182,13cyclictest28278-21dpkg07:50:121
1405399181,9cyclictest34762kernelversion11:15:181
1405399181,8cyclictest268702sh09:49:571
1405399181,8cyclictest268702sh09:49:571
14053991812,4cyclictest249392sleep111:03:101
14053991812,4cyclictest249392sleep111:03:101
14053991812,4cyclictest0-21swapper/111:50:161
14053991812,4cyclictest0-21swapper/111:50:161
14053991812,4cyclictest0-21swapper/110:40:291
14053991812,4cyclictest0-21swapper/110:40:291
14053991812,4cyclictest0-21swapper/109:05:061
14053991812,4cyclictest0-21swapper/109:05:061
14053991812,4cyclictest0-21swapper/109:05:061
14053991812,4cyclictest0-21swapper/107:20:151
14053991812,4cyclictest0-21swapper/107:20:151
14053991811,5cyclictest29713-21gzip10:30:211
14053991811,5cyclictest29713-21gzip10:30:211
14053991810,6cyclictest17766-21latency_hist08:50:021
14053991810,6cyclictest17687-21sh12:04:491
14053991810,6cyclictest17687-21sh12:04:491
14053991810,6cyclictest13147-21ntp_kernel_pll_08:35:241
14053991810,6cyclictest13147-21ntp_kernel_pll_08:35:241
14053991810,6cyclictest0-21swapper/108:00:331
14053991810,6cyclictest0-21swapper/108:00:331
1405299189,7cyclictest32277-21fschecks_time08:00:200
1405299189,7cyclictest32277-21fschecks_time08:00:200
1405299181,8cyclictest9894-21grep08:25:300
1405299181,8cyclictest9894-21grep08:25:300
1405299181,8cyclictest23495-21cat07:35:240
1405299181,8cyclictest23495-21cat07:35:240
1405299181,14cyclictest22329-21ls07:35:020
1405299181,14cyclictest22329-21ls07:35:020
1405299180,9cyclictest7635-21ntp_offset08:20:220
1405599179,6cyclictest21413-21taskset10:59:263
1405599179,6cyclictest21413-21taskset10:59:263
14055991711,4cyclictest19322sleep310:35:283
14055991711,4cyclictest19322sleep310:35:283
1405499179,7cyclictest31288-21sh12:18:392
1405499179,7cyclictest31288-21sh12:18:392
1405499179,6cyclictest17469-21sshd08:46:232
1405499179,6cyclictest11923-21seq10:10:132
1405499179,6cyclictest11923-21seq10:10:132
14054991711,4cyclictest7430-21sh11:20:032
14054991711,4cyclictest0-21swapper/208:55:302
14054991711,4cyclictest0-21swapper/208:55:302
1405499171,13cyclictest4755-21cron10:40:132
1405499171,13cyclictest4755-21cron10:40:132
1405499171,12cyclictest25244-21diskmemload10:35:142
1405499171,12cyclictest25244-21diskmemload10:35:142
1405499171,10cyclictest0-21swapper/207:45:092
14054991710,5cyclictest14547-21readlink10:50:282
14054991710,5cyclictest14547-21readlink10:50:282
1405399179,6cyclictest7090-21fschecks_count08:20:161
1405399179,6cyclictest15382-21grep07:15:191
1405399179,6cyclictest15382-21grep07:15:191
1405399178,7cyclictest2689-21ls11:15:021
1405399178,7cyclictest2689-21ls11:15:021
1405399178,7cyclictest20075-21perl08:55:181
1405399178,7cyclictest20075-21perl08:55:181
1405399178,7cyclictest19178-21grep08:50:281
1405399178,7cyclictest12755-21awk10:10:281
1405399178,7cyclictest12755-21awk10:10:281
1405399178,6cyclictest27609-21ps11:40:251
1405399178,6cyclictest27609-21ps11:40:251
1405399177,8cyclictest10706-21memory09:30:201
1405399177,8cyclictest10706-21memory09:30:201
1405399176,9cyclictest8745-21ssh11:55:151
1405399176,9cyclictest8745-21ssh11:55:151
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional