You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-27 - 14:28
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5.osadl.org (updated Sat Jul 27, 2024 00:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
31642994545,0cyclictest24213-21diskmemload21:50:241
31647993232,0cyclictest0-21swapper/322:32:273
3164299310,30cyclictest0-21swapper/123:37:371
31647993028,1cyclictest0-21swapper/323:50:193
3164799300,29cyclictest32065-21taskset21:50:593
3164799300,29cyclictest31681-21cron23:35:013
31642993028,1cyclictest24213-21diskmemload21:45:151
3164299300,29cyclictest24213-21diskmemload22:41:181
3164299300,29cyclictest21684-21/usr/sbin/munin22:50:181
31640993030,0cyclictest24213-21diskmemload22:29:360
31640993028,1cyclictest575-21dbus-daemon23:50:000
31640993027,2cyclictest6022-21basename21:25:010
3164099300,30cyclictest16725-21taskset23:52:280
3164099300,29cyclictest5474-21awk23:40:170
3164099300,1cyclictest308-21systemd-journal23:00:010
31647992928,1cyclictest24213-21diskmemload23:35:113
3164799290,28cyclictest24213-21diskmemload22:00:163
3164799290,28cyclictest23063-21munin-run00:00:003
3164799290,28cyclictest19335-21ssh22:46:233
3164799290,28cyclictest16967-21hddtemp_smartct22:10:123
3164799290,28cyclictest0-21swapper/323:42:223
3164799290,28cyclictest0-21swapper/322:15:383
3164799290,28cyclictest0-21swapper/321:15:113
3164799290,28cyclictest0-21swapper/321:10:313
3164799290,28cyclictest0-21swapper/300:37:463
3164799290,1cyclictest575-21dbus-daemon23:05:003
3164799290,1cyclictest24213-21diskmemload22:51:183
31645992929,0cyclictest0-21swapper/223:34:212
31645992928,1cyclictest18882-21memory23:20:202
31645992927,1cyclictest24213-21diskmemload00:10:202
3164599290,29cyclictest5124-1kworker/u9:122:17:142
3164599290,29cyclictest24213-21diskmemload22:12:162
3164599290,28cyclictest24213-21diskmemload23:35:482
3164599290,28cyclictest24213-21diskmemload22:00:012
3164599290,28cyclictest24213-21diskmemload21:21:442
3164599290,28cyclictest24213-21diskmemload00:15:082
3164599290,28cyclictest13156-21apt-get23:15:122
3164599290,28cyclictest12829-21apt-get20:45:112
3164599290,28cyclictest0-21swapper/222:22:112
3164599290,28cyclictest0-21swapper/222:07:552
3164599290,28cyclictest0-21swapper/221:45:052
3164599290,28cyclictest0-21swapper/200:27:302
3164599290,28cyclictest0-21swapper/200:21:242
3164599290,28cyclictest0-21swapper/200:02:342
3164599290,1cyclictest24213-21diskmemload22:49:502
3164599290,1cyclictest24213-21diskmemload22:38:302
3164599290,1cyclictest12773-21cron23:15:012
31642992929,0cyclictest24213-21diskmemload00:16:111
31642992927,1cyclictest22332-21users21:40:231
3164299290,28cyclictest24213-21diskmemload23:55:191
3164299290,28cyclictest24213-21diskmemload23:12:521
3164299290,28cyclictest24213-21diskmemload00:07:441
3164299290,28cyclictest12007-21perf22:40:011
3164299290,28cyclictest0-21swapper/122:32:101
3164299290,28cyclictest0-21swapper/121:31:021
3164299290,28cyclictest0-21swapper/120:25:011
3164299290,0cyclictest0-21swapper/122:26:011
31640992928,1cyclictest24213-21diskmemload23:26:040
31640992928,1cyclictest0-21swapper/023:38:040
31640992928,1cyclictest0-21swapper/022:08:190
31640992928,0cyclictest0-21swapper/020:40:130
31640992927,2cyclictest30048-21kworker/u8:023:33:550
3164099290,28cyclictest24213-21diskmemload23:15:120
3164099290,28cyclictest24213-21diskmemload22:37:240
3164099290,28cyclictest24213-21diskmemload21:49:320
3164099290,28cyclictest24213-21diskmemload21:40:530
3164099290,28cyclictest24213-21diskmemload21:13:080
3164099290,28cyclictest24213-21diskmemload00:00:270
3164099290,28cyclictest0-21swapper/022:41:310
3164099290,28cyclictest0-21swapper/022:32:530
3164099290,28cyclictest0-21swapper/022:11:040
3164099290,28cyclictest0-21swapper/000:20:100
3164099290,28cyclictest0-21swapper/000:11:420
3164099290,1cyclictest24213-21diskmemload23:58:420
3164099290,1cyclictest0-21swapper/000:35:190
3164099290,0cyclictest0-21swapper/023:24:070
31647992828,0cyclictest0-21swapper/323:16:013
31647992828,0cyclictest0-21swapper/323:11:203
31647992828,0cyclictest0-21swapper/321:55:513
31647992828,0cyclictest0-21swapper/320:15:123
31647992828,0cyclictest0-21swapper/300:15:023
31647992827,1cyclictest363-21ssh22:25:583
31647992826,1cyclictest17921-21apt-get23:20:133
3164799280,28cyclictest24213-21diskmemload23:46:023
3164799280,28cyclictest24213-21diskmemload22:20:173
3164799280,28cyclictest24213-21diskmemload00:11:253
3164799280,28cyclictest24213-21diskmemload00:05:083
3164799280,28cyclictest0-21swapper/323:25:353
3164799280,28cyclictest0-21swapper/323:05:433
3164799280,28cyclictest0-21swapper/322:41:063
3164799280,28cyclictest0-21swapper/322:35:143
3164799280,28cyclictest0-21swapper/321:30:583
3164799280,28cyclictest0-21swapper/321:25:573
3164799280,28cyclictest0-21swapper/300:30:103
3164799280,28cyclictest0-21swapper/300:21:103
3164799280,0cyclictest24213-21diskmemload21:44:163
3164799280,0cyclictest0-21swapper/322:56:203
3164799280,0cyclictest0-21swapper/322:05:123
3164799280,0cyclictest0-21swapper/321:48:433
3164799280,0cyclictest0-21swapper/321:36:093
3164799280,0cyclictest0-21swapper/321:20:203
3164799280,0cyclictest0-21swapper/300:02:553
31645992828,0cyclictest24213-21diskmemload23:05:042
31645992828,0cyclictest24213-21diskmemload21:35:232
31645992828,0cyclictest0-21swapper/221:10:182
3164599280,28cyclictest24213-21diskmemload21:25:522
3164599280,28cyclictest0-21swapper/223:45:042
3164599280,28cyclictest0-21swapper/223:41:142
3164599280,28cyclictest0-21swapper/222:50:052
3164599280,28cyclictest0-21swapper/222:26:372
3164599280,28cyclictest0-21swapper/221:54:582
3164599280,28cyclictest0-21swapper/221:17:102
3164599280,28cyclictest0-21swapper/200:08:092
3164599280,0cyclictest24213-21diskmemload23:56:012
3164599280,0cyclictest24213-21diskmemload23:25:542
3164599280,0cyclictest24213-21diskmemload23:00:122
3164599280,0cyclictest24213-21diskmemload22:41:452
3164599280,0cyclictest24213-21diskmemload00:35:012
3164599280,0cyclictest11168-21apt-get21:30:182
3164599280,0cyclictest0-21swapper/223:50:512
3164599280,0cyclictest0-21swapper/222:56:272
3164599280,0cyclictest0-21swapper/222:31:502
3164599280,0cyclictest0-21swapper/221:57:452
3164599280,0cyclictest0-21swapper/221:42:072
3164599280,0cyclictest0-21swapper/200:30:422
31642992828,0cyclictest24213-21diskmemload21:55:551
31642992828,0cyclictest0-21swapper/123:50:081
31642992828,0cyclictest0-21swapper/123:20:581
31642992828,0cyclictest0-21swapper/122:07:451
31642992828,0cyclictest0-21swapper/121:36:051
31642992828,0cyclictest0-21swapper/121:10:551
31642992828,0cyclictest0-21swapper/100:36:071
31642992828,0cyclictest0-21swapper/100:30:161
31642992828,0cyclictest0-21swapper/100:11:341
3164299280,28cyclictest24213-21diskmemload23:42:291
3164299280,28cyclictest24213-21diskmemload23:32:451
3164299280,28cyclictest24213-21diskmemload22:55:391
3164299280,28cyclictest24213-21diskmemload22:46:471
3164299280,28cyclictest24213-21diskmemload00:25:561
3164299280,28cyclictest0-21swapper/123:16:291
3164299280,28cyclictest0-21swapper/123:01:161
3164299280,28cyclictest0-21swapper/122:20:361
3164299280,28cyclictest0-21swapper/122:01:251
3164299280,28cyclictest0-21swapper/121:25:071
3164299280,28cyclictest0-21swapper/121:17:391
3164299280,28cyclictest0-21swapper/100:21:391
3164299280,0cyclictest24213-21diskmemload23:29:351
3164299280,0cyclictest24213-21diskmemload22:17:581
3164299280,0cyclictest24213-21diskmemload00:00:071
3164299280,0cyclictest0-21swapper/123:45:371
3164299280,0cyclictest0-21swapper/123:05:431
3164299280,0cyclictest0-21swapper/122:13:111
3164299280,0cyclictest0-21swapper/121:20:341
31640992828,0cyclictest59850irq/127-eno121:16:060
31640992828,0cyclictest0-21swapper/022:50:130
31640992828,0cyclictest0-21swapper/022:15:180
31640992828,0cyclictest0-21swapper/000:32:330
31640992828,0cyclictest0-21swapper/000:15:440
31640992827,1cyclictest0-21swapper/023:06:270
31640992827,1cyclictest0-21swapper/022:02:180
31640992827,1cyclictest0-21swapper/019:25:120
31640992826,2cyclictest3872-21munin-run19:20:000
3164099280,28cyclictest0-21swapper/023:10:070
3164099280,28cyclictest0-21swapper/023:00:210
3164099280,28cyclictest0-21swapper/021:50:500
3164099280,28cyclictest0-21swapper/021:35:010
3164099280,28cyclictest0-21swapper/021:30:090
3164099280,28cyclictest0-21swapper/000:05:320
3164099280,0cyclictest24213-21diskmemload22:20:090
3164099280,0cyclictest0-21swapper/022:45:410
3164099280,0cyclictest0-21swapper/021:55:220
3164099280,0cyclictest0-21swapper/021:25:020
3164099280,0cyclictest0-21swapper/019:35:110
3164099280,0cyclictest0-21swapper/000:25:150
31647992727,0cyclictest0-21swapper/321:00:123
3164799270,0cyclictest0-21swapper/300:26:553
31645992727,0cyclictest3521-21apt-get20:25:102
31642992727,0cyclictest0-21swapper/120:10:111
31642992727,0cyclictest0-21swapper/119:50:101
31642992727,0cyclictest0-21swapper/119:30:111
3164299270,0cyclictest0-21swapper/120:50:101
31640992727,0cyclictest4130-21apt-get19:20:110
31640992727,0cyclictest0-21swapper/020:20:120
31640992727,0cyclictest0-21swapper/019:55:130
3164099270,27cyclictest0-21swapper/020:00:120
31647992626,0cyclictest0-21swapper/320:35:003
31647992626,0cyclictest0-21swapper/319:50:023
31647992626,0cyclictest0-21swapper/319:15:103
31645992626,0cyclictest21005-21apt-get19:55:132
31645992626,0cyclictest0-21swapper/219:20:112
31642992626,0cyclictest0-21swapper/120:35:091
31640992626,0cyclictest0-21swapper/020:45:110
31647992525,0cyclictest0-21swapper/319:35:113
31645992525,0cyclictest0-21swapper/221:10:002
31640992525,0cyclictest0-21swapper/020:25:100
31647992424,0cyclictest26023-21apt-get20:05:133
31642992424,0cyclictest0-21swapper/119:55:131
31645992323,0cyclictest0-21swapper/219:35:112
31642992323,0cyclictest0-21swapper/120:45:111
31640992321,1cyclictest19491-21cron21:00:000
31645992222,0cyclictest0-21swapper/220:05:132
31645992222,0cyclictest0-21swapper/220:00:122
31640992222,0cyclictest0-21swapper/021:05:120
31647992121,0cyclictest9077-21apt-get19:30:093
31645992121,0cyclictest0-21swapper/220:20:122
31642992121,0cyclictest0-21swapper/120:05:131
31642992121,0cyclictest0-21swapper/119:25:121
31642992121,0cyclictest0-21swapper/119:15:111
3164599207,6cyclictest30692-21munin-node20:52:372
31642992020,0cyclictest0-21swapper/120:30:111
31642992020,0cyclictest0-21swapper/119:20:111
31640992020,0cyclictest1516-21perf19:15:000
31647991919,0cyclictest0-21swapper/319:40:133
31642991918,1cyclictest11400-21apt-get19:35:111
31640991919,0cyclictest0-21swapper/021:05:000
31645991817,1cyclictest7887-21idleruntime-cro20:35:002
31645991716,1cyclictest10244-21perf20:40:012
31645991616,0cyclictest0-21swapper/220:40:132
31645991614,1cyclictest0-21swapper/219:20:002
3164099161,6cyclictest0-21swapper/020:10:130
31640991615,1cyclictest0-21swapper/019:35:010
31647991513,1cyclictest16706-21hddtemp_smartct19:45:153
31647991512,2cyclictest6361-21cut19:25:013
3164799150,1cyclictest18529-21/usr/sbin/munin20:55:203
3164799150,1cyclictest12000-21sed20:40:263
3164799150,14cyclictest0-21swapper/320:00:123
31645991515,0cyclictest0-21swapper/219:25:122
3164599150,1cyclictest30453-21cut20:15:012
31642991515,0cyclictest23399-21apt-get20:00:121
31642991514,1cyclictest28301-21kworker/1:020:41:001
3164299150,1cyclictest3017-21latency_hist20:25:001
3164299150,1cyclictest23237-21ntp_states21:05:201
3164099150,14cyclictest0-21swapper/020:08:530
3164099150,14cyclictest0-21swapper/019:40:130
3164799140,14cyclictest0-21swapper/320:50:483
3164799140,14cyclictest0-21swapper/320:37:073
3164799140,14cyclictest0-21swapper/320:29:333
3164799140,14cyclictest0-21swapper/320:11:323
3164799140,14cyclictest0-21swapper/319:55:303
3164799140,14cyclictest0-21swapper/319:25:023
3164799140,14cyclictest0-21swapper/319:13:593
3164799140,0cyclictest0-21swapper/320:46:453
31645991414,0cyclictest0-21swapper/219:46:082
3164599140,14cyclictest0-21swapper/221:04:112
3164599140,14cyclictest0-21swapper/220:57:342
3164599140,14cyclictest0-21swapper/220:17:202
3164599140,14cyclictest0-21swapper/219:50:372
3164599140,14cyclictest0-21swapper/219:40:042
3164599140,14cyclictest0-21swapper/219:34:312
3164599140,0cyclictest0-21swapper/219:11:442
31642991414,0cyclictest17469-21apt-get20:55:121
31642991414,0cyclictest10019-21kworker/1:019:11:301
31642991413,1cyclictest10986-21kworker/1:119:45:031
3164299140,14cyclictest0-21swapper/119:40:091
3164299140,0cyclictest0-21swapper/121:00:151
31640991414,0cyclictest0-21swapper/020:50:070
31640991414,0cyclictest0-21swapper/020:31:120
3164099140,14cyclictest0-21swapper/019:50:250
3164099140,0cyclictest0-21swapper/020:35:010
3164099140,0cyclictest0-21swapper/020:15:070
3164099140,0cyclictest0-21swapper/019:46:130
31647991313,0cyclictest0-21swapper/320:20:113
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional