MCPcopy Create free account
hub / github.com/AtlasAnalyticsLab/AdaFisher / update_running_stat

Function update_running_stat

optimizers/kfac_utils.py:33–37  ·  view source on GitHub ↗
(aa, m_aa, stat_decay)

Source from the content-addressed store, hash-verified

31
32
33def update_running_stat(aa, m_aa, stat_decay):
34 # using inplace operation to save memory!
35 m_aa *= stat_decay / (1 - stat_decay)
36 m_aa += aa
37 m_aa *= (1 - stat_decay)
38
39
40class ComputeMatGrad:

Callers 2

_save_inputMethod · 0.90
_save_grad_outputMethod · 0.90

Calls

no outgoing calls

Tested by

no test coverage detected