MCPcopy Create free account
hub / github.com/tensorflow/lingvo / _AdafactorDecayRatePow

Function _AdafactorDecayRatePow

lingvo/core/optimizer.py:876–886  ·  view source on GitHub ↗

Second moment decay rate where memory-length grows as step_num^exponent. Args: exponent: a float between 0 and 1 offset: an optional integer Returns: a scalar

(exponent, offset=0)

Source from the content-addressed store, hash-verified

source not stored for this graph (policy: none)

Callers 1

GetOptimizerMethod · 0.85

Calls 1

_StepNumFunction · 0.85

Tested by

no test coverage detected

Used in the wild real call sites across dependent graphs

searching dependent graphs…