MCPcopy Create free account
hub / github.com/tensorflow/lingvo / _parameter_scale

Method _parameter_scale

lingvo/core/optimizer.py:984–1000  ·  view source on GitHub ↗

Estimate the scale of the parameters from the current values. We include a minimum value of 0.001 to give it a chance to escape 0 if it was zero-initialized. Instead of using the value, we could impute the scale from the shape, as initializers do. Args: var: a variable o

(self, var)

Source from the content-addressed store, hash-verified

source not stored for this graph (policy: none)

Callers 2

try_apply_denseMethod · 0.95
_resource_apply_denseMethod · 0.95

Calls

no outgoing calls

Tested by

no test coverage detected