hub / github.com/tensorflow/lingvo / ReverseAndGrad

Method ReverseAndGrad

lingvo/core/reversible_layers.py:50–113 · view source on GitHub ↗

Implements Algorithm 1 in the revnet paper. Args: theta: A NestedMap object containing weights' values of this layer and its children layers. outputs: A NestedMap: .split1 and .split2 corresponding to y1 and y2. d_outputs: A NestedMap: .split1 and .split2 corresponding

(self, theta, outputs, d_outputs, f_seed, g_seed,
                     *extra_inputs)

Source from the content-addressed store, hash-verified

source not stored for this graph (policy: none)

Callers 2

BakMethod · 0.80

testRevNetLayerReverseGradMethod · 0.80

Calls 3

PackMethod · 0.80

FPropMethod · 0.45

FlattenMethod · 0.45

Tested by 1

testRevNetLayerReverseGradMethod · 0.64