MCPcopy Create free account
hub / github.com/tensorflow/lingvo / EncoderLayer

Method EncoderLayer

lingvo/core/gshard_builder.py:488–503  ·  view source on GitHub ↗

Returns params for lambda x: x + residual_weight * DropOut(layer(LN(x))).

(self, name, layer, residual_weight=1.0)

Source from the content-addressed store, hash-verified

source not stored for this graph (policy: none)

Callers 3

EncoderLayerStackMethod · 0.95
__init__Method · 0.80
_ConfigFFLayerOrMoEParamsMethod · 0.80

Calls 5

MaskMethod · 0.95
_LNMethod · 0.95
_DropoutMethod · 0.95
_AddMethod · 0.95
_GraphMethod · 0.80

Tested by

no test coverage detected