MCPcopy Create free account
hub / github.com/tensorflow/lingvo / EncoderLayerStack

Method EncoderLayerStack

lingvo/core/gshard_builder.py:511–556  ·  view source on GitHub ↗

Clean EncoderLayerStack with minimal layer nesting. E.g:: encoder/ layer_000/ ln/w/ scale self_attention/w/ wq wk wv wo layer_001/ ... will be constructed with:: builder.

(self,
                        name,
                        sub_layers,
                        num=1,
                        use_repeat_layer=False,
                        spmd_pipeline_stages=1,
                        spmd_pipeline_microbatches=None)

Source from the content-addressed store, hash-verified

source not stored for this graph (policy: none)

Callers 3

__init__Method · 0.80
testLayerStackMethod · 0.80
testLayerStackSummaryMethod · 0.80

Calls 2

_LayerStackMethod · 0.95
EncoderLayerMethod · 0.95

Tested by 2

testLayerStackMethod · 0.64
testLayerStackSummaryMethod · 0.64