MCPcopy Create free account
hub / github.com/TEA-Lab/TwoByTwo / forward

Method forward

src/shape_assembly/models/train/transformer.py:101–105  ·  view source on GitHub ↗
(self, x, memory, src_mask, tgt_mask)

Source from the content-addressed store, hash-verified

99 self.sublayer = clones(SublayerConnection(size), 3)
100
101 def forward(self, x, memory, src_mask, tgt_mask):
102 m = memory
103 x = self.sublayer[0](x, lambda x: self.self_attn(x, x, x, tgt_mask))
104 x = self.sublayer[1](x, lambda x: self.src_attn(x, m, m, src_mask))
105 return self.sublayer[2](x, self.feed_forward)
106
107class MultiHeadedAttention(pl.LightningModule):
108

Callers

nothing calls this directly

Calls

no outgoing calls

Tested by

no test coverage detected