MCPcopy Create free account
hub / github.com/MotrixLab/FineMoGen / __init__

Method __init__

mogen/models/transformers/finemogen.py:213–216  ·  view source on GitHub ↗
(self, ca_block_cfg=None, ffn_cfg=None)

Source from the content-addressed store, hash-verified

211class DecoderLayer(nn.Module):
212
213 def __init__(self, ca_block_cfg=None, ffn_cfg=None):
214 super().__init__()
215 self.ca_block = build_attention(ca_block_cfg)
216 self.ffn = SFFN(**ffn_cfg)
217
218 def forward(self, **kwargs):
219 if self.ca_block is not None:

Callers

nothing calls this directly

Calls 3

build_attentionFunction · 0.85
SFFNClass · 0.85
__init__Method · 0.45

Tested by

no test coverage detected