MCPcopy Create free account
hub / github.com/OpenSparseLLMs/Linear-MoE / MambaStackSubmodules

Class MambaStackSubmodules

linear_moe/sequence_modeling/ssm.py:67–70  ·  view source on GitHub ↗

Source from the content-addressed store, hash-verified

65
66@dataclass
67class MambaStackSubmodules:
68 mamba_layer: Union[ModuleSpec, type] = IdentityOp
69 attention_layer: Union[ModuleSpec, type] = IdentityOp
70 mlp_layer: Union[ModuleSpec, type] = IdentityOp
71
72
73class MambaStack(MegatronModule):

Callers 4

get_hybrid_mamba2_linear_moe_layer_local_specFunction · 0.90
get_hybrid_mamba2_linear_moe_layer_local_specFunction · 0.90
get_hybrid_mamba2_linear_moe_layer_local_specFunction · 0.90
get_hybrid_mamba2_linear_moe_layer_local_specFunction · 0.90

Calls

no outgoing calls

Tested by

no test coverage detected