MCPcopy Create free account
hub / github.com/kyegomez/BitNet / __post_init__

Method __post_init__

bitnet/bit_mamba.py:160–164  ·  view source on GitHub ↗
(self)

Source from the content-addressed store, hash-verified

158 pscan: bool = True # use parallel scan mode or sequential mode when training
159
160 def __post_init__(self):
161 self.d_inner = self.expand_factor * self.dim # E*D = ED in comments
162
163 if self.dt_rank == "auto":
164 self.dt_rank = math.ceil(self.dim / 16)
165
166
167class ResidualBlock(nn.Module):

Callers

nothing calls this directly

Calls

no outgoing calls

Tested by

no test coverage detected