Method
__init__
(
self,
in_features: int,
out_features: int,
bias: bool = False, # paper: no bias
dtype: torch.dtype | None = None,
)
Source from the content-addressed store, hash-verified
| 101 | """ |
| 102 | |
| 103 | def __init__( |
| 104 | self, |
| 105 | in_features: int, |
| 106 | out_features: int, |
| 107 | bias: bool = False, # paper: no bias |
| 108 | dtype: torch.dtype | None = None, |
| 109 | ) -> None: |
| 110 | super().__init__(in_features, out_features, bias=bias, dtype=dtype) |
| 111 | self.norm = _RMSNorm(in_features) |
| 112 | |
| 113 | # ------------------------------------------------------------------ |
| 114 | def forward(self, x: torch.Tensor) -> torch.Tensor: |
Callers
nothing calls this directly
Tested by
no test coverage detected