Method forward

models/rmsnorm.py:347–348 · view source on GitHub ↗

(self, x)

Source from the content-addressed store, hash-verified

345	)
346
347	def forward(self, x):
348	return self.w2(F.silu(self.w1(x)) * self.w3(x))
349
350
351	class TransformerBlock(nn.Module):

nothing calls this directly

no outgoing calls

no test coverage detected