Class LayerNorm

wan/modules/clip.py:47–50 · view source on GitHub ↗

Source from the content-addressed store, hash-verified

45
46
47	class LayerNorm(nn.LayerNorm):
48
49	def forward(self, x):
50	return super().forward(x.float()).type_as(x)
51
52
53	class SelfAttention(nn.Module):

__init__Method · 0.70

no outgoing calls

no test coverage detected