MCPcopy Create free account
hub / github.com/OpenImagingLab/FlashVSR / GELU

Class GELU

diffsynth/models/wan_video_text_encoder.py:15–19  ·  view source on GitHub ↗

Source from the content-addressed store, hash-verified

13
14
15class GELU(nn.Module):
16
17 def forward(self, x):
18 return 0.5 * x * (1.0 + torch.tanh(
19 math.sqrt(2.0 / math.pi) * (x + 0.044715 * torch.pow(x, 3.0))))
20
21
22class T5LayerNorm(nn.Module):

Callers 1

__init__Method · 0.70

Calls

no outgoing calls

Tested by

no test coverage detected