MCPcopy Create free account
hub / github.com/Francis-Rings/FlashPortrait / QuickGELU

Class QuickGELU

wan/models/wan_image_encoder.py:43–46  ·  view source on GitHub ↗

Source from the content-addressed store, hash-verified

41
42
43class QuickGELU(nn.Module):
44
45 def forward(self, x):
46 return x * torch.sigmoid(1.702 * x)
47
48
49class LayerNorm(nn.LayerNorm):

Callers 2

__init__Method · 0.85
__init__Method · 0.85

Calls

no outgoing calls

Tested by

no test coverage detected