MCPcopy Create free account
hub / github.com/UX-Decoder/Semantic-SAM / QuickGELU

Class QuickGELU

semantic_sam/language/LangEncoder/transformer.py:39–41  ·  view source on GitHub ↗

Source from the content-addressed store, hash-verified

37
38
39class QuickGELU(nn.Module):
40 def forward(self, x: torch.Tensor):
41 return x * torch.sigmoid(1.702 * x)
42
43
44class ResidualAttentionBlock(nn.Module):

Callers 1

__init__Method · 0.85

Calls

no outgoing calls

Tested by

no test coverage detected