MCPcopy Create free account
hub / github.com/OpenDriveLab/ReSim / GEGLU

Class GEGLU

sat/sgm/modules/autoencoding/magvit2_pytorch.py:446–449  ·  view source on GitHub ↗

Source from the content-addressed store, hash-verified

444
445
446class GEGLU(Module):
447 def forward(self, x):
448 x, gate = x.chunk(2, dim=1)
449 return F.gelu(gate) * x
450
451
452class FeedForward(Module):

Callers 1

__init__Method · 0.70

Calls

no outgoing calls

Tested by

no test coverage detected