MCPcopy Create free account
hub / github.com/YunwenTechnology/QueryGeneration / gelu

Function gelu

train/utils.py:85–98  ·  view source on GitHub ↗

Gaussian Error Linear Unit. This is a smoother version of the RELU. Original paper: https://arxiv.org/abs/1606.08415 Args: input_tensor: float Tensor to perform activation. Returns: `input_tensor` with the GELU activation applied.

(input_tensor)

Source from the content-addressed store, hash-verified

source not stored for this graph (policy: none)

Callers

nothing calls this directly

Calls

no outgoing calls

Tested by

no test coverage detected