Function normalization

models/utils.py:122–128

Make a standard normalization layer. :param channels: number of input channels. :return: an nn.Module for normalization.

(channels)

def normalization(channels):
    """
    Make a standard normalization layer.
    :param channels: number of input channels.
    :return: an nn.Module for normalization.
    """
    return GroupNorm32(32, channels)


# PyTorch 1.7 has SiLU, but we support PyTorch 1.5.