A sequential module that passes timestep embeddings to the children that support it as an extra input.

A residual block that can optionally change the number of channels. :param channels: the number of input channels. :param emb_channels: t

Normlize image by given mean and std.

An attention block that allows spatial positions to attend to each other. Originally ported from here, but adapted to the N-d case. https

Feature fusion block.

Transformer block for image-like data. First, project the input (aka embedding) and reshape to b, t, d. Then apply standard transform

A downsampling layer with an optional convolution. :param channels: channels in the inputs and outputs. :param use_conv: a bool determini

Feature fusion block.

Apply Gaussian Blur to the PIL image.

Interpolation module.

An upsampling layer with an optional convolution. :param channels: channels in the inputs and outputs. :param use_conv: a bool determinin

Drop paths (Stochastic Depth) per sample (when applied in main path of residual blocks).

Convert a ``PIL Image`` or ``numpy.ndarray`` to tensor, or keep as is if already a tensor.

Prepare sample for usage as network input.

A module which performs QKV attention and splits in a different order.

Residual convolution module.

Residual convolution module.

Resize sample to given size (width, height).

Track a series of values and provide access to smoothed values over a window or the global series average.

Uses the CLIP transformer encoder for text (from huggingface)

Uses the T5 transformer encoder for text

Kozachenko-Leonenko entropic loss regularizer from Sablayrolles et al. - 2018 - Spreading vectors for similarity search

Lite R-ASPP

Linear layer to train on top of frozen features

Uses xformers efficient implementation, see https://github.com/MatthieuTPHR/diffusers/blob/d80b531ff8060ec1ea982b65a1b8df70f73aa67c/s

Network for monocular depth estimation.

Network for monocular depth estimation.

A module which performs QKV attention. Matches legacy QKVAttention + input/ouput heads shaping