A residual block that can optionally change the number of channels. :param channels: the number of input channels. :param emb_channels: t

A sequential module that passes timestep embeddings to the children that support it as an extra input.

https://github.com/evelinehong/Transformer_Relative_Position_PyTorch/blob/master/relative_position.py

Transformer block for image-like data in temporal axis. First, reshape to b, t, d. Then apply standard transformer action. Finally, r

A downsampling layer with an optional convolution. :param channels: channels in the inputs and outputs. :param use_conv: a bool determini

Transformer block for image-like data in spatial axis. First, project the input (aka embedding) and reshape to b, t, d. Then apply st

An upsampling layer with an optional convolution. :param channels: channels in the inputs and outputs. :param use_conv: a bool determinin

A module which performs QKV attention and splits in a different order.

A module which performs QKV attention. Matches legacy QKVAttention + input/ouput heads shaping

https://github.com/evelinehong/Transformer_Relative_Position_PyTorch/blob/master/relative_position.py

A downsampling layer with an optional convolution. :param channels: channels in the inputs and outputs. :param use_conv: a bool determini

Uses the CLIP transformer encoder for text (from huggingface)

Uses the T5 transformer encoder for text

to match AttnBlock usage

Uses the OpenCLIP transformer encoder for text

Uses the OpenCLIP vision transformer encoder for images

main class

Transformer block for video-like data (5D tensor). First, project the input (aka embedding) with NO reshape. Then apply standard transfor

Any module where forward() takes timestep embeddings as a second argument.

The full UNet model with attention and timestep embedding. :param in_channels: in_channels in the input Tensor. :param model_channels: ba