A class that keeps all conversation history.

Causal 3d convolusion.

Sampler class for the transport model

Computes and stores the average and current value

Subclass torch's LayerNorm to handle fp16.

Causal self-attention with a single head.

Computes and stores the average and current value

Transformer decoder consisting of *config.num_hidden_layers* layers. Each layer is a [`Qwen2DecoderLayer`] Args: config: Qwen2Config

2D Image to Patch Embedding

Transformer decoder consisting of *config.num_hidden_layers* layers. Each layer is a [`PhiDecoderLayer`] Args: config: PhiConfig

Transformer encoder consisting of `config.num_hidden_layers` self attention layers. Each layer is a [`SiglipEncoderLayer`]. Args:

Fake file-like stream object that redirects writes to a logger instance.

Dataset for Visual Story Telling (VIST) with interleaved image-text pairs.

ODE solver class

Dummy tqdm which doesn't do anything.

Dummy tqdm which doesn't do anything.

The final layer of DiT.

Dataset for loading imagenet.

Dataset for loading image-text pairs.

PhiRotaryEmbedding extended with Dynamic NTK scaling. Credits to the Reddit users /u/bloc97 and /u/emozilla

PhiRotaryEmbedding extended with linear scaling. Credits to the Reddit user /u/kaiokendev

Multihead Attention Pooling.

Args: loss (`torch.FloatTensor` of shape `(1,)`, *optional*, returned when `return_loss` is `True`): Contrastive loss for ima

Embeds scalar timesteps into vector representations.

SDE solver class

Multi-headed attention from 'Attention Is All You Need' paper

Exponential Moving Average of models weights

The final layer of DiT.

Linear Coupling Plan

r""" A subclass of `ModelMixin` to resolve class mapping from legacy classes (like `Transformer2DModel`) to more pipeline-specific classes (li

r""" A subclass of `ModelMixin` to resolve class mapping from legacy classes (like `Transformer2DModel`) to more pipeline-specific classes (li

r"""Implements Lion algorithm.

r""" Base class for all models. [`ModelMixin`] takes care of storing the model configuration and provides methods for loading, downloading an

r""" Base class for all models. [`ModelMixin`] takes care of storing the model configuration and provides methods for loading, downloading an