A class that manages prompt templates and keeps all conversation history.

Transformer decoder consisting of *config.num_hidden_layers* layers. Each layer is a [`Qwen2DecoderLayer`] Args: config: Qwen2Config

r""" Extend from BatchFeature for supporting various image size

A fluid interface wrapper for DataPipline that returns image embedding pairs Reads embeddings as npy files from the webdataset if they exist.

A fluid interface wrapper for DataPipline that returns image embedding pairs Reads embeddings as npy files from the webdataset if they exist.

A fluid interface wrapper for DataPipline that returns image embedding pairs Reads embeddings as npy files from the webdataset if they exist.

A fluid interface wrapper for DataPipline that returns image embedding pairs Reads embeddings as npy files from the webdataset if they exist.

Transformer decoder consisting of *config.num_hidden_layers* layers. Each layer is a [`InternLM2DecoderLayer`] Args: config: InternL

r""" This is the configuration class to store the configuration of a [`SiglipVisionModel`]. It is used to instantiate a Siglip vision encoder

A conditional text-to-speech model that can generate speech from text with speaker conditioning. This model extends PreTrainedModel to provide te

Output class for ConditionalChatTTS generation. Args: new_ids (torch.LongTensor): Newly generated audio code sequence, shape (batch_

Implement the scaled dot product attention with softmax. Arguments --------- softmax_scale: The temperature to use for the softmax att

r""" A Transformer block following the MMDiT architecture, introduced in Stable Diffusion 3. Reference: https://arxiv.org/abs/2403.03206

r""" A Transformer block following the MMDiT architecture, introduced in Stable Diffusion 3. Reference: https://arxiv.org/abs/2403.03206

Multi-headed attention from 'Attention Is All You Need' paper

r""" This is the configuration class to store the configuration of a [`InternLM2Model`]. It is used to instantiate an InternLM2 model accordin

InternLM2RotaryEmbedding extended with Dynamic NTK scaling. Credits to the Reddit users /u/bloc97 and /u/emozilla.

InternLM2RotaryEmbedding extended with linear scaling. Credits to the Reddit user /u/kaiokendev

r""" This is the configuration class to store the configuration of a [`InternVisionModel`]. It is used to instantiate a vision encoder accordi

Transformer encoder consisting of `config.num_hidden_layers` self attention layers. Each layer is a [`InternEncoderLayer`]. Args:

r""" A helper class to ensure text-to-speech (TTS) systems read numeric digits in the desired language (Chinese or English) digit-by-digit. It

A 2D perceiver-resampler network with one cross attention layers by given learnable queries and 2d sincos pos_emb Outputs: A t

Multi-headed attention from 'Attention Is All You Need' paper

Transformer encoder consisting of `config.num_hidden_layers` self attention layers. Each layer is a [`SiglipEncoderLayer`]. Args:

Llama flash attention module. This module inherits from `LlamaAttention` as the weights of the module stays untouched. The only required chan

r""" A simple utility class to detect silence or low variation in consecutive audio chunks by comparing the mel-spectrogram distances. It keep

The output of [`ControlNetModel`]. Args: down_block_res_samples (`tuple[torch.Tensor]`): A tuple of downsample activatio

The Transformer model introduced in Flux. Reference: https://blackforestlabs.ai/announcing-black-forest-labs/ Parameters: patch

Multi-headed attention from 'Attention Is All You Need' paper

InternLM2 flash attention module. This module inherits from `InternLM2Attention` as the weights of the module stays untouched. The only requi

r""" Constructs a MiniCPMV processor which wraps a MiniCPMV image processor and a MiniCPMV tokenizer into a single processor. [`MiniCPMVProce