Subclass torch's LayerNorm to handle fp16 (by casting to float32 and back).

Subclass torch's LayerNorm to handle fp16 (by casting to float32 and back).

A class that keeps all conversation history.

r""" This is the configuration class to store the configuration of a [`MplugOwlVisionModel`]. It is used to instantiate a mPLUG-Owl visio

A utility attention mask class that allows one to: - Create a causal 4d mask - Create a causal 4d mask with slided window

A class that keeps all conversation history.

Processes an answer similar to Eval AI copied from https://github.com/facebookresearch/mmf/blob/c46b3b3391275b4181567db80943473a8

r""" This is the configuration class to store the configuration of a [`LlamaModel`]. It is used to instantiate an LLaMA model according to the

r""" This is the configuration class to store the configuration of a [`MplugOwlVisionModel`]. It is used to instantiate a mPLUG-Owl vision en

r""" This is the configuration class to store the configuration of a [`MplugOwlVisionModel`]. It is used to instantiate a mPLUG-Owl visio

MultiModal dataset

Fake file-like stream object that redirects writes to a logger instance.

Collate examples for supervised fine-tuning.

Processes an answer similar to Eval AI copied from https://github.com/facebookresearch/mmf/blob/c46b3b3391275b4181567db80943473a8

Transforms a function that takes a callback into a lazy iterator (generator).

Dataset for supervised fine-tuning.

r""" Sampler that samples indices in a way that groups together features of the dataset of roughly the same length while keeping a bit of rand

Multi-headed attention from 'Attention Is All You Need' paper

Multi-headed attention from 'Attention Is All You Need' paper

Multi-headed attention from 'Attention Is All You Need' paper

Multi-headed attention from 'Attention Is All You Need' paper

Transformer encoder consisting of `config.num_hidden_layers` self attention layers. Each layer is a [`MplugOwlVisionEncoderLayer`]. Args

Transformer encoder consisting of `config.num_hidden_layers` self attention layers. Each layer is a [`MplugOwlVisionEncoderLayer`]. Args

Transformer encoder consisting of `config.num_hidden_layers` self attention layers. Each layer is a [`MplugOwlVisionEncoderLayer`]. Args

Mixed IO module to support both system-level and OSS IO methods