A class that manages prompt templates and keeps all conversation history.

Transformer decoder consisting of *config.num_hidden_layers* layers. Each layer is a [`DeepseekV2DecoderLayer`] Args: config: Deepse

Vision Transformer A PyTorch impl of : `An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale` - https://arxiv.org/

r""" This is the configuration class to store the configuration of a [`DeepseekV2Model`]. It is used to instantiate an DeepSeek model accordin

DeepseekV2RotaryEmbedding extended with Dynamic NTK scaling. Credits to the Reddit users /u/bloc97 and /u/emozilla

DeepseekV2RotaryEmbedding extended with linear scaling. Credits to the Reddit user /u/kaiokendev

A mixed expert module containing shared experts.

The trick function of adding auxiliary (aux) loss, which includes the gradient of the aux loss during backpropagation.

Base class for DeepSeek-VL2 causal language model (or autoregressive) outputs. Args: loss (`torch.FloatTensor` of shape `(1,)`, *opt

Multi-headed attention from 'Attention Is All You Need' paper

DeepseekV2 flash attention module. This module inherits from `DeepseekV2Attention` as the weights of the module stays untouched. The only req

Separator styles.