MCPcopy Create free account

hub / github.com/OSU-NLP-Group/In-Context-Reranking / types & classes

Types & classes25 in github.com/OSU-NLP-Group/In-Context-Reranking

↓ 3 callersClassLlamaRMSNorm
src/custom/custom_modeling_llama.py:126
↓ 3 callersClassMistralRMSNorm
src/custom/custom_modeling_mistral.py:65
↓ 2 callersClassLlamaRotaryEmbedding
src/custom/custom_modeling_llama.py:149
↓ 1 callersClassDynamicCacheWithQuery
Cache class used for In-context RAG
src/custom/custom_cache.py:5
↓ 1 callersClassInContextReranker
src/in_context_reranker.py:14
↓ 1 callersClassLlamaDecoderLayer
src/custom/custom_modeling_llama.py:718
↓ 1 callersClassLlamaMLP
src/custom/custom_modeling_llama.py:295
↓ 1 callersClassLlamaModel
Transformer decoder consisting of *config.num_hidden_layers* layers. Each layer is a [`LlamaDecoderLayer`] Args: config: LlamaConfig
src/custom/custom_modeling_llama.py:921
↓ 1 callersClassMistralDecoderLayer
src/custom/custom_modeling_mistral.py:526
↓ 1 callersClassMistralMLP
src/custom/custom_modeling_mistral.py:150
↓ 1 callersClassMistralModel
Transformer decoder consisting of *config.num_hidden_layers* layers. Each layer is a [`MistralDecoderLayer`] Args: config: MistralCo
src/custom/custom_modeling_mistral.py:719
↓ 1 callersClassMistralRotaryEmbedding
src/custom/custom_modeling_mistral.py:85
↓ 1 callersClassRankGPTModel
src/rank_gpt_reranker.py:11
ClassLlamaAttention
Multi-headed attention from 'Attention Is All You Need' paper
src/custom/custom_modeling_llama.py:341
ClassLlamaDynamicNTKScalingRotaryEmbedding
LlamaRotaryEmbedding extended with Dynamic NTK scaling. Credits to the Reddit users /u/bloc97 and /u/emozilla
src/custom/custom_modeling_llama.py:248
ClassLlamaFlashAttention2
Llama flash attention module. This module inherits from `LlamaAttention` as the weights of the module stays untouched. The only required chan
src/custom/custom_modeling_llama.py:480
ClassLlamaForCausalLM
src/custom/custom_modeling_llama.py:1145
ClassLlamaLinearScalingRotaryEmbedding
LlamaRotaryEmbedding extended with linear scaling. Credits to the Reddit user /u/kaiokendev
src/custom/custom_modeling_llama.py:236
ClassLlamaPreTrainedModel
src/custom/custom_modeling_llama.py:819
ClassLlamaSdpaAttention
Llama attention module using torch.nn.functional.scaled_dot_product_attention. This module inherits from `LlamaAttention` as the weights of t
src/custom/custom_modeling_llama.py:612
ClassMistralAttention
Multi-headed attention from 'Attention Is All You Need' paper. Modified to use sliding window attention: Longformer and "Generating Long Sequ
src/custom/custom_modeling_mistral.py:177
ClassMistralFlashAttention2
Mistral flash attention module. This module inherits from `MistralAttention` as the weights of the module stays untouched. The only required
src/custom/custom_modeling_mistral.py:281
ClassMistralForCausalLM
src/custom/custom_modeling_mistral.py:977
ClassMistralPreTrainedModel
src/custom/custom_modeling_mistral.py:622
ClassMistralSdpaAttention
Mistral attention module using torch.nn.functional.scaled_dot_product_attention. This module inherits from `MistralAttention` as the weights
src/custom/custom_modeling_mistral.py:429