Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/JavisVerse/JavisGPT
/ types & classes
Types & classes
115 in github.com/JavisVerse/JavisGPT
⨍
Functions
412
◇
Types & classes
115
↳
Endpoints
2
↓ 21 callers
Class
Conversation
A class that keeps all conversation history.
javisgpt/conversation.py:26
↓ 9 callers
Class
Qwen2RMSNorm
javisgpt/model/qwen2_5_vl/modeling_qwen2_5_vl.py:127
↓ 3 callers
Class
Qwen2RMSNorm
javisgpt/model/qwen2_vl/modeling_qwen2_vl.py:442
↓ 2 callers
Class
HierarchicalCondMLP
interface/javisdit_interface.py:150
↓ 2 callers
Class
JavisDiTInterface
interface/javisdit_interface.py:184
↓ 2 callers
Class
MLP
javisgpt/model/blocks.py:192
↓ 2 callers
Class
Preprocessor
interface/javisdit_interface.py:34
↓ 2 callers
Class
Qwen2VLRotaryEmbedding
javisgpt/model/qwen2_vl/modeling_qwen2_vl.py:107
↓ 2 callers
Class
Qwen2VLVisionConfig
javisgpt/model/qwen2_vl/configuration_qwen2_vl.py:25
↓ 2 callers
Class
Qwen2_5_VLRotaryEmbedding
javisgpt/model/qwen2_5_vl/modeling_qwen2_5_vl.py:567
↓ 2 callers
Class
StreamToLogger
Fake file-like stream object that redirects writes to a logger instance.
javisgpt/utils.py:81
↓ 2 callers
Class
TransformerEncoder
javisgpt/model/beats/backbone.py:26
↓ 1 callers
Class
AVSync
javisgpt/model/blocks.py:56
↓ 1 callers
Class
BEATs
javisgpt/model/beats/BEATs.py:69
↓ 1 callers
Class
BEATsConfig
javisgpt/model/beats/BEATs.py:24
↓ 1 callers
Class
DataCollatorForEvalDataset
javisgpt/eval/dataset.py:351
↓ 1 callers
Class
DataCollatorForSupervisedDataset
Collate examples for supervised fine-tuning.
javisgpt/train/train_audio_video.py:519
↓ 1 callers
Class
EmbeddingEMA
javisgpt/model/beats/quantizer.py:70
↓ 1 callers
Class
GLU_Linear
javisgpt/model/beats/modules.py:52
↓ 1 callers
Class
LLaVATrainer
javisgpt/train/llava_trainer.py:240
↓ 1 callers
Class
LazySupervisedDataset
javisgpt/train/train_audio_video.py:320
↓ 1 callers
Class
MultiHeadCrossAttention
javisgpt/model/blocks.py:484
↓ 1 callers
Class
MultiheadAttention
Multi-headed attention. See "Attention Is All You Need" for more details.
javisgpt/model/beats/backbone.py:281
↓ 1 callers
Class
NormEMAVectorQuantizer
javisgpt/model/beats/quantizer.py:131
↓ 1 callers
Class
PatchEmbed
javisgpt/model/qwen2_vl/modeling_qwen2_vl.py:275
↓ 1 callers
Class
PatchMerger
javisgpt/model/qwen2_vl/modeling_qwen2_vl.py:301
↓ 1 callers
Class
Qwen2MLP
javisgpt/model/qwen2_5_vl/modeling_qwen2_5_vl.py:628
↓ 1 callers
Class
Qwen2MLP
javisgpt/model/qwen2_vl/modeling_qwen2_vl.py:463
↓ 1 callers
Class
Qwen2VLCausalLMOutputWithPast
Base class for Qwen2VL causal language model (or autoregressive) outputs. Args: loss (`torch.FloatTensor` of shape `(1,)`, *optional
javisgpt/model/qwen2_vl/modeling_qwen2_vl.py:69
↓ 1 callers
Class
Qwen2VLDecoderLayer
javisgpt/model/qwen2_vl/modeling_qwen2_vl.py:837
↓ 1 callers
Class
Qwen2VLModel
javisgpt/model/qwen2_vl/modeling_qwen2_vl.py:1055
↓ 1 callers
Class
Qwen2VLVisionBlock
javisgpt/model/qwen2_vl/modeling_qwen2_vl.py:421
↓ 1 callers
Class
Qwen2_5_VLCausalLMOutputWithPast
javisgpt/model/qwen2_5_vl/modular_qwen2_5_vl.py:402
↓ 1 callers
Class
Qwen2_5_VLCausalLMOutputWithPast
Base class for Qwen2_5_VL causal language model (or autoregressive) outputs. Args: loss (`torch.FloatTensor` of shape `(1,)`, *optio
javisgpt/model/qwen2_5_vl/modeling_qwen2_5_vl.py:1398
↓ 1 callers
Class
Qwen2_5_VLDecoderLayer
javisgpt/model/qwen2_5_vl/modeling_qwen2_5_vl.py:1015
↓ 1 callers
Class
Qwen2_5_VLMLP
javisgpt/model/qwen2_5_vl/modular_qwen2_5_vl.py:121
↓ 1 callers
Class
Qwen2_5_VLMLP
javisgpt/model/qwen2_5_vl/modeling_qwen2_5_vl.py:75
↓ 1 callers
Class
Qwen2_5_VLModel
javisgpt/model/qwen2_5_vl/modeling_qwen2_5_vl.py:1103
↓ 1 callers
Class
Qwen2_5_VLPatchMerger
javisgpt/model/qwen2_5_vl/modular_qwen2_5_vl.py:143
↓ 1 callers
Class
Qwen2_5_VLPatchMerger
javisgpt/model/qwen2_5_vl/modeling_qwen2_5_vl.py:147
↓ 1 callers
Class
Qwen2_5_VLVisionBlock
javisgpt/model/qwen2_5_vl/modular_qwen2_5_vl.py:204
↓ 1 callers
Class
Qwen2_5_VLVisionBlock
javisgpt/model/qwen2_5_vl/modeling_qwen2_5_vl.py:334
↓ 1 callers
Class
Qwen2_5_VisionPatchEmbed
javisgpt/model/qwen2_5_vl/modular_qwen2_5_vl.py:135
↓ 1 callers
Class
Qwen2_5_VisionPatchEmbed
javisgpt/model/qwen2_5_vl/modeling_qwen2_5_vl.py:89
↓ 1 callers
Class
Qwen2_5_VisionRotaryEmbedding
javisgpt/model/qwen2_5_vl/modular_qwen2_5_vl.py:139
↓ 1 callers
Class
Qwen2_5_VisionRotaryEmbedding
javisgpt/model/qwen2_5_vl/modeling_qwen2_5_vl.py:115
↓ 1 callers
Class
SamePad
javisgpt/model/beats/modules.py:29
↓ 1 callers
Class
Swish
javisgpt/model/beats/modules.py:43
↓ 1 callers
Class
TransformerSentenceEncoderLayer
javisgpt/model/beats/backbone.py:156
↓ 1 callers
Class
VisionMlp
javisgpt/model/qwen2_vl/modeling_qwen2_vl.py:317
↓ 1 callers
Class
VisionRotaryEmbedding
javisgpt/model/qwen2_vl/modeling_qwen2_vl.py:263
Class
AVQADataset
javisgpt/eval/dataset.py:196
Class
AVSDDataset
javisgpt/eval/dataset.py:258
Class
ActivityNetDataset
javisgpt/eval/dataset.py:75
Class
BiMultiHeadCrossAttention
javisgpt/model/blocks.py:219
Class
ClothoAQADataset
javisgpt/eval/dataset.py:27
Class
DataArguments
javisgpt/train/train_audio_video.py:89
Class
FeatureSaver
javisgpt/utils.py:168
Class
GradMultiply
javisgpt/model/beats/modules.py:17
Class
JavisBenchDataset
javisgpt/eval/dataset.py:324
Class
JavisConfig
javisgpt/model/javisgpt_arch.py:62
Class
JavisGPTForConditionalGeneration
javisgpt/model/javisgpt_arch.py:81
Class
JavisProcessor
javisgpt/model/javisgpt_arch.py:73
Class
LengthGroupedSampler
r""" Sampler that samples indices in a way that groups together features of the dataset of roughly the same length while keeping a bit of rand
javisgpt/train/llava_trainer.py:196
Class
MVBenchDataset
javisgpt/eval/dataset.py:160
Class
ModelArguments
javisgpt/train/train_audio_video.py:70
Class
Modulator
javisgpt/model/blocks.py:209
Class
MusicAVQADataset
javisgpt/eval/dataset.py:254
Class
PerceptionDataset
javisgpt/eval/dataset.py:115
Class
Qwen2VLAttention
Multi-headed attention from 'Attention Is All You Need' paper. Modified to use sliding window attention: Longformer and "Generating Long Sequ
javisgpt/model/qwen2_vl/modeling_qwen2_vl.py:490
Class
Qwen2VLConfig
r""" This is the configuration class to store the configuration of a [`Qwen2VLModel`]. It is used to instantiate a Qwen2-VL model according to
javisgpt/model/qwen2_vl/configuration_qwen2_vl.py:57
Class
Qwen2VLFlashAttention2
Qwen2VL flash attention module, following Qwen2VL attention module. This module inherits from `Qwen2VLAttention` as the weights of the module
javisgpt/model/qwen2_vl/modeling_qwen2_vl.py:610
Class
Qwen2VLForConditionalGeneration
javisgpt/model/qwen2_vl/modeling_qwen2_vl.py:1417
Class
Qwen2VLImageProcessor
r""" Constructs a Qwen2-VL image processor that dynamically resizes images based on the original images. Args: do_resize (`bool`, *op
javisgpt/model/qwen2_vl/image_processing_qwen2_vl.py:130
Class
Qwen2VLPreTrainedModel
javisgpt/model/qwen2_vl/modeling_qwen2_vl.py:942
Class
Qwen2VLProcessor
r""" Constructs a Qwen2-VL processor which wraps a Qwen2-VL image processor and a Qwen2 tokenizer into a single processor. [`Qwen2VLProcessor`
javisgpt/model/qwen2_vl/processing_qwen2_vl.py:44
Class
Qwen2VLProcessorKwargs
javisgpt/model/processing_model.py:36
Class
Qwen2VLProcessorKwargs
javisgpt/model/qwen2_vl/processing_qwen2_vl.py:36
Class
Qwen2VLSdpaAttention
Qwen2 attention module using torch.nn.functional.scaled_dot_product_attention. This module inherits from `Qwen2Attention` as the weights of t
javisgpt/model/qwen2_vl/modeling_qwen2_vl.py:731
Class
Qwen2VisionTransformerPretrainedModel
javisgpt/model/qwen2_vl/modeling_qwen2_vl.py:965
Class
Qwen2_5_VLAttention
Multi-headed attention from 'Attention Is All You Need' paper. Modified to use sliding window attention: Longformer and "Generating Long Sequ
javisgpt/model/qwen2_5_vl/modeling_qwen2_5_vl.py:701
Class
Qwen2_5_VLConfig
javisgpt/model/qwen2_5_vl/modular_qwen2_5_vl.py:116
Class
Qwen2_5_VLConfig
r""" This is the configuration class to store the configuration of a [`Qwen2_5_VLModel`]. It is used to instantiate a Qwen2-VL model according
javisgpt/model/qwen2_5_vl/configuration_qwen2_5_vl.py:68
Class
Qwen2_5_VLFlashAttention2
Qwen2_5_VL flash attention module, following Qwen2_5_VL attention module. This module inherits from `Qwen2_5_VLAttention` as the weights of t
javisgpt/model/qwen2_5_vl/modeling_qwen2_5_vl.py:806
Class
Qwen2_5_VLForConditionalGeneration
javisgpt/model/qwen2_5_vl/modular_qwen2_5_vl.py:406
Class
Qwen2_5_VLForConditionalGeneration
javisgpt/model/qwen2_5_vl/modeling_qwen2_5_vl.py:1512
Class
Qwen2_5_VLModel
javisgpt/model/qwen2_5_vl/modular_qwen2_5_vl.py:397
Class
Qwen2_5_VLPreTrainedModel
javisgpt/model/qwen2_5_vl/modular_qwen2_5_vl.py:231
Class
Qwen2_5_VLPreTrainedModel
javisgpt/model/qwen2_5_vl/modeling_qwen2_5_vl.py:382
Class
Qwen2_5_VLProcessor
r""" Constructs a Qwen2.5-VL processor which wraps a Qwen2.5-VL image processor and a Qwen2 tokenizer into a single processor. [`Qwen2_5_VLPro
javisgpt/model/qwen2_5_vl/modular_qwen2_5_vl.py:870
Class
Qwen2_5_VLProcessor
r""" Constructs a Qwen2.5-VL processor which wraps a Qwen2.5-VL image processor and a Qwen2 tokenizer into a single processor. [`Qwen2_5_VLPro
javisgpt/model/qwen2_5_vl/processing_qwen2_5_vl.py:48
Class
Qwen2_5_VLProcessorKwargs
javisgpt/model/qwen2_5_vl/modular_qwen2_5_vl.py:860
Class
Qwen2_5_VLProcessorKwargs
javisgpt/model/qwen2_5_vl/processing_qwen2_5_vl.py:38
Class
Qwen2_5_VLSdpaAttention
Qwen2 attention module using torch.nn.functional.scaled_dot_product_attention. This module inherits from `Qwen2Attention` as the weights of t
javisgpt/model/qwen2_5_vl/modeling_qwen2_5_vl.py:917
Class
Qwen2_5_VLVideosProcessorKwargs
javisgpt/model/qwen2_5_vl/modular_qwen2_5_vl.py:856
Class
Qwen2_5_VLVideosProcessorKwargs
javisgpt/model/qwen2_5_vl/processing_qwen2_5_vl.py:34
Class
Qwen2_5_VLVisionAttention
javisgpt/model/qwen2_5_vl/modular_qwen2_5_vl.py:189
Class
Qwen2_5_VLVisionAttention
javisgpt/model/qwen2_5_vl/modeling_qwen2_5_vl.py:234
Class
Qwen2_5_VLVisionConfig
javisgpt/model/qwen2_5_vl/modular_qwen2_5_vl.py:78
Class
Qwen2_5_VLVisionConfig
javisgpt/model/qwen2_5_vl/configuration_qwen2_5_vl.py:30
next →
1–100 of 115, ranked by callers