MCPcopy Create free account

hub / github.com/JavisVerse/JavisGPT / types & classes

Types & classes115 in github.com/JavisVerse/JavisGPT

↓ 21 callersClassConversation
A class that keeps all conversation history.
javisgpt/conversation.py:26
↓ 9 callersClassQwen2RMSNorm
javisgpt/model/qwen2_5_vl/modeling_qwen2_5_vl.py:127
↓ 3 callersClassQwen2RMSNorm
javisgpt/model/qwen2_vl/modeling_qwen2_vl.py:442
↓ 2 callersClassHierarchicalCondMLP
interface/javisdit_interface.py:150
↓ 2 callersClassJavisDiTInterface
interface/javisdit_interface.py:184
↓ 2 callersClassMLP
javisgpt/model/blocks.py:192
↓ 2 callersClassPreprocessor
interface/javisdit_interface.py:34
↓ 2 callersClassQwen2VLRotaryEmbedding
javisgpt/model/qwen2_vl/modeling_qwen2_vl.py:107
↓ 2 callersClassQwen2VLVisionConfig
javisgpt/model/qwen2_vl/configuration_qwen2_vl.py:25
↓ 2 callersClassQwen2_5_VLRotaryEmbedding
javisgpt/model/qwen2_5_vl/modeling_qwen2_5_vl.py:567
↓ 2 callersClassStreamToLogger
Fake file-like stream object that redirects writes to a logger instance.
javisgpt/utils.py:81
↓ 2 callersClassTransformerEncoder
javisgpt/model/beats/backbone.py:26
↓ 1 callersClassAVSync
javisgpt/model/blocks.py:56
↓ 1 callersClassBEATs
javisgpt/model/beats/BEATs.py:69
↓ 1 callersClassBEATsConfig
javisgpt/model/beats/BEATs.py:24
↓ 1 callersClassDataCollatorForEvalDataset
javisgpt/eval/dataset.py:351
↓ 1 callersClassDataCollatorForSupervisedDataset
Collate examples for supervised fine-tuning.
javisgpt/train/train_audio_video.py:519
↓ 1 callersClassEmbeddingEMA
javisgpt/model/beats/quantizer.py:70
↓ 1 callersClassGLU_Linear
javisgpt/model/beats/modules.py:52
↓ 1 callersClassLLaVATrainer
javisgpt/train/llava_trainer.py:240
↓ 1 callersClassLazySupervisedDataset
javisgpt/train/train_audio_video.py:320
↓ 1 callersClassMultiHeadCrossAttention
javisgpt/model/blocks.py:484
↓ 1 callersClassMultiheadAttention
Multi-headed attention. See "Attention Is All You Need" for more details.
javisgpt/model/beats/backbone.py:281
↓ 1 callersClassNormEMAVectorQuantizer
javisgpt/model/beats/quantizer.py:131
↓ 1 callersClassPatchEmbed
javisgpt/model/qwen2_vl/modeling_qwen2_vl.py:275
↓ 1 callersClassPatchMerger
javisgpt/model/qwen2_vl/modeling_qwen2_vl.py:301
↓ 1 callersClassQwen2MLP
javisgpt/model/qwen2_5_vl/modeling_qwen2_5_vl.py:628
↓ 1 callersClassQwen2MLP
javisgpt/model/qwen2_vl/modeling_qwen2_vl.py:463
↓ 1 callersClassQwen2VLCausalLMOutputWithPast
Base class for Qwen2VL causal language model (or autoregressive) outputs. Args: loss (`torch.FloatTensor` of shape `(1,)`, *optional
javisgpt/model/qwen2_vl/modeling_qwen2_vl.py:69
↓ 1 callersClassQwen2VLDecoderLayer
javisgpt/model/qwen2_vl/modeling_qwen2_vl.py:837
↓ 1 callersClassQwen2VLModel
javisgpt/model/qwen2_vl/modeling_qwen2_vl.py:1055
↓ 1 callersClassQwen2VLVisionBlock
javisgpt/model/qwen2_vl/modeling_qwen2_vl.py:421
↓ 1 callersClassQwen2_5_VLCausalLMOutputWithPast
javisgpt/model/qwen2_5_vl/modular_qwen2_5_vl.py:402
↓ 1 callersClassQwen2_5_VLCausalLMOutputWithPast
Base class for Qwen2_5_VL causal language model (or autoregressive) outputs. Args: loss (`torch.FloatTensor` of shape `(1,)`, *optio
javisgpt/model/qwen2_5_vl/modeling_qwen2_5_vl.py:1398
↓ 1 callersClassQwen2_5_VLDecoderLayer
javisgpt/model/qwen2_5_vl/modeling_qwen2_5_vl.py:1015
↓ 1 callersClassQwen2_5_VLMLP
javisgpt/model/qwen2_5_vl/modular_qwen2_5_vl.py:121
↓ 1 callersClassQwen2_5_VLMLP
javisgpt/model/qwen2_5_vl/modeling_qwen2_5_vl.py:75
↓ 1 callersClassQwen2_5_VLModel
javisgpt/model/qwen2_5_vl/modeling_qwen2_5_vl.py:1103
↓ 1 callersClassQwen2_5_VLPatchMerger
javisgpt/model/qwen2_5_vl/modular_qwen2_5_vl.py:143
↓ 1 callersClassQwen2_5_VLPatchMerger
javisgpt/model/qwen2_5_vl/modeling_qwen2_5_vl.py:147
↓ 1 callersClassQwen2_5_VLVisionBlock
javisgpt/model/qwen2_5_vl/modular_qwen2_5_vl.py:204
↓ 1 callersClassQwen2_5_VLVisionBlock
javisgpt/model/qwen2_5_vl/modeling_qwen2_5_vl.py:334
↓ 1 callersClassQwen2_5_VisionPatchEmbed
javisgpt/model/qwen2_5_vl/modular_qwen2_5_vl.py:135
↓ 1 callersClassQwen2_5_VisionPatchEmbed
javisgpt/model/qwen2_5_vl/modeling_qwen2_5_vl.py:89
↓ 1 callersClassQwen2_5_VisionRotaryEmbedding
javisgpt/model/qwen2_5_vl/modular_qwen2_5_vl.py:139
↓ 1 callersClassQwen2_5_VisionRotaryEmbedding
javisgpt/model/qwen2_5_vl/modeling_qwen2_5_vl.py:115
↓ 1 callersClassSamePad
javisgpt/model/beats/modules.py:29
↓ 1 callersClassSwish
javisgpt/model/beats/modules.py:43
↓ 1 callersClassTransformerSentenceEncoderLayer
javisgpt/model/beats/backbone.py:156
↓ 1 callersClassVisionMlp
javisgpt/model/qwen2_vl/modeling_qwen2_vl.py:317
↓ 1 callersClassVisionRotaryEmbedding
javisgpt/model/qwen2_vl/modeling_qwen2_vl.py:263
ClassAVQADataset
javisgpt/eval/dataset.py:196
ClassAVSDDataset
javisgpt/eval/dataset.py:258
ClassActivityNetDataset
javisgpt/eval/dataset.py:75
ClassBiMultiHeadCrossAttention
javisgpt/model/blocks.py:219
ClassClothoAQADataset
javisgpt/eval/dataset.py:27
ClassDataArguments
javisgpt/train/train_audio_video.py:89
ClassFeatureSaver
javisgpt/utils.py:168
ClassGradMultiply
javisgpt/model/beats/modules.py:17
ClassJavisBenchDataset
javisgpt/eval/dataset.py:324
ClassJavisConfig
javisgpt/model/javisgpt_arch.py:62
ClassJavisGPTForConditionalGeneration
javisgpt/model/javisgpt_arch.py:81
ClassJavisProcessor
javisgpt/model/javisgpt_arch.py:73
ClassLengthGroupedSampler
r""" Sampler that samples indices in a way that groups together features of the dataset of roughly the same length while keeping a bit of rand
javisgpt/train/llava_trainer.py:196
ClassMVBenchDataset
javisgpt/eval/dataset.py:160
ClassModelArguments
javisgpt/train/train_audio_video.py:70
ClassModulator
javisgpt/model/blocks.py:209
ClassMusicAVQADataset
javisgpt/eval/dataset.py:254
ClassPerceptionDataset
javisgpt/eval/dataset.py:115
ClassQwen2VLAttention
Multi-headed attention from 'Attention Is All You Need' paper. Modified to use sliding window attention: Longformer and "Generating Long Sequ
javisgpt/model/qwen2_vl/modeling_qwen2_vl.py:490
ClassQwen2VLConfig
r""" This is the configuration class to store the configuration of a [`Qwen2VLModel`]. It is used to instantiate a Qwen2-VL model according to
javisgpt/model/qwen2_vl/configuration_qwen2_vl.py:57
ClassQwen2VLFlashAttention2
Qwen2VL flash attention module, following Qwen2VL attention module. This module inherits from `Qwen2VLAttention` as the weights of the module
javisgpt/model/qwen2_vl/modeling_qwen2_vl.py:610
ClassQwen2VLForConditionalGeneration
javisgpt/model/qwen2_vl/modeling_qwen2_vl.py:1417
ClassQwen2VLImageProcessor
r""" Constructs a Qwen2-VL image processor that dynamically resizes images based on the original images. Args: do_resize (`bool`, *op
javisgpt/model/qwen2_vl/image_processing_qwen2_vl.py:130
ClassQwen2VLPreTrainedModel
javisgpt/model/qwen2_vl/modeling_qwen2_vl.py:942
ClassQwen2VLProcessor
r""" Constructs a Qwen2-VL processor which wraps a Qwen2-VL image processor and a Qwen2 tokenizer into a single processor. [`Qwen2VLProcessor`
javisgpt/model/qwen2_vl/processing_qwen2_vl.py:44
ClassQwen2VLProcessorKwargs
javisgpt/model/processing_model.py:36
ClassQwen2VLProcessorKwargs
javisgpt/model/qwen2_vl/processing_qwen2_vl.py:36
ClassQwen2VLSdpaAttention
Qwen2 attention module using torch.nn.functional.scaled_dot_product_attention. This module inherits from `Qwen2Attention` as the weights of t
javisgpt/model/qwen2_vl/modeling_qwen2_vl.py:731
ClassQwen2VisionTransformerPretrainedModel
javisgpt/model/qwen2_vl/modeling_qwen2_vl.py:965
ClassQwen2_5_VLAttention
Multi-headed attention from 'Attention Is All You Need' paper. Modified to use sliding window attention: Longformer and "Generating Long Sequ
javisgpt/model/qwen2_5_vl/modeling_qwen2_5_vl.py:701
ClassQwen2_5_VLConfig
javisgpt/model/qwen2_5_vl/modular_qwen2_5_vl.py:116
ClassQwen2_5_VLConfig
r""" This is the configuration class to store the configuration of a [`Qwen2_5_VLModel`]. It is used to instantiate a Qwen2-VL model according
javisgpt/model/qwen2_5_vl/configuration_qwen2_5_vl.py:68
ClassQwen2_5_VLFlashAttention2
Qwen2_5_VL flash attention module, following Qwen2_5_VL attention module. This module inherits from `Qwen2_5_VLAttention` as the weights of t
javisgpt/model/qwen2_5_vl/modeling_qwen2_5_vl.py:806
ClassQwen2_5_VLForConditionalGeneration
javisgpt/model/qwen2_5_vl/modular_qwen2_5_vl.py:406
ClassQwen2_5_VLForConditionalGeneration
javisgpt/model/qwen2_5_vl/modeling_qwen2_5_vl.py:1512
ClassQwen2_5_VLModel
javisgpt/model/qwen2_5_vl/modular_qwen2_5_vl.py:397
ClassQwen2_5_VLPreTrainedModel
javisgpt/model/qwen2_5_vl/modular_qwen2_5_vl.py:231
ClassQwen2_5_VLPreTrainedModel
javisgpt/model/qwen2_5_vl/modeling_qwen2_5_vl.py:382
ClassQwen2_5_VLProcessor
r""" Constructs a Qwen2.5-VL processor which wraps a Qwen2.5-VL image processor and a Qwen2 tokenizer into a single processor. [`Qwen2_5_VLPro
javisgpt/model/qwen2_5_vl/modular_qwen2_5_vl.py:870
ClassQwen2_5_VLProcessor
r""" Constructs a Qwen2.5-VL processor which wraps a Qwen2.5-VL image processor and a Qwen2 tokenizer into a single processor. [`Qwen2_5_VLPro
javisgpt/model/qwen2_5_vl/processing_qwen2_5_vl.py:48
ClassQwen2_5_VLProcessorKwargs
javisgpt/model/qwen2_5_vl/modular_qwen2_5_vl.py:860
ClassQwen2_5_VLProcessorKwargs
javisgpt/model/qwen2_5_vl/processing_qwen2_5_vl.py:38
ClassQwen2_5_VLSdpaAttention
Qwen2 attention module using torch.nn.functional.scaled_dot_product_attention. This module inherits from `Qwen2Attention` as the weights of t
javisgpt/model/qwen2_5_vl/modeling_qwen2_5_vl.py:917
ClassQwen2_5_VLVideosProcessorKwargs
javisgpt/model/qwen2_5_vl/modular_qwen2_5_vl.py:856
ClassQwen2_5_VLVideosProcessorKwargs
javisgpt/model/qwen2_5_vl/processing_qwen2_5_vl.py:34
ClassQwen2_5_VLVisionAttention
javisgpt/model/qwen2_5_vl/modular_qwen2_5_vl.py:189
ClassQwen2_5_VLVisionAttention
javisgpt/model/qwen2_5_vl/modeling_qwen2_5_vl.py:234
ClassQwen2_5_VLVisionConfig
javisgpt/model/qwen2_5_vl/modular_qwen2_5_vl.py:78
ClassQwen2_5_VLVisionConfig
javisgpt/model/qwen2_5_vl/configuration_qwen2_5_vl.py:30
next →1–100 of 115, ranked by callers