MCPcopy Create free account

hub / github.com/PKU-YuanGroup/Video-LLaVA / types & classes

Types & classes125 in github.com/PKU-YuanGroup/Video-LLaVA

↓ 11 callersClassConversation
A class that keeps all conversation history.
videollava/conversation.py:16
↓ 9 callersClassKeywordsStoppingCriteria
videollava/mm_utils.py:73
↓ 4 callersClassEvalAIAnswerProcessor
Processes an answer similar to Eval AI copied from https://github.com/facebookresearch/mmf/blob/c46b3b3391275b4181567db80943473a8
videollava/eval/m4c_evaluator.py:7
↓ 2 callersClassCLIPEncoder
Transformer encoder consisting of `config.num_hidden_layers` self attention layers. Each layer is a [`CLIPEncoderLayer`]. Args:
videollava/model/multimodal_encoder/languagebind/image/modeling_image.py:337
↓ 2 callersClassCLIPEncoder
Transformer encoder consisting of `config.num_hidden_layers` self attention layers. Each layer is a [`CLIPEncoderLayer`]. Args:
videollava/model/multimodal_encoder/languagebind/audio/modeling_audio.py:337
↓ 2 callersClassCLIPEncoder
Transformer encoder consisting of `config.num_hidden_layers` self attention layers. Each layer is a [`CLIPEncoderLayer`]. Args:
videollava/model/multimodal_encoder/languagebind/depth/modeling_depth.py:337
↓ 2 callersClassCLIPEncoder
Transformer encoder consisting of `config.num_hidden_layers` self attention layers. Each layer is a [`CLIPEncoderLayer`]. Args:
videollava/model/multimodal_encoder/languagebind/thermal/modeling_thermal.py:337
↓ 2 callersClassCLIPEncoder
Transformer encoder consisting of `config.num_hidden_layers` self attention layers. Each layer is a [`CLIPEncoderLayer`]. Args:
videollava/model/multimodal_encoder/languagebind/video/modeling_video.py:337
↓ 2 callersClassCLIPTextConfig
r""" This is the configuration class to store the configuration of a [`CLIPTextModel`]. It is used to instantiate a CLIP text encoder accordin
videollava/model/multimodal_encoder/languagebind/image/configuration_image.py:16
↓ 2 callersClassCLIPTextConfig
r""" This is the configuration class to store the configuration of a [`CLIPTextModel`]. It is used to instantiate a CLIP text encoder accordin
videollava/model/multimodal_encoder/languagebind/audio/configuration_audio.py:16
↓ 2 callersClassCLIPTextConfig
r""" This is the configuration class to store the configuration of a [`CLIPTextModel`]. It is used to instantiate a CLIP text encoder accordin
videollava/model/multimodal_encoder/languagebind/depth/configuration_depth.py:16
↓ 2 callersClassCLIPTextConfig
r""" This is the configuration class to store the configuration of a [`CLIPTextModel`]. It is used to instantiate a CLIP text encoder accordin
videollava/model/multimodal_encoder/languagebind/thermal/configuration_thermal.py:16
↓ 2 callersClassCLIPTextConfig
r""" This is the configuration class to store the configuration of a [`CLIPTextModel`]. It is used to instantiate a CLIP text encoder accordin
videollava/model/multimodal_encoder/languagebind/video/configuration_video.py:16
↓ 2 callersClassCLIPTextTransformer
videollava/model/multimodal_encoder/languagebind/image/modeling_image.py:458
↓ 2 callersClassCLIPTextTransformer
videollava/model/multimodal_encoder/languagebind/audio/modeling_audio.py:458
↓ 2 callersClassCLIPTextTransformer
videollava/model/multimodal_encoder/languagebind/depth/modeling_depth.py:458
↓ 2 callersClassCLIPTextTransformer
videollava/model/multimodal_encoder/languagebind/thermal/modeling_thermal.py:458
↓ 2 callersClassCLIPTextTransformer
videollava/model/multimodal_encoder/languagebind/video/modeling_video.py:458
↓ 2 callersClassCLIPVisionConfig
r""" This is the configuration class to store the configuration of a [`CLIPVisionModel`]. It is used to instantiate a CLIP vision encoder acco
videollava/model/multimodal_encoder/languagebind/image/configuration_image.py:128
↓ 2 callersClassCLIPVisionConfig
r""" This is the configuration class to store the configuration of a [`CLIPVisionModel`]. It is used to instantiate a CLIP vision encoder acco
videollava/model/multimodal_encoder/languagebind/audio/configuration_audio.py:128
↓ 2 callersClassCLIPVisionConfig
r""" This is the configuration class to store the configuration of a [`CLIPVisionModel`]. It is used to instantiate a CLIP vision encoder acco
videollava/model/multimodal_encoder/languagebind/depth/configuration_depth.py:128
↓ 2 callersClassCLIPVisionConfig
r""" This is the configuration class to store the configuration of a [`CLIPVisionModel`]. It is used to instantiate a CLIP vision encoder acco
videollava/model/multimodal_encoder/languagebind/thermal/configuration_thermal.py:128
↓ 2 callersClassCLIPVisionConfig
r""" This is the configuration class to store the configuration of a [`CLIPVisionModel`]. It is used to instantiate a CLIP vision encoder acco
videollava/model/multimodal_encoder/languagebind/video/configuration_video.py:128
↓ 2 callersClassCLIPVisionTransformer
videollava/model/multimodal_encoder/languagebind/image/modeling_image.py:596
↓ 2 callersClassCLIPVisionTransformer
videollava/model/multimodal_encoder/languagebind/audio/modeling_audio.py:596
↓ 2 callersClassCLIPVisionTransformer
videollava/model/multimodal_encoder/languagebind/depth/modeling_depth.py:596
↓ 2 callersClassCLIPVisionTransformer
videollava/model/multimodal_encoder/languagebind/thermal/modeling_thermal.py:596
↓ 2 callersClassCLIPVisionTransformer
videollava/model/multimodal_encoder/languagebind/video/modeling_video.py:596
↓ 2 callersClassStreamToLogger
Fake file-like stream object that redirects writes to a logger instance.
videollava/utils.py:75
↓ 1 callersClassAudioTransform
videollava/model/multimodal_encoder/languagebind/audio/processing_audio.py:31
↓ 1 callersClassCLIPEncoderLayer
videollava/model/multimodal_encoder/languagebind/image/modeling_image.py:65
↓ 1 callersClassCLIPEncoderLayer
videollava/model/multimodal_encoder/languagebind/audio/modeling_audio.py:65
↓ 1 callersClassCLIPEncoderLayer
videollava/model/multimodal_encoder/languagebind/depth/modeling_depth.py:65
↓ 1 callersClassCLIPEncoderLayer
videollava/model/multimodal_encoder/languagebind/thermal/modeling_thermal.py:65
↓ 1 callersClassCLIPEncoderLayer
videollava/model/multimodal_encoder/languagebind/video/modeling_video.py:65
↓ 1 callersClassCLIPVisionTower
videollava/model/multimodal_encoder/clip_encoder.py:7
↓ 1 callersClassChat
videollava/serve/gradio_utils.py:51
↓ 1 callersClassController
videollava/serve/controller.py:57
↓ 1 callersClassCustomDataset
videollava/eval/model_vqa_loader.py:31
↓ 1 callersClassDataCollatorForSupervisedDataset
Collate examples for supervised fine-tuning.
videollava/train/train.py:806
↓ 1 callersClassDepthNorm
videollava/model/multimodal_encoder/languagebind/depth/processing_depth.py:21
↓ 1 callersClassIdentityMap
videollava/model/multimodal_projector/builder.py:6
↓ 1 callersClassKeywordsStoppingCriteria
videollava/eval/model_qa.py:14
↓ 1 callersClassLLaVATrainer
videollava/train/llava_trainer.py:133
↓ 1 callersClassLanguageBindImageProcessor
videollava/model/multimodal_encoder/languagebind/image/processing_image.py:33
↓ 1 callersClassLanguageBindImageTower
videollava/model/multimodal_encoder/languagebind/__init__.py:94
↓ 1 callersClassLanguageBindVideoProcessor
videollava/model/multimodal_encoder/languagebind/video/processing_video.py:116
↓ 1 callersClassLanguageBindVideoTower
videollava/model/multimodal_encoder/languagebind/__init__.py:176
↓ 1 callersClassLazySupervisedDataset
Dataset for supervised fine-tuning.
videollava/train/train.py:672
↓ 1 callersClassLengthGroupedSampler
r""" Sampler that samples indices in a way that groups together features of the dataset of roughly the same length while keeping a bit of rand
videollava/train/llava_trainer.py:99
↓ 1 callersClassLlavaLlamaModel
videollava/model/language_model/llava_llama.py:33
↓ 1 callersClassLlavaMPTModel
videollava/model/language_model/llava_mpt.py:34
↓ 1 callersClassMPTBlock
videollava/model/language_model/mpt/blocks.py:20
↓ 1 callersClassMPTMLP
videollava/model/language_model/mpt/blocks.py:8
↓ 1 callersClassMPTModel
videollava/model/language_model/mpt/modeling_mpt.py:33
↓ 1 callersClassModelWorker
videollava/serve/model_worker.py:44
↓ 1 callersClassPatchDropout
https://arxiv.org/abs/2212.00794
videollava/model/multimodal_encoder/languagebind/image/modeling_image.py:19
↓ 1 callersClassPatchDropout
https://arxiv.org/abs/2212.00794
videollava/model/multimodal_encoder/languagebind/audio/modeling_audio.py:19
↓ 1 callersClassPatchDropout
https://arxiv.org/abs/2212.00794
videollava/model/multimodal_encoder/languagebind/depth/modeling_depth.py:19
↓ 1 callersClassPatchDropout
https://arxiv.org/abs/2212.00794
videollava/model/multimodal_encoder/languagebind/thermal/modeling_thermal.py:19
↓ 1 callersClassPatchDropout
https://arxiv.org/abs/2212.00794
videollava/model/multimodal_encoder/languagebind/video/modeling_video.py:19
↓ 1 callersClassSharedEmbedding
videollava/model/language_model/mpt/custom_embedding.py:6
↓ 1 callersClassTextVQAAccuracyEvaluator
videollava/eval/m4c_evaluator.py:221
↓ 1 callersClassWorkerInfo
videollava/serve/controller.py:43
ClassAutoTokenizerForMOD
AutoTokenizer + Adaptation for MOD. A simple wrapper around AutoTokenizer to make instantiating an MOD-adapted tokenizer a bit easier. M
videollava/model/language_model/mpt/adapt_tokenizer.py:25
ClassCLIPPreTrainedModel
An abstract class to handle weights initialization and a simple interface for downloading and loading pretrained models.
videollava/model/multimodal_encoder/languagebind/image/modeling_image.py:168
ClassCLIPPreTrainedModel
An abstract class to handle weights initialization and a simple interface for downloading and loading pretrained models.
videollava/model/multimodal_encoder/languagebind/audio/modeling_audio.py:168
ClassCLIPPreTrainedModel
An abstract class to handle weights initialization and a simple interface for downloading and loading pretrained models.
videollava/model/multimodal_encoder/languagebind/depth/modeling_depth.py:168
ClassCLIPPreTrainedModel
An abstract class to handle weights initialization and a simple interface for downloading and loading pretrained models.
videollava/model/multimodal_encoder/languagebind/thermal/modeling_thermal.py:168
ClassCLIPPreTrainedModel
An abstract class to handle weights initialization and a simple interface for downloading and loading pretrained models.
videollava/model/multimodal_encoder/languagebind/video/modeling_video.py:168
ClassCLIPTextModel
videollava/model/multimodal_encoder/languagebind/image/modeling_image.py:539
ClassCLIPTextModel
videollava/model/multimodal_encoder/languagebind/audio/modeling_audio.py:539
ClassCLIPTextModel
videollava/model/multimodal_encoder/languagebind/depth/modeling_depth.py:539
ClassCLIPTextModel
videollava/model/multimodal_encoder/languagebind/thermal/modeling_thermal.py:539
ClassCLIPTextModel
videollava/model/multimodal_encoder/languagebind/video/modeling_video.py:539
ClassCLIPVisionModel
videollava/model/multimodal_encoder/languagebind/image/modeling_image.py:679
ClassCLIPVisionModel
videollava/model/multimodal_encoder/languagebind/audio/modeling_audio.py:679
ClassCLIPVisionModel
videollava/model/multimodal_encoder/languagebind/depth/modeling_depth.py:679
ClassCLIPVisionModel
videollava/model/multimodal_encoder/languagebind/thermal/modeling_thermal.py:679
ClassCLIPVisionModel
videollava/model/multimodal_encoder/languagebind/video/modeling_video.py:682
ClassDataArguments
videollava/train/train.py:71
ClassDispatchMethod
videollava/serve/controller.py:28
ClassFlashAttnFunc
videollava/model/language_model/mpt/flash_attn_triton.py:457
ClassFlashAttnKVPackedFunc
videollava/model/language_model/mpt/flash_attn_triton.py:428
ClassFlashAttnQKVPackedFunc
videollava/model/language_model/mpt/flash_attn_triton.py:401
ClassLPLayerNorm
videollava/model/language_model/mpt/norm.py:14
ClassLPRMSNorm
videollava/model/language_model/mpt/norm.py:46
ClassLanguageBind
videollava/model/multimodal_encoder/languagebind/__init__.py:54
ClassLanguageBindAudio
videollava/model/multimodal_encoder/languagebind/audio/modeling_audio.py:734
ClassLanguageBindAudioConfig
r""" [`CLIPConfig`] is the configuration class to store the configuration of a [`CLIPModel`]. It is used to instantiate a CLIP model according
videollava/model/multimodal_encoder/languagebind/audio/configuration_audio.py:260
ClassLanguageBindAudioProcessor
videollava/model/multimodal_encoder/languagebind/audio/processing_audio.py:146
ClassLanguageBindAudioTokenizer
Construct a CLIP tokenizer. Based on byte-level Byte-Pair-Encoding. This tokenizer inherits from [`PreTrainedTokenizer`] which contains most
videollava/model/multimodal_encoder/languagebind/audio/tokenization_audio.py:29
ClassLanguageBindDepth
videollava/model/multimodal_encoder/languagebind/depth/modeling_depth.py:734
ClassLanguageBindDepthConfig
r""" [`CLIPConfig`] is the configuration class to store the configuration of a [`CLIPModel`]. It is used to instantiate a CLIP model according
videollava/model/multimodal_encoder/languagebind/depth/configuration_depth.py:255
ClassLanguageBindDepthProcessor
videollava/model/multimodal_encoder/languagebind/depth/processing_depth.py:64
ClassLanguageBindDepthTokenizer
Construct a CLIP tokenizer. Based on byte-level Byte-Pair-Encoding. This tokenizer inherits from [`PreTrainedTokenizer`] which contains most
videollava/model/multimodal_encoder/languagebind/depth/tokenization_depth.py:29
ClassLanguageBindImage
videollava/model/multimodal_encoder/languagebind/image/modeling_image.py:734
ClassLanguageBindImageConfig
r""" [`CLIPConfig`] is the configuration class to store the configuration of a [`CLIPModel`]. It is used to instantiate a CLIP model according
videollava/model/multimodal_encoder/languagebind/image/configuration_image.py:253
ClassLanguageBindImageTokenizer
Construct a CLIP tokenizer. Based on byte-level Byte-Pair-Encoding. This tokenizer inherits from [`PreTrainedTokenizer`] which contains most
videollava/model/multimodal_encoder/languagebind/image/tokenization_image.py:29
ClassLanguageBindThermal
videollava/model/multimodal_encoder/languagebind/thermal/modeling_thermal.py:734
next →1–100 of 125, ranked by callers