MCPcopy Create free account

hub / github.com/VITA-MLLM/VITA / functions

Functions1,650 in github.com/VITA-MLLM/VITA

⨍ Functions 1,650◇ Types & classes 320↳ Endpoints 1
↓ 1 callersMethod__init__
(self, vision_tower, args, delay_load=False)
vita/model/multimodal_encoder/siglip/siglip_encoder.py:9
↓ 1 callersMethod__init__
Construct an Encoder object.
vita/model/multimodal_encoder/whale/module/component/mamba.py:101
↓ 1 callersMethod__init__
Construct an Encoder object.
vita/model/multimodal_encoder/whale/module/component/transformer.py:239
↓ 1 callersMethod__init__
(self)
vita/model/multimodal_encoder/eva_clip/eva_clip_encoder.py:63
↓ 1 callersMethod__init__
(self)
vita/model/multimodal_encoder/eva_clip/eva_clip_processors.py:14
↓ 1 callersMethod__init__
(self, func)
VLMEvalKit/vlmeval/utils/mp_util.py:16
↓ 1 callersMethod__init__
(self, dataset='MVBench', pack=False)
VLMEvalKit/vlmeval/dataset/mvbench.py:34
↓ 1 callersMethod__init__
(self, model_path='internlm/internlm-xcomposer-vl-7b', **kwargs)
VLMEvalKit/vlmeval/vlm/xcomposer/xcomposer.py:28
↓ 1 callersMethod__init__
(self, model_path='OpenGVLab/VideoChat2_HD_stage4_Mistral_7B', root='./Ask-Anything', config_
VLMEvalKit/vlmeval/vlm/video_llm/videochat2.py:64
↓ 1 callersFunction__padding__
(image)
VLMEvalKit/vlmeval/vlm/xcomposer/xcomposer2.py:12
↓ 1 callersMethod__str__
(self)
VLMEvalKit/vlmeval/dataset/utils/tablevqabench.py:273
↓ 1 callersMethod__str__
(self)
VLMEvalKit/vlmeval/dataset/utils/tablevqabench.py:307
↓ 1 callersMethod_add_bos_eos
(self, bos, eos, inputs_embeds, attention_mask, target=None)
vita/model/multimodal_encoder/whale/init_model.py:156
↓ 1 callersFunction_build_vision_tower
(vision_tower_path: str, embed_dim: int, vision_cfg: CLIPVisionCfg)
vita/model/multimodal_encoder/eva_clip/eva_vit.py:905
↓ 1 callersMethod_extract_fbank_features
Get mel-filter bank features using TorchAudio. Note that TorchAudio requires 16-bit signed integers as inputs and hence the waveform
web_demo/vllm_tools/qwen2p5_model_weight_file/processor_whale.py:168
↓ 1 callersMethod_flash_attn
(self, x, key_padding_mask=None, need_weights=False)
vita/model/multimodal_encoder/internvit/modeling_intern_vit.py:179
↓ 1 callersMethod_get_context_length
(self, model, model_path)
VLMEvalKit/vlmeval/api/hf_chat_model.py:36
↓ 1 callersMethod_get_context_length_robust
(self, model, model_path)
VLMEvalKit/vlmeval/api/hf_chat_model.py:50
↓ 1 callersMethod_get_model
(model_arch: str)
web_demo/vllm_tools/vllm_file/__init__.py:140
↓ 1 callersMethod_get_pos_embed
(self, pos_embed, H, W)
vita/model/multimodal_encoder/internvit/modeling_intern_vit.py:92
↓ 1 callersFunction_get_rawvideo_dec
( video_path, image_processor, max_frames=MAX_IMAGE_LENGTH, min_frames=4, image_resolution
video_audio_demo.py:29
↓ 1 callersFunction_get_rawvideo_dec
( video_path, image_processor, max_frames=64, image_resolution=224, video_framerate=1,
VLMEvalKit/vlmeval/vlm/video_llm/chat_uni_vi.py:14
↓ 1 callersFunction_get_rawvideo_dec
(video_path, max_frames=MAX_IMAGE_LENGTH, min_frames=MIN_IMAGE_LENGTH, video_framerate=1, s=None, e=None)
web_demo/web_ability_demo.py:169
↓ 1 callersMethod_image_pixels_to_features
(self, vision_tower: InternVisionModel, pixel_values: torch.Tensor)
web_demo/vllm_tools/vllm_file/qwen2.py:994
↓ 1 callersFunction_launch_demo
(llm, model_config, sampling_params, tokenizer, feature_extractor, tts, llm_embedding)
web_demo/web_ability_demo.py:242
↓ 1 callersFunction_load_json_cmvn
Load the json format cmvn stats file and calculate cmvn Args: json_cmvn_file: cmvn stats file in json format Returns: a num
vita/model/vita_tts/encoder/cmvn.py:37
↓ 1 callersMethod_load_json_cmvn
Load the json format cmvn stats file and calculate cmvn Args: json_cmvn_file: cmvn stats file in json format Returns:
web_demo/vllm_tools/qwen2p5_model_weight_file/processor_whale.py:142
↓ 1 callersFunction_load_kaldi_cmvn
Load the kaldi format cmvn stats file and calculate cmvn Args: kaldi_cmvn_file: kaldi text style global cmvn file, which is
vita/model/vita_tts/encoder/cmvn.py:61
↓ 1 callersMethod_naive_attn
(self, x)
vita/model/multimodal_encoder/internvit/modeling_intern_vit.py:158
↓ 1 callersMethod_naive_attn
(self, x, attention_mask=None, pos_embeds=None)
web_demo/vllm_tools/vllm_file/whale.py:385
↓ 1 callersMethod_parse_and_validate_audio_input
( self, **kwargs: object)
web_demo/vllm_tools/vllm_file/qwen2.py:1043
↓ 1 callersMethod_parse_and_validate_image_input
( self, **kwargs: object)
web_demo/vllm_tools/vllm_file/qwen2.py:967
↓ 1 callersMethod_post_decode
Decoding function, based on the posterior probability output, uses top_k, top_p, and temperature parameters for sampling. P
vita/model/vita_tts/audioLLM.py:339
↓ 1 callersFunction_process_audio
(audio_path)
web_demo/server.py:206
↓ 1 callersMethod_process_audio_input
(self, inputs: Qwen2AudioInputs)
web_demo/vllm_tools/vllm_file/qwen2.py:1023
↓ 1 callersFunction_process_digit_article
(inText)
VLMEvalKit/vlmeval/dataset/utils/vqa_eval.py:9
↓ 1 callersFunction_process_image
(image_path)
web_demo/server.py:197
↓ 1 callersMethod_process_image_input
(self, image_input: Qwen2ImageInputs)
web_demo/vllm_tools/vllm_file/qwen2.py:1013
↓ 1 callersFunction_process_inputs
(inputs)
web_demo/server.py:195
↓ 1 callersFunction_process_video
(video_path, max_frames=4, min_frames=4, s=None, e=None)
web_demo/server.py:213
↓ 1 callersMethod_sample_crop_size
(self, im_size)
VLMEvalKit/vlmeval/dataset/utils/mvbench.py:281
↓ 1 callersMethod_sample_fix_offset
(self, image_w, image_h, crop_w, crop_h)
VLMEvalKit/vlmeval/dataset/utils/mvbench.py:310
↓ 1 callersMethod_save
(self, output_dir: Optional[str] = None, state_dict=None)
vita/train/vita_trainer.py:335
↓ 1 callersMethod_select_image_features
(self, image_features: torch.Tensor, *, strategy: str)
web_demo/vllm_tools/vllm_file/qwen2.py:983
↓ 1 callersFunction_tasks_with_index
Add index to tasks.
VLMEvalKit/vlmeval/utils/mp_util.py:48
↓ 1 callersMethod_try_load_model_cls
(model_arch: str)
web_demo/vllm_tools/vllm_file/__init__.py:147
↓ 1 callersMethod_validate_audio_input
(self, data: torch.Tensor)
web_demo/vllm_tools/vllm_file/qwen2.py:1035
↓ 1 callersMethod_validate_pixel_values
(self, data: torch.Tensor)
web_demo/vllm_tools/vllm_file/qwen2.py:946
↓ 1 callersFunctionadd_encoder_args
Add Encoder common arguments.
vita/model/multimodal_encoder/whale/module/encoder/encoder.py:17
↓ 1 callersMethodadjust_kwargs
(self, dataset)
VLMEvalKit/vlmeval/vlm/qwen_vl.py:38
↓ 1 callersFunctionanls_compute
(groundtruth, prediction)
VLMEvalKit/vlmeval/dataset/utils/vqa_eval.py:230
↓ 1 callersMethodapply_prompt_template
(self, query)
VLMEvalKit/vlmeval/vlm/xgen_mm.py:36
↓ 1 callersFunctionbatched_forward
(model, x, batch_size=-1)
vita/util/s2wrapper/utils.py:55
↓ 1 callersFunctionbroadcat
(tensors, dim=-1)
vita/model/multimodal_encoder/eva_clip/eva_vit.py:26
↓ 1 callersMethodbuild_gen_config
(self, dataset)
VLMEvalKit/vlmeval/vlm/llava/llava_xtuner.py:140
↓ 1 callersMethodbuild_hallusionbench
(self, line)
VLMEvalKit/vlmeval/vlm/rbdash.py:211
↓ 1 callersMethodbuild_history
(self, message)
VLMEvalKit/vlmeval/vlm/internvl_chat.py:373
↓ 1 callersMethodbuild_history
(self, message)
VLMEvalKit/vlmeval/vlm/qwen_vl.py:90
↓ 1 callersFunctionbuild_mathv_gpt4_prompt
(line)
VLMEvalKit/vlmeval/dataset/utils/mathv.py:79
↓ 1 callersFunctionbuild_mathvista_gpt4_prompt
(line)
VLMEvalKit/vlmeval/dataset/utils/mathvista.py:53
↓ 1 callersMethodbuild_mcqa
(self, line)
VLMEvalKit/vlmeval/vlm/xcomposer/xcomposer2_4KHD.py:189
↓ 1 callersMethodbuild_mcqa
(self, line)
VLMEvalKit/vlmeval/vlm/xcomposer/xcomposer2.py:168
↓ 1 callersMethodbuild_mcqa
(self, line)
VLMEvalKit/vlmeval/vlm/xcomposer/xcomposer2d5.py:231
↓ 1 callersMethodbuild_mmbench
(self, line)
VLMEvalKit/vlmeval/vlm/rbdash.py:216
↓ 1 callersMethodbuild_mme
(self, line)
VLMEvalKit/vlmeval/vlm/rbdash.py:206
↓ 1 callersMethodbuild_mme_rw_prompt
(self, line, dataset_name)
VLMEvalKit/vlmeval/vlm/vita/vita_qwen2.py:75
↓ 1 callersMethodbuild_mme_rw_prompt
(self, line, dataset_name)
VLMEvalKit/vlmeval/vlm/vita/vita_mistral.py:75
↓ 1 callersMethodbuild_mme_rw_prompt
(self, line, dataset_name)
VLMEvalKit/vlmeval/vlm/vita/vita.py:75
↓ 1 callersFunctionbuild_mmlongbench_gpt4_prompt
(line)
VLMEvalKit/vlmeval/dataset/mmlongbench.py:76
↓ 1 callersMethodbuild_mmmu
(self, line)
VLMEvalKit/vlmeval/vlm/rbdash.py:234
↓ 1 callersFunctionbuild_mmvet_gpt4_prompt
(line)
VLMEvalKit/vlmeval/dataset/utils/mmvet.py:4
↓ 1 callersMethodbuild_msgs
(msgs_raw, system_prompt=None)
VLMEvalKit/vlmeval/api/qwen_api.py:44
↓ 1 callersMethodbuild_msgs
(msgs_raw)
VLMEvalKit/vlmeval/api/stepai.py:40
↓ 1 callersMethodbuild_msgs
(self, msgs_raw, system_prompt=None, dataset=None)
VLMEvalKit/vlmeval/api/glm_vision.py:49
↓ 1 callersMethodbuild_msgs_genai
(self, inputs)
VLMEvalKit/vlmeval/api/gemini.py:51
↓ 1 callersMethodbuild_msgs_vertex
(self, inputs)
VLMEvalKit/vlmeval/api/gemini.py:60
↓ 1 callersMethodbuild_multi_choice_prompt
(self, line, dataset=None)
VLMEvalKit/vlmeval/vlm/mmalaya.py:262
↓ 1 callersMethodbuild_multi_choice_prompt
(self, line, dataset=None)
VLMEvalKit/vlmeval/vlm/internvl_chat.py:187
↓ 1 callersMethodbuild_multi_choice_prompt
(self, line, dataset=None)
VLMEvalKit/vlmeval/vlm/parrot.py:93
↓ 1 callersMethodbuild_multi_choice_prompt
(self, line, dataset=None)
VLMEvalKit/vlmeval/vlm/ovis.py:78
↓ 1 callersMethodbuild_multi_choice_prompt
(self, line, dataset=None)
VLMEvalKit/vlmeval/vlm/vita/vita_qwen2.py:52
↓ 1 callersMethodbuild_multi_choice_prompt
(self, line, dataset=None)
VLMEvalKit/vlmeval/vlm/vita/vita_mistral.py:52
↓ 1 callersMethodbuild_multi_choice_prompt
(self, line, dataset=None)
VLMEvalKit/vlmeval/vlm/vita/vita.py:52
↓ 1 callersMethodbuild_multi_choice_prompt
(self, line, dataset=None)
VLMEvalKit/vlmeval/api/sensechat_vision.py:86
↓ 1 callersFunctionbuild_option_str
(option_dict)
VLMEvalKit/vlmeval/smp/vlm.py:116
↓ 1 callersFunctionbuild_prompt
(question, options, prediction)
VLMEvalKit/vlmeval/dataset/utils/multiple_choice.py:154
↓ 1 callersFunctionbuild_prompt_blink
(question, options, prediction)
VLMEvalKit/vlmeval/dataset/utils/multiple_choice.py:174
↓ 1 callersFunctionbuild_prompt_cn
(question, options, prediction)
VLMEvalKit/vlmeval/dataset/utils/multiple_choice.py:208
↓ 1 callersMethodbuild_prompt_mathvista
(self, message)
VLMEvalKit/vlmeval/vlm/idefics.py:203
↓ 1 callersMethodbuild_prompt_mmbench
(self, message)
VLMEvalKit/vlmeval/vlm/idefics.py:146
↓ 1 callersMethodbuild_prompt_mmmu
(self, message)
VLMEvalKit/vlmeval/vlm/idefics.py:173
↓ 1 callersMethodbuild_prompt_mt
(self, message)
VLMEvalKit/vlmeval/vlm/idefics.py:129
↓ 1 callersMethodbuild_prompt_nopack
(self, line, num_frames, video_llm)
VLMEvalKit/vlmeval/dataset/mmbench_video.py:113
↓ 1 callersMethodbuild_prompt_pack
(self, line, num_frames)
VLMEvalKit/vlmeval/dataset/mmbench_video.py:91
↓ 1 callersMethodbuild_prompt_puremcq
(self, message)
VLMEvalKit/vlmeval/vlm/idefics.py:109
↓ 1 callersFunctionbuild_transform
(input_size)
VLMEvalKit/vlmeval/vlm/internvl_chat.py:22
↓ 1 callersMethodbuilt_yorn_prompt
(self, line, dataset=None)
VLMEvalKit/vlmeval/vlm/parrot.py:82
↓ 1 callersMethodbuilt_yorn_prompt
(self, line, dataset=None)
VLMEvalKit/vlmeval/vlm/ovis.py:70
↓ 1 callersMethodcalculat_metric
(self, ans)
VLMEvalKit/vlmeval/dataset/image_mt.py:61
↓ 1 callersMethodcall_for_batch
( self, output_ids: torch.LongTensor, scores: torch.FloatTensor, **kwargs )
vita/util/mm_utils.py:136
← previousnext →301–400 of 1,650, ranked by callers