MCPcopy Create free account

hub / github.com/JavisVerse/JavisGPT / functions

Functions412 in github.com/JavisVerse/JavisGPT

↓ 1 callersMethodauto_slice_audio
Rearrange 1D padded tensor into a 2D tensor with zeros uniformly distributed. Thanks to DeepSeek-R1. Args:
javisgpt/model/blocks.py:118
↓ 1 callersMethodbatch_decode
This method forwards all its arguments to Qwen2TokenizerFast's [`~PreTrainedTokenizer.batch_decode`]. Please refer to the docstring o
javisgpt/model/qwen2_5_vl/processing_qwen2_5_vl.py:181
↓ 1 callersMethodbatch_decode
This method forwards all its arguments to Qwen2TokenizerFast's [`~PreTrainedTokenizer.batch_decode`]. Please refer to the docstring o
javisgpt/model/qwen2_vl/processing_qwen2_vl.py:159
↓ 1 callersFunctionbatch_process
()
javisgpt/eval/eval_und.py:95
↓ 1 callersFunctionbuild_judge_llm
(jugde_model_name_or_path, api_key="")
javisgpt/eval/eval_und.py:132
↓ 1 callersMethodbuild_models
(self)
interface/javisdit_interface.py:200
↓ 1 callersFunctioncheck_imports
Check if the current Python environment contains all the libraries that are imported in a file.
assets/src/dynamic_modules_utils.py:127
↓ 1 callersMethodcompute_bias
(self, query_length, key_length)
javisgpt/model/beats/backbone.py:422
↓ 1 callersMethodcompute_caption_loss
(self, input_conds, target_texts, prior_scale=1.0, use_cos=True)
interface/javisdit_interface.py:371
↓ 1 callersMethodcompute_diffusion_loss
(self, input_conds, target_audios, target_videos)
interface/javisdit_interface.py:409
↓ 1 callersMethodextract_features
(self, x, padding_mask=None, tgt_layer=None)
javisgpt/model/beats/backbone.py:110
↓ 1 callersFunctionextract_vision_info
(conversations: list[dict] | list[list[dict]])
javisgpt/model/qwenvl_vision_process.py:303
↓ 1 callersFunctionfetch_response
(semaphore, messages, idx)
javisgpt/eval/eval_und.py:73
↓ 1 callersFunctionfetch_video
(ele: dict, image_factor: int = IMAGE_FACTOR)
javisgpt/model/qwenvl_vision_process.py:257
↓ 1 callersFunctionfind_all_linear_names
(model)
javisgpt/train/ckpt_utils.py:65
↓ 1 callersFunctionfind_pipeline_class
Retrieve pipeline class that inherits from `DiffusionPipeline`. Note that there has to be exactly one class inheriting from `DiffusionPipelin
assets/src/dynamic_modules_utils.py:171
↓ 1 callersMethodflush
(self)
javisgpt/utils.py:109
↓ 1 callersMethodforward
r""" Args: labels (`torch.LongTensor` of shape `(batch_size, sequence_length)`, *optional*): Labels for computing
javisgpt/model/javisgpt_arch.py:378
↓ 1 callersMethodforward
(self, x)
javisgpt/model/qwen2_5_vl/modeling_qwen2_5_vl.py:639
↓ 1 callersMethodforward
(self, hidden_state)
javisgpt/model/qwen2_vl/modeling_qwen2_vl.py:473
↓ 1 callersMethodforward_eager
(self, x1, x2, attention_mask_1:torch.Tensor=None, attention_mask_2:torch.Tensor=None)
javisgpt/model/blocks.py:286
↓ 1 callersMethodforward_flash_attn_2
(self, x1, x2, attention_mask_1:torch.Tensor=None, attention_mask_2:torch.Tensor=None)
javisgpt/model/blocks.py:431
↓ 1 callersMethodgenerate_audio_video_infer
(self, attention_mask, past_key_values, embed_only=False)
javisgpt/model/javisgpt_arch.py:832
↓ 1 callersFunctionget_activation_fn
Returns the activation function corresponding to `activation`
javisgpt/model/beats/modules.py:97
↓ 1 callersFunctionget_cached_module_file
Prepares Downloads a module from a local folder or a distant repo and returns its path inside the cached Transformers module. Args:
assets/src/dynamic_modules_utils.py:199
↓ 1 callersFunctionget_chunk
(lst, n, k)
javisgpt/eval/dataset.py:22
↓ 1 callersFunctionget_class_in_module
Import a module on the cache directory for modules and extract a class from it.
assets/src/dynamic_modules_utils.py:159
↓ 1 callersMethodget_cond_projector
(self, input_dim, hidden_dim=None)
interface/javisdit_interface.py:302
↓ 1 callersFunctionget_diffusers_versions
()
assets/src/dynamic_modules_utils.py:44
↓ 1 callersMethodget_images
(self, return_pil=False, return_path=False)
javisgpt/conversation.py:229
↓ 1 callersFunctionget_mm_adapter_state_maybe_zero_3
(named_params, keys_to_match)
javisgpt/train/ckpt_utils.py:59
↓ 1 callersFunctionget_mm_adapter_state_maybe_zero_3
(named_params, keys_to_match)
javisgpt/train/llava_trainer.py:45
↓ 1 callersFunctionget_modality_length_grouped_indices
Return a list of indices so that each slice of `batch_size` consecutive indices correspond to elements of similar lengths. To do this, the in
javisgpt/train/llava_trainer.py:89
↓ 1 callersFunctionget_modality_length_grouped_indices_auto
(lengths, batch_size, world_size, generator=None)
javisgpt/train/llava_trainer.py:167
↓ 1 callersFunctionget_peft_state_non_lora_maybe_zero_3
(named_params, require_grad_only=True)
javisgpt/train/ckpt_utils.py:51
↓ 1 callersMethodget_prompt
(self)
javisgpt/conversation.py:47
↓ 1 callersMethodget_rope_index
Calculate the 3D rope index based on image and video's temporal, height and width in LLM. Explanation: Each embedding se
javisgpt/model/javisgpt_arch.py:180
↓ 1 callersMethodget_rope_index
Calculate the 3D rope index based on image and video's temporal, height and width in LLM. Explanation: Each embedding se
javisgpt/model/qwen2_5_vl/modular_qwen2_5_vl.py:414
↓ 1 callersMethodget_rope_index
Calculate the 3D rope index based on image and video's temporal, height and width in LLM. Explanation: Each embedding se
javisgpt/model/qwen2_5_vl/modeling_qwen2_5_vl.py:1546
↓ 1 callersMethodget_rope_index
Calculate the 3D rope index based on image and video's temporal, height and width in LLM. Explanation: Each embedding se
javisgpt/model/qwen2_vl/modeling_qwen2_vl.py:1449
↓ 1 callersFunctionget_variable_length_grouped_indices
(lengths, batch_size, world_size, megabatch_mult=8, generator=None)
javisgpt/train/llava_trainer.py:73
↓ 1 callersFunctionget_video_reader_backend
()
javisgpt/model/qwenvl_vision_process.py:246
↓ 1 callersMethodget_window_index
(self, grid_thw)
javisgpt/model/qwen2_5_vl/modular_qwen2_5_vl.py:296
↓ 1 callersMethodget_window_index
(self, grid_thw)
javisgpt/model/qwen2_5_vl/modeling_qwen2_5_vl.py:466
↓ 1 callersMethodinit_avgen_token
(self, method='vocab_cluster')
javisgpt/model/javisgpt_arch.py:125
↓ 1 callersMethodinit_embed_
(self, data)
javisgpt/model/beats/quantizer.py:97
↓ 1 callersFunctioninit_hf_modules
Creates the cache directory for modules with an init, and adds it to the Python path.
assets/src/dynamic_modules_utils.py:50
↓ 1 callersFunctionis_decord_available
()
javisgpt/model/qwenvl_vision_process.py:201
↓ 1 callersMethodis_video_file
(self, filename)
javisgpt/conversation.py:248
↓ 1 callersFunctionkmeans
(samples, num_clusters, num_iters=10, use_cosine_sim=False)
javisgpt/model/beats/quantizer.py:40
↓ 1 callersMethodload_data
(self, meta_info: dict)
interface/javisdit_interface.py:78
↓ 1 callersMethodload_transform_audio_video
(self, audio_path, video_path, fix_start_frame=None)
interface/javisdit_interface.py:135
↓ 1 callersFunctionmake_batched_images
Accepts images in list or nested list format, and makes a list of images for preprocessing. Args: images (`Union[List[List[ImageInpu
javisgpt/model/qwen2_vl/image_processing_qwen2_vl.py:59
↓ 1 callersFunctionmake_batched_videos
(videos)
javisgpt/model/qwen2_vl/image_processing_qwen2_vl.py:83
↓ 1 callersFunctionmake_supervised_data_module
Make dataset and collator for supervised fine-tuning.
javisgpt/train/train_audio_video.py:605
↓ 1 callersFunctionmaybe_zero_3
(param, ignore_status=False, name=None)
javisgpt/train/llava_trainer.py:30
↓ 1 callersFunctionmerge_lora
(args)
tools/merge_lora_weights.py:6
↓ 1 callersFunctionnorm_ema_inplace
(moving_avg, new, decay)
javisgpt/model/beats/quantizer.py:126
↓ 1 callersFunctionparse_args
Parse command-line arguments.
tools/audio_visual_demo.py:15
↓ 1 callersMethodpreprocess
( self, source: torch.Tensor, fbank_mean: float = 15.41663, fb
javisgpt/model/beats/Tokenizers.py:123
↓ 1 callersMethodreset_parameters
(self)
javisgpt/model/beats/backbone.py:373
↓ 1 callersMethodrot_pos_emb
(self, grid_thw)
javisgpt/model/qwen2_5_vl/modular_qwen2_5_vl.py:267
↓ 1 callersMethodrot_pos_emb
(self, grid_thw)
javisgpt/model/qwen2_5_vl/modeling_qwen2_5_vl.py:437
↓ 1 callersMethodrot_pos_emb
(self, grid_thw)
javisgpt/model/qwen2_vl/modeling_qwen2_vl.py:997
↓ 1 callersFunctionrun_eval
(args)
javisgpt/eval/eval_und.py:166
↓ 1 callersFunctionrun_inference
Run inference on ActivityNet QA DataSet using the Video-ChatGPT model. Args: args: Command-line arguments.
tools/audio_visual_demo.py:64
↓ 1 callersFunctionrun_inference
(args)
javisgpt/eval/infer_und.py:20
↓ 1 callersFunctionrun_inference
(args)
javisgpt/eval/infer_gen.py:18
↓ 1 callersFunctionsafe_load_tokenizer
(tokenizer_id)
javisgpt/conversation.py:380
↓ 1 callersFunctionsample_vectors
(samples, num)
javisgpt/model/beats/quantizer.py:29
↓ 1 callersFunctionsmart_resize
Rescales the image so that the following conditions are met: 1. Both dimensions (height and width) are divisible by 'factor'. 2. The total n
javisgpt/model/qwen2_vl/image_processing_qwen2_vl.py:99
↓ 1 callersFunctionsmart_save
(output_dir: str, save_name: str, weight_to_save: object)
javisgpt/train/ckpt_utils.py:108
↓ 1 callersFunctionsmart_tokenizer_and_embedding_resize
Resize tokenizer and embedding. Note: This is the unoptimized version that may make your embedding size not be divisible by 64.
javisgpt/train/train_audio_video.py:133
↓ 1 callersFunctionsplit_list
Split a list into n (roughly) equal-sized chunks
javisgpt/eval/dataset.py:16
↓ 1 callersFunctiontrain
(attn_implementation=None)
javisgpt/train/train_audio_video.py:736
↓ 1 callersMethodupdate
(self, cfg: dict)
javisgpt/model/beats/Tokenizers.py:68
↓ 1 callersMethodwrite
(self, buf)
javisgpt/utils.py:95
Method__call__
Main method to prepare for the model one or several sequences(s) and image(s). This method forwards the `text` and `kwargs` arguments
javisgpt/model/processing_model.py:69
Method__call__
Main method to prepare for the model one or several sequences(s) and image(s). This method forwards the `text` and `kwargs` arguments
javisgpt/model/qwen2_5_vl/modular_qwen2_5_vl.py:893
Method__call__
Main method to prepare for the model one or several sequences(s) and image(s). This method forwards the `text` and `kwargs` arguments
javisgpt/model/qwen2_5_vl/processing_qwen2_5_vl.py:73
Method__call__
Main method to prepare for the model one or several sequences(s) and image(s). This method forwards the `text` and `kwargs` arguments
javisgpt/model/qwen2_vl/processing_qwen2_vl.py:68
Method__call__
(self, instances: Union[Sequence[Dict]])
javisgpt/eval/dataset.py:353
Method__call__
(self, instances: Sequence[Dict])
javisgpt/train/train_audio_video.py:546
Method__getattr__
(self, attr)
javisgpt/utils.py:92
Method__getitem__
(self, idx)
javisgpt/eval/dataset.py:36
Method__getitem__
(self, idx)
javisgpt/eval/dataset.py:84
Method__getitem__
(self, idx)
javisgpt/eval/dataset.py:117
Method__getitem__
(self, idx)
javisgpt/eval/dataset.py:162
Method__getitem__
(self, idx)
javisgpt/eval/dataset.py:205
Method__getitem__
(self, idx)
javisgpt/eval/dataset.py:260
Method__getitem__
(self, idx)
javisgpt/eval/dataset.py:333
Method__getitem__
(self, i)
javisgpt/train/train_audio_video.py:351
Method__init__
(self, input_dim, hidden_dim, caption_out_dim, prior_out_dim=None, caption_token_num=None, pr
interface/javisdit_interface.py:151
Method__init__
(self, cfg_path, num_frames=81, image_size=(512, 512))
interface/javisdit_interface.py:185
Method__init__
(self, logger, log_level=logging.INFO)
javisgpt/utils.py:86
Method__init__
(self, save_dir, bin_size=64, start_bin=0)
javisgpt/utils.py:169
Method__init__
( self, hidden_size, num_heads=8, mode='merge', enable_layernorm_kernel=False )
javisgpt/model/blocks.py:57
Method__init__
(self, hidden_size)
javisgpt/model/blocks.py:210
Method__init__
(self, m1_dim, m2_dim, embed_dim, num_heads, dropout=0.0, attn_implementation: Literal['eager
javisgpt/model/blocks.py:220
Method__init__
(self, d_model, num_heads, attn_drop=0.0, proj_drop=0.0, attn_impl="sdpa")
javisgpt/model/blocks.py:485
← previousnext →101–200 of 412, ranked by callers