MCPcopy Create free account

hub / github.com/MeiGen-AI/InfiniteTalk / functions

Functions460 in github.com/MeiGen-AI/InfiniteTalk

↓ 1 callersMethod__init__
( self, dim: int, encoder_hidden_states_dim: int, num_heads: int, qkv_
wan/modules/attention.py:192
↓ 1 callersMethod__init__
(self, momentum: float)
wan/utils/multitalk_utils.py:317
↓ 1 callersMethod__init__
( self, repo_id: Optional[str] = None, config: Union[Dict, str, None] = None,
kokoro/model.py:32
↓ 1 callersMethod_apply_lora_weights
(self, lora_weights, alpha, device)
wan/wan_lora.py:63
↓ 1 callersMethod_build_weights
(self, dim_in, dim_out, style_dim)
kokoro/istftnet.py:354
↓ 1 callersMethod_clean
(self, text)
wan/modules/tokenizers.py:75
↓ 1 callersFunction_clip
(pretrained=False, pretrained_name=None, model_cls=XLMRobertaCLIP, return_transf
wan/modules/clip.py:434
↓ 1 callersMethod_crop_black_borders
Crop out black borders from the image
tools/convert_img_to_video.py:48
↓ 1 callersMethod_f02sine
f0_values: (batchsize, length, dim) where dim indicates fundamental tone and overtones
kokoro/istftnet.py:142
↓ 1 callersMethod_get_frameid_bbox
(self, fps, frame_timestamps, h, w, crop_box, rng)
wan/utils/vace_processor.py:219
↓ 1 callersMethod_get_frameid_bbox_adjust_last
(self, fps, frame_timestamps, h, w, crop_box, rng)
wan/utils/vace_processor.py:187
↓ 1 callersMethod_get_frameid_bbox_default
(self, fps, frame_timestamps, h, w, crop_box, rng)
wan/utils/vace_processor.py:154
↓ 1 callersMethod_image_preprocess
(self, img, oh, ow, normalize=True, **kwargs)
wan/utils/vace_processor.py:60
↓ 1 callersMethod_improve_video_quality
(self, video_path)
tools/convert_img_to_video.py:128
↓ 1 callersFunction_init_logging
(rank)
generate_infinitetalk.py:312
↓ 1 callersFunction_init_logging
(rank)
app.py:290
↓ 1 callersMethod_init_step_index
Initialize the step_index counter for the scheduler.
wan/utils/fm_solvers.py:695
↓ 1 callersMethod_init_step_index
Initialize the step_index counter for the scheduler.
wan/utils/fm_solvers_unipc.py:645
↓ 1 callersMethod_load_image
(self, img_path)
wan/utils/vace_processor.py:30
↓ 1 callersMethod_load_images
(self)
tools/convert_img_to_video.py:15
↓ 1 callersMethod_load_lora_file
(self, file_path, param_dtype)
wan/wan_lora.py:33
↓ 1 callersMethod_norm
(self, x)
wan/modules/multitalk_model.py:94
↓ 1 callersMethod_norm
(self, x)
wan/modules/model.py:88
↓ 1 callersFunction_parse_args
()
generate_infinitetalk.py:62
↓ 1 callersFunction_parse_args
()
app.py:61
↓ 1 callersMethod_pillow_convert
(self, image, cvt_type='RGB')
wan/utils/vace_processor.py:15
↓ 1 callersMethod_relative_position_bucket
(self, rel_pos)
wan/modules/t5.py:250
↓ 1 callersMethod_residual
(self, x, s)
kokoro/istftnet.py:368
↓ 1 callersMethod_resize_crop
Resize, center crop, convert to tensor, and normalize.
wan/utils/vace_processor.py:37
↓ 1 callersMethod_scale_image
Scale the image
tools/convert_img_to_video.py:66
↓ 1 callersMethod_shortcut
(self, x)
kokoro/istftnet.py:362
↓ 1 callersFunction_t5
(name, encoder_only=False, decoder_only=False, return_tokenizer=False, tokeniz
wan/modules/t5.py:420
↓ 1 callersMethod_transform_image
Apply transformations in sequence: translation → cropping → scaling
tools/convert_img_to_video.py:85
↓ 1 callersMethod_translate_image
Perform only translation
tools/convert_img_to_video.py:32
↓ 1 callersFunction_validate_args
(args)
generate_infinitetalk.py:37
↓ 1 callersFunction_validate_args
(args)
app.py:36
↓ 1 callersMethod_video_preprocess
(self, video, oh, ow)
wan/utils/vace_processor.py:151
↓ 1 callersFunction_video_vae
Autoencoder3d adapted from Stable Diffusion 1.x, 2.x and XL.
wan/modules/vae.py:592
↓ 1 callersMethodapply_lora
(self, lora_name, alpha=1.0, param_dtype=torch.bfloat16, device='cpu')
wan/wan_lora.py:38
↓ 1 callersFunctionaudio_prepare_multi
(left_path, right_path, audio_type, sample_rate=16000)
app.py:270
↓ 1 callersFunctionbuild_manager
()
wan/utils/segvideo.py:5
↓ 1 callersFunctioncache_video
(tensor, save_file=None, fps=30, suffix='.mp4',
wan/utils/multitalk_utils.py:203
↓ 1 callersFunctioncalculate_x_ref_attn_map
(visual_q, ref_k, ref_target_masks, mode='mean', attn_bias=None)
wan/utils/multitalk_utils.py:80
↓ 1 callersFunctioncanonicalize
(text, keep_punctuation_exact_string=None)
wan/modules/tokenizers.py:24
↓ 1 callersFunctionclip_xlm_roberta_vit_h_14
( pretrained=False, pretrained_name='open-clip-xlm-roberta-large-vit-huge-14', **kwarg
wan/modules/clip.py:471
↓ 1 callersMethodconvert_model_output
Convert the model output to the corresponding type the DPMSolver/DPMSolver++ algorithm needs. DPM-Solver is designed to discretize an
wan/utils/fm_solvers.py:343
↓ 1 callersMethodconvert_model_output
r""" Convert the model output to the corresponding type the UniPC algorithm needs. Args: model_output (`torch.Tensor`):
wan/utils/fm_solvers_unipc.py:281
↓ 1 callersFunctionconvert_video_to_h264
(input_video_path, output_video_path)
wan/utils/utils.py:127
↓ 1 callersMethodcreate_video
(self, output_path, fps=25)
tools/convert_img_to_video.py:100
↓ 1 callersFunctioncustom_init
(device, wav2vec)
generate_infinitetalk.py:277
↓ 1 callersFunctioncustom_init
(device, wav2vec)
app.py:256
↓ 1 callersMethoddecide_system_prompt
(self, tar_lang="zh", multi_images_input=False)
wan/utils/prompt_extend.py:183
↓ 1 callersMethoddecode
(self, z, scale)
wan/modules/vae.py:544
↓ 1 callersMethoddisable_teacache
(self)
wan/modules/multitalk_model.py:595
↓ 1 callersMethoddpm_solver_first_order_update
One step for the first-order DPMSolver (equivalent to DDIM). Args: model_output (`torch.Tensor`): The dir
wan/utils/fm_solvers.py:417
↓ 1 callersMethoddynamic_load
(self)
wan/vace.py:512
↓ 1 callersMethodenable_cpu_offload
(self)
wan/multitalk.py:332
↓ 1 callersFunctionenable_vram_management
( model: torch.nn.Module, module_map: dict, module_config: dict, max_num_param=None, overf
src/vram_management/layers.py:228
↓ 1 callersFunctionenable_vram_management_recursively
( model: torch.nn.Module, module_map: dict, module_config: dict, max_num_param=None, overf
src/vram_management/layers.py:191
↓ 1 callersMethodextend_with_img
(self, prompt, system_prompt, image=No
wan/utils/prompt_extend.py:171
↓ 1 callersFunctionextract_audio_from_video
(filename, sample_rate)
generate_infinitetalk.py:348
↓ 1 callersFunctionextract_audio_from_video
(filename, sample_rate)
app.py:326
↓ 1 callersFunctionextract_vision_info
( conversations: list[dict] | list[list[dict]])
wan/utils/qwen_vl_utils.py:328
↓ 1 callersFunctionfetch_video
( ele: dict, image_factor: int = IMAGE_FACTOR)
wan/utils/qwen_vl_utils.py:274
↓ 1 callersMethodforward
(self, x)
wan/modules/t5.py:53
↓ 1 callersMethodforward
(self, x: torch.Tensor, encoder_hidden_states: torch.Tensor, shape=None, enable_sp=False, kv_seq=None)
wan/modules/attention.py:227
↓ 1 callersMethodforward
r""" Args: x(Tensor): Shape [B, L1, C] e(Tensor): Shape [B, C]
wan/modules/model.py:337
↓ 1 callersMethodforward
(self, x)
kokoro/modules.py:29
↓ 1 callersMethodforward_vace
(self, x, vace_context, seq_len, kwargs)
wan/modules/vace_model.py:136
↓ 1 callersFunctiongenerate
(args)
generate_infinitetalk.py:453
↓ 1 callersFunctiongenerate_and_save_audio
( output_file: Path, text: str, kokoro_language: str, voice: str, speed=1 )
kokoro/__main__.py:50
↓ 1 callersFunctiongenerate_audio
( text: str, kokoro_language: str, voice: str, speed=1 )
kokoro/__main__.py:39
↓ 1 callersMethodget_parameter_by_name
(self, model, param_name)
wan/wan_lora.py:52
↓ 1 callersFunctionget_video_codec
(video_path)
wan/utils/utils.py:154
↓ 1 callersFunctionget_video_reader_backend
()
wan/utils/qwen_vl_utils.py:261
↓ 1 callersMethodinit_freqs
(self)
wan/modules/multitalk_model.py:548
↓ 1 callersMethodinit_weights
r""" Initialize model parameters using Xavier initialization.
wan/modules/multitalk_model.py:802
↓ 1 callersMethodinit_weights
r""" Initialize model parameters using Xavier initialization.
wan/modules/model.py:609
↓ 1 callersMethodinverse
Inverse STFT => returns waveform shape (B, T).
kokoro/custom_stft.py:142
↓ 1 callersFunctionis_decord_available
()
wan/utils/qwen_vl_utils.py:215
↓ 1 callersMethodload_lora
(self, lora_path, lora_name=None)
wan/wan_lora.py:20
↓ 1 callersMethodload_models_to_device
(self, loadmodel_names=[])
wan/multitalk.py:335
↓ 1 callersMethodload_single_voice
(self, voice: str)
kokoro/pipeline.py:149
↓ 1 callersMethodload_video
(self, data_key, crop_box=None, seed=2024, **kwargs)
wan/utils/vace_processor.py:227
↓ 1 callersMethodload_video_pair
(self, data_key, data_key2, crop_box=N
wan/utils/vace_processor.py:231
↓ 1 callersFunctionmain
()
tools/convert_img_to_video.py:146
↓ 1 callersFunctionmain
()
kokoro/__main__.py:68
↓ 1 callersFunctionmatch_and_blend_colors
Matches the color of a source video chunk to a reference image and blends with the original. Args: source_chunk (torch.Tensor): The
wan/utils/multitalk_utils.py:361
↓ 1 callersMethodmultistep_dpm_solver_second_order_update
One step for the second-order multistep DPMSolver. Args: model_output_list (`List[torch.Tensor]`): The di
wan/utils/fm_solvers.py:488
↓ 1 callersMethodmultistep_dpm_solver_third_order_update
One step for the third-order multistep DPMSolver. Args: model_output_list (`List[torch.Tensor]`): The dir
wan/utils/fm_solvers.py:598
↓ 1 callersMethodmultistep_uni_c_bh_update
One step for the UniC (B(h) version). Args: this_model_output (`torch.Tensor`): The model outputs at `x_
wan/utils/fm_solvers_unipc.py:488
↓ 1 callersMethodmultistep_uni_p_bh_update
One step for the UniP (B(h) version). Alternatively, `self.solver_p` is used if is specified. Args: model_output (`torch
wan/utils/fm_solvers_unipc.py:352
↓ 1 callersMethodoffload
(self)
src/vram_management/layers.py:42
↓ 1 callersMethodonload
(self)
src/vram_management/layers.py:50
↓ 1 callersFunctionpad_freqs
(original_tensor, target_len)
wan/distributed/xdit_context_parallel.py:20
↓ 1 callersFunctionpatch_tensor_constructor
(fn)
src/utils.py:26
↓ 1 callersFunctionpos_interpolate
(pos, seq_len)
wan/modules/clip.py:22
↓ 1 callersMethodprecompute_freqs_cis_1d
(self, pos_indices)
wan/utils/multitalk_utils.py:165
↓ 1 callersFunctionprocess_tts_multi
(text, save_dir, voice1, voice2)
app.py:382
↓ 1 callersFunctionprocess_tts_single
(text, save_dir, voice1)
app.py:359
← previousnext →101–200 of 460, ranked by callers