MCPcopy Create free account

hub / github.com/MeiGen-AI/MultiTalk / functions

Functions446 in github.com/MeiGen-AI/MultiTalk

↓ 1 callersMethod_build_weights
(self, dim_in, dim_out, style_dim)
kokoro/istftnet.py:354
↓ 1 callersMethod_clean
(self, text)
wan/modules/tokenizers.py:75
↓ 1 callersFunction_clip
(pretrained=False, pretrained_name=None, model_cls=XLMRobertaCLIP, return_transf
wan/modules/clip.py:434
↓ 1 callersMethod_f02sine
f0_values: (batchsize, length, dim) where dim indicates fundamental tone and overtones
kokoro/istftnet.py:142
↓ 1 callersMethod_get_frameid_bbox
(self, fps, frame_timestamps, h, w, crop_box, rng)
wan/utils/vace_processor.py:219
↓ 1 callersMethod_get_frameid_bbox_adjust_last
(self, fps, frame_timestamps, h, w, crop_box, rng)
wan/utils/vace_processor.py:187
↓ 1 callersMethod_get_frameid_bbox_default
(self, fps, frame_timestamps, h, w, crop_box, rng)
wan/utils/vace_processor.py:154
↓ 1 callersMethod_image_preprocess
(self, img, oh, ow, normalize=True, **kwargs)
wan/utils/vace_processor.py:60
↓ 1 callersFunction_init_logging
(rank)
generate_multitalk.py:289
↓ 1 callersFunction_init_logging
(rank)
app.py:280
↓ 1 callersMethod_init_step_index
Initialize the step_index counter for the scheduler.
wan/utils/fm_solvers.py:695
↓ 1 callersMethod_init_step_index
Initialize the step_index counter for the scheduler.
wan/utils/fm_solvers_unipc.py:645
↓ 1 callersMethod_load_image
(self, img_path)
wan/utils/vace_processor.py:30
↓ 1 callersMethod_load_lora_file
(self, file_path, param_dtype)
wan/wan_lora.py:33
↓ 1 callersMethod_norm
(self, x)
wan/modules/multitalk_model.py:94
↓ 1 callersMethod_norm
(self, x)
wan/modules/model.py:88
↓ 1 callersFunction_parse_args
()
generate_multitalk.py:60
↓ 1 callersFunction_parse_args
()
app.py:61
↓ 1 callersMethod_pillow_convert
(self, image, cvt_type='RGB')
wan/utils/vace_processor.py:15
↓ 1 callersMethod_relative_position_bucket
(self, rel_pos)
wan/modules/t5.py:250
↓ 1 callersMethod_residual
(self, x, s)
kokoro/istftnet.py:368
↓ 1 callersMethod_resize_crop
Resize, center crop, convert to tensor, and normalize.
wan/utils/vace_processor.py:37
↓ 1 callersMethod_shortcut
(self, x)
kokoro/istftnet.py:362
↓ 1 callersFunction_t5
(name, encoder_only=False, decoder_only=False, return_tokenizer=False, tokeniz
wan/modules/t5.py:420
↓ 1 callersFunction_validate_args
(args)
generate_multitalk.py:35
↓ 1 callersFunction_validate_args
(args)
app.py:36
↓ 1 callersMethod_video_preprocess
(self, video, oh, ow)
wan/utils/vace_processor.py:151
↓ 1 callersFunction_video_vae
Autoencoder3d adapted from Stable Diffusion 1.x, 2.x and XL.
wan/modules/vae.py:592
↓ 1 callersMethodapply_lora
(self, lora_name, alpha=1.0, param_dtype=torch.bfloat16, device='cpu')
wan/wan_lora.py:38
↓ 1 callersFunctionaudio_prepare_multi
(left_path, right_path, audio_type, sample_rate=16000)
generate_multitalk.py:268
↓ 1 callersFunctionaudio_prepare_multi
(left_path, right_path, audio_type, sample_rate=16000)
app.py:260
↓ 1 callersFunctioncache_video
(tensor, save_file=None, fps=30, suffix='.mp4',
wan/utils/multitalk_utils.py:203
↓ 1 callersFunctioncalculate_x_ref_attn_map
(visual_q, ref_k, ref_target_masks, mode='mean', attn_bias=None)
wan/utils/multitalk_utils.py:80
↓ 1 callersFunctioncanonicalize
(text, keep_punctuation_exact_string=None)
wan/modules/tokenizers.py:24
↓ 1 callersFunctionclip_xlm_roberta_vit_h_14
( pretrained=False, pretrained_name='open-clip-xlm-roberta-large-vit-huge-14', **kwarg
wan/modules/clip.py:471
↓ 1 callersMethodconvert_model_output
Convert the model output to the corresponding type the DPMSolver/DPMSolver++ algorithm needs. DPM-Solver is designed to discretize an
wan/utils/fm_solvers.py:343
↓ 1 callersMethodconvert_model_output
r""" Convert the model output to the corresponding type the UniPC algorithm needs. Args: model_output (`torch.Tensor`):
wan/utils/fm_solvers_unipc.py:281
↓ 1 callersFunctioncustom_init
(device, wav2vec)
generate_multitalk.py:254
↓ 1 callersFunctioncustom_init
(device, wav2vec)
app.py:246
↓ 1 callersMethoddecide_system_prompt
(self, tar_lang="zh", multi_images_input=False)
wan/utils/prompt_extend.py:183
↓ 1 callersMethoddecode
(self, z, scale)
wan/modules/vae.py:544
↓ 1 callersMethoddisable_teacache
(self)
wan/modules/multitalk_model.py:594
↓ 1 callersMethoddpm_solver_first_order_update
One step for the first-order DPMSolver (equivalent to DDIM). Args: model_output (`torch.Tensor`): The dir
wan/utils/fm_solvers.py:417
↓ 1 callersMethoddynamic_load
(self)
wan/vace.py:512
↓ 1 callersMethodenable_cpu_offload
(self)
wan/multitalk.py:303
↓ 1 callersFunctionenable_vram_management
( model: torch.nn.Module, module_map: dict, module_config: dict, max_num_param=None, overf
src/vram_management/layers.py:228
↓ 1 callersFunctionenable_vram_management_recursively
( model: torch.nn.Module, module_map: dict, module_config: dict, max_num_param=None, overf
src/vram_management/layers.py:191
↓ 1 callersMethodextend_with_img
(self, prompt, system_prompt, image=No
wan/utils/prompt_extend.py:171
↓ 1 callersFunctionextract_audio_from_video
(filename, sample_rate)
generate_multitalk.py:325
↓ 1 callersFunctionextract_audio_from_video
(filename, sample_rate)
app.py:316
↓ 1 callersFunctionextract_vision_info
( conversations: list[dict] | list[list[dict]])
wan/utils/qwen_vl_utils.py:328
↓ 1 callersFunctionfetch_video
( ele: dict, image_factor: int = IMAGE_FACTOR)
wan/utils/qwen_vl_utils.py:274
↓ 1 callersMethodforward
(self, x)
wan/modules/t5.py:53
↓ 1 callersMethodforward
(self, x: torch.Tensor, encoder_hidden_states: torch.Tensor, shape=None, enable_sp=False, kv_seq=None)
wan/modules/attention.py:227
↓ 1 callersMethodforward
r""" Args: x(Tensor): Shape [B, L1, C] e(Tensor): Shape [B, C]
wan/modules/model.py:337
↓ 1 callersMethodforward
(self, x)
kokoro/modules.py:29
↓ 1 callersMethodforward_vace
(self, x, vace_context, seq_len, kwargs)
wan/modules/vace_model.py:136
↓ 1 callersFunctiongenerate
(args)
generate_multitalk.py:430
↓ 1 callersMethodgenerate
r""" Generates video frames from input image and text prompt using diffusion process. Args: frame_num (`int`, *optional*,
wan/multitalk.py:346
↓ 1 callersFunctiongenerate_and_save_audio
( output_file: Path, text: str, kokoro_language: str, voice: str, speed=1 )
kokoro/__main__.py:50
↓ 1 callersFunctiongenerate_audio
( text: str, kokoro_language: str, voice: str, speed=1 )
kokoro/__main__.py:39
↓ 1 callersMethodget_parameter_by_name
(self, model, param_name)
wan/wan_lora.py:52
↓ 1 callersFunctionget_video_reader_backend
()
wan/utils/qwen_vl_utils.py:261
↓ 1 callersMethodinit_freqs
(self)
wan/modules/multitalk_model.py:547
↓ 1 callersMethodinit_weights
r""" Initialize model parameters using Xavier initialization.
wan/modules/multitalk_model.py:801
↓ 1 callersMethodinit_weights
r""" Initialize model parameters using Xavier initialization.
wan/modules/model.py:609
↓ 1 callersMethodinverse
Inverse STFT => returns waveform shape (B, T).
kokoro/custom_stft.py:142
↓ 1 callersFunctionis_decord_available
()
wan/utils/qwen_vl_utils.py:215
↓ 1 callersMethodload_models_to_device
(self, loadmodel_names=[])
wan/multitalk.py:306
↓ 1 callersMethodload_single_voice
(self, voice: str)
kokoro/pipeline.py:149
↓ 1 callersMethodload_video
(self, data_key, crop_box=None, seed=2024, **kwargs)
wan/utils/vace_processor.py:227
↓ 1 callersMethodload_video_pair
(self, data_key, data_key2, crop_box=N
wan/utils/vace_processor.py:231
↓ 1 callersFunctionmain
()
kokoro/__main__.py:68
↓ 1 callersFunctionmatch_and_blend_colors
Matches the color of a source video chunk to a reference image and blends with the original. Args: source_chunk (torch.Tensor): The
wan/utils/multitalk_utils.py:361
↓ 1 callersMethodmultistep_dpm_solver_second_order_update
One step for the second-order multistep DPMSolver. Args: model_output_list (`List[torch.Tensor]`): The di
wan/utils/fm_solvers.py:488
↓ 1 callersMethodmultistep_dpm_solver_third_order_update
One step for the third-order multistep DPMSolver. Args: model_output_list (`List[torch.Tensor]`): The dir
wan/utils/fm_solvers.py:598
↓ 1 callersMethodmultistep_uni_c_bh_update
One step for the UniC (B(h) version). Args: this_model_output (`torch.Tensor`): The model outputs at `x_
wan/utils/fm_solvers_unipc.py:488
↓ 1 callersMethodmultistep_uni_p_bh_update
One step for the UniP (B(h) version). Alternatively, `self.solver_p` is used if is specified. Args: model_output (`torch
wan/utils/fm_solvers_unipc.py:352
↓ 1 callersMethodoffload
(self)
src/vram_management/layers.py:42
↓ 1 callersMethodonload
(self)
src/vram_management/layers.py:50
↓ 1 callersFunctionpad_freqs
(original_tensor, target_len)
wan/distributed/xdit_context_parallel.py:20
↓ 1 callersFunctionpatch_tensor_constructor
(fn)
src/utils.py:26
↓ 1 callersFunctionpos_interpolate
(pos, seq_len)
wan/modules/clip.py:22
↓ 1 callersMethodprecompute_freqs_cis_1d
(self, pos_indices)
wan/utils/multitalk_utils.py:165
↓ 1 callersFunctionprocess_tts_multi
(text, save_dir, voice1, voice2)
generate_multitalk.py:381
↓ 1 callersFunctionprocess_tts_multi
(text, save_dir, voice1, voice2)
app.py:372
↓ 1 callersFunctionprocess_tts_single
(text, save_dir, voice1)
generate_multitalk.py:358
↓ 1 callersFunctionprocess_tts_single
(text, save_dir, voice1)
app.py:349
↓ 1 callersFunctionproject
( v0: torch.Tensor, # [B, C, T, H, W] v1: torch.Tensor, # [B, C, T, H, W] )
wan/utils/multitalk_utils.py:327
↓ 1 callersFunctionrand_name
(length=8, suffix='')
wan/utils/multitalk_utils.py:195
↓ 1 callersFunctionrand_name
(length=8, suffix='')
wan/utils/utils.py:14
↓ 1 callersMethodreparameterize
(self, mu, log_var)
wan/modules/vae.py:570
↓ 1 callersMethodresize_crop
Resize, center crop and normalize for decord loaded video (torch.Tensor type) Parameters: video - video to process (torch.
wan/utils/vace_processor.py:113
↓ 1 callersFunctionrotate_half
(x)
wan/utils/multitalk_utils.py:147
↓ 1 callersFunctionrun_graio_demo
(args)
app.py:421
↓ 1 callersFunctionsave_video
(frames, save_path, fps, quality=9, ffmpeg_params=None)
wan/utils/multitalk_utils.py:239
↓ 1 callersMethodset_area
(self, area)
wan/utils/vace_processor.py:105
↓ 1 callersFunctionsinusoidal_embedding_1d
(dim, position)
wan/modules/multitalk_model.py:28
↓ 1 callersMethodstep
Predict the sample from the previous timestep by reversing the SDE. This function propagates the sample with the multistep UniPC.
wan/utils/fm_solvers_unipc.py:657
↓ 1 callersMethodteacache_init
( self, use_ret_steps=True, teacache_thresh=0.2, sample_steps=40, mode
wan/modules/multitalk_model.py:556
← previousnext →101–200 of 446, ranked by callers