MCPcopy Create free account

hub / github.com/MeiGen-AI/MultiTalk / functions

Functions446 in github.com/MeiGen-AI/MultiTalk

↓ 41 callersMethoddevice
(self)
kokoro/model.py:82
↓ 15 callersFunctiontorch_gc
()
wan/multitalk.py:39
↓ 13 callersMethodupdate
(self, update_value: torch.Tensor)
wan/utils/multitalk_utils.py:321
↓ 10 callersMethod_sigma_to_alpha_sigma_t
(self, sigma)
wan/utils/fm_solvers.py:335
↓ 10 callersFunctionflash_attention
q: [B, Lq, Nq, C1]. k: [B, Lk, Nk, C1]. v: [B, Lk, Nk, C2]. Nq must be divisible by Nk. q_lens
wan/modules/attention.py:33
↓ 9 callersMethodencode
videos: A list of videos each with shape [C, T, H, W].
wan/modules/vae.py:647
↓ 8 callersMethod__init__
(self, vocab_size, dim, dim_attn, dim_ffn,
wan/modules/t5.py:379
↓ 8 callersMethod__init__
(self, z_dim=16, vae_pth='cache/vae_step_411000.pth', dtype
wan/modules/vae.py:621
↓ 8 callersMethod__init__
(self, dim, out_dim, patch_size, eps=1e-6)
wan/modules/multitalk_model.py:323
↓ 8 callersMethod__init__
(self, style_dim, num_features)
kokoro/istftnet.py:21
↓ 8 callersMethod_sigma_to_alpha_sigma_t
(self, sigma)
wan/utils/fm_solvers_unipc.py:274
↓ 8 callersMethodset_timesteps
Sets the discrete timesteps used for the diffusion chain (to be run before inference). Args: num_inference_steps (`int`):
wan/utils/fm_solvers.py:228
↓ 7 callersMethod__init__
(self, dim, out_dim, patch_size, eps=1e-6)
wan/modules/model.py:322
↓ 7 callersMethoddecode
(self, zs)
wan/modules/vae.py:657
↓ 6 callersMethod__init__
(self, dim, mid_dim)
wan/modules/clip.py:96
↓ 6 callersFunctionget_embedding
(speech_array, wav2vec_feature_extractor, audio_encoder, sr=16000, device='cpu')
generate_multitalk.py:300
↓ 6 callersFunctionget_embedding
(speech_array, wav2vec_feature_extractor, audio_encoder, sr=16000, device='cpu')
app.py:291
↓ 6 callersFunctionget_padding
(kernel_size, dilation=1)
kokoro/istftnet.py:16
↓ 6 callersFunctionhalf
(x)
wan/modules/attention.py:68
↓ 6 callersFunctionhalf
(x)
wan/distributed/xdit_context_parallel.py:193
↓ 6 callersFunctionrope_params
(max_seq_len, dim, theta=10000)
wan/modules/multitalk_model.py:42
↓ 5 callersMethod__init__
(self, channels, eps=1e-5)
kokoro/modules.py:22
↓ 5 callersFunctionaudio_prepare_single
(audio_path, sample_rate=16000)
generate_multitalk.py:348
↓ 5 callersFunctionaudio_prepare_single
(audio_path, sample_rate=16000)
app.py:339
↓ 5 callersFunctionfp16_clamp
(x)
wan/modules/t5.py:25
↓ 5 callersFunctionget_sampling_sigmas
(sampling_steps, shift)
wan/utils/fm_solvers.py:24
↓ 5 callersFunctionretrieve_timesteps
( scheduler, num_inference_steps=None, device=None, timesteps=None, sigmas=None, **kwa
wan/utils/fm_solvers.py:31
↓ 5 callersMethodstep
Predict the sample from the previous timestep by reversing the SDE. This function propagates the sample with the multistep DPMSolver.
wan/utils/fm_solvers.py:708
↓ 4 callersFunctionceil_by_factor
Returns the smallest integer greater than or equal to 'number' that is divisible by 'factor'.
wan/utils/qwen_vl_utils.py:44
↓ 4 callersMethodclear_cache
(self)
wan/modules/vae.py:582
↓ 4 callersMethodinfer
( model: KModel, ps: str, pack: torch.FloatTensor, speed: Union[float, Callabl
kokoro/pipeline.py:237
↓ 4 callersFunctionnormalize_and_scale
(column, source_range, target_range, epsilon=1e-8)
wan/utils/multitalk_utils.py:69
↓ 4 callersFunctionqkv_fn
(x)
wan/distributed/xdit_context_parallel.py:197
↓ 4 callersFunctionrope_apply
x: [B, L, N, C]. grid_sizes: [B, 3]. freqs: [M, C // 2].
wan/distributed/xdit_context_parallel.py:34
↓ 4 callersFunctionround_by_factor
Returns the closest integer to 'number' that is divisible by 'factor'.
wan/utils/qwen_vl_utils.py:39
↓ 4 callersFunctionsinusoidal_embedding_1d
(dim, position)
wan/modules/model.py:18
↓ 4 callersFunctionsmart_resize
Rescales the image so that the following conditions are met: 1. Both dimensions (height and width) are divisible by 'factor'. 2. The to
wan/utils/qwen_vl_utils.py:54
↓ 4 callersMethodtokens_to_ps
(tokens: List[en.MToken])
kokoro/pipeline.py:183
↓ 4 callersMethodunpatchify
r""" Reconstruct video tensors from patch embeddings. Args: x (List[Tensor]): List of patchified features
wan/modules/model.py:584
↓ 4 callersMethodvisual
(self, videos)
wan/modules/clip.py:527
↓ 3 callersFunctionadaptive_projected_guidance
( diff: torch.Tensor, # [B, C, T, H, W] pred_cond: torch.Tensor, # [B, C, T, H, W]
wan/utils/multitalk_utils.py:339
↓ 3 callersFunctionbasic_clean
(text)
wan/modules/tokenizers.py:12
↓ 3 callersFunctionfloor_by_factor
Returns the largest integer less than or equal to 'number' that is divisible by 'factor'.
wan/utils/qwen_vl_utils.py:49
↓ 3 callersMethodgenerate
r""" Generates video frames from text prompt using diffusion process. Args: input_prompt (`str`): Text pr
wan/vace.py:295
↓ 3 callersFunctionrope_params
(max_seq_len, dim, theta=10000)
wan/modules/model.py:32
↓ 3 callersMethodtransfer_data_to_cuda
(self, data, device)
wan/vace.py:544
↓ 2 callersMethod__init__
(self, vace_layers=None, vace_in_dim=None, model_type='vace
wan/modules/vace_model.py:68
↓ 2 callersMethod__init__
(self, vocab_size=250002, max_seq_len=514, type_size=1,
wan/modules/xlm_roberta.py:81
↓ 2 callersMethod__init__
(self, model_name, is_vl=False, device=0, **kwargs)
wan/utils/prompt_extend.py:166
↓ 2 callersMethod__init__
( self, module: torch.nn.Module, offload_dtype, offload_device, onload
src/vram_management/layers.py:22
↓ 2 callersMethod_f02uv
(self, f0)
kokoro/istftnet.py:137
↓ 2 callersMethod_threshold_sample
"Dynamic thresholding: At each sampling step we set s to a certain percentile absolute pixel value in xt0 (the prediction of x_0 at t
wan/utils/fm_solvers.py:294
↓ 2 callersMethod_threshold_sample
"Dynamic thresholding: At each sampling step we set s to a certain percentile absolute pixel value in xt0 (the prediction of x_0 at t
wan/utils/fm_solvers_unipc.py:232
↓ 2 callersMethodadd_noise
compatible with diffusers add_noise()
wan/multitalk.py:257
↓ 2 callersFunctioncast_to
(weight, dtype, device)
src/vram_management/layers.py:8
↓ 2 callersFunctioncast_to_device
(weight, device)
src/vram_management/layers.py:13
↓ 2 callersFunctioncount_conv3d
(model)
wan/modules/vae.py:475
↓ 2 callersMethoddecode_latent
(self, zs, ref_images=None, vae=None)
wan/vace.py:280
↓ 2 callersMethoden_tokenize
( self, tokens: List[en.MToken] )
kokoro/pipeline.py:208
↓ 2 callersMethodenable_vram_management
(self, num_persistent_param_in_dit=None)
wan/multitalk.py:271
↓ 2 callersMethodencode
(self, x, scale)
wan/modules/vae.py:516
↓ 2 callersMethodextend
(self, prompt, system_prompt, seed=-1, *args, **kwargs)
wan/utils/prompt_extend.py:180
↓ 2 callersFunctionfetch_image
(ele: dict[str, str | Image.Image], size_factor: int = IMAGE_FACTOR)
wan/utils/qwen_vl_utils.py:85
↓ 2 callersMethodforward
(self, x)
wan/modules/clip.py:106
↓ 2 callersMethodforward
(self, x)
wan/modules/vae.py:510
↓ 2 callersMethodforward
r""" Forward pass through the diffusion model Args: x (List[Tensor]): List of input video tensors, each w
wan/modules/vace_model.py:155
↓ 2 callersMethodforward_with_tokens
( self, input_ids: torch.LongTensor, ref_s: torch.FloatTensor, speed: float =
kokoro/model.py:91
↓ 2 callersFunctionget_attn_map_with_target
Args: query (torch.tensor): B M H K key (torch.tensor): B M H K shape (tuple): (N_t, N_h, N_w) ref_target_masks: [B, N
wan/utils/multitalk_utils.py:120
↓ 2 callersMethodindex_for_timestep
(self, timestep, schedule_timesteps=None)
wan/utils/fm_solvers.py:681
↓ 2 callersMethodindex_for_timestep
(self, timestep, schedule_timesteps=None)
wan/utils/fm_solvers_unipc.py:630
↓ 2 callersFunctioninit_weights_on_device
(device=torch.device("meta"), include_buffers: bool = False)
src/utils.py:6
↓ 2 callersMethodinverse
(self, magnitude, phase)
kokoro/istftnet.py:96
↓ 2 callersMethodjoin_timestamps
(tokens: List[en.MToken], pred_dur: torch.LongTensor)
kokoro/pipeline.py:298
↓ 2 callersFunctionlinear_interpolation
(features, seq_len)
src/audio_analysis/torch_utils.py:16
↓ 2 callersMethodload_image_batch
(self, *data_key_batch, normalize=True,
wan/utils/vace_processor.py:69
↓ 2 callersMethodload_lora
(self, lora_path, lora_name=None)
wan/wan_lora.py:20
↓ 2 callersMethodload_video_batch
(self, *data_key_batch, crop_box=None,
wan/utils/vace_processor.py:240
↓ 2 callersMethodload_voice
(self, voice: Union[str, torch.FloatTensor], delimiter: str = ",")
kokoro/pipeline.py:170
↓ 2 callersFunctionloudness_norm
(audio_array, sr=16000, lufs=-23)
generate_multitalk.py:260
↓ 2 callersFunctionloudness_norm
(audio_array, sr=16000, lufs=-23)
app.py:252
↓ 2 callersFunctionresize_and_centercrop
Resize image or tensor to the target size without padding.
wan/multitalk.py:51
↓ 2 callersFunctionrope_apply
(x, grid_sizes, freqs)
wan/modules/multitalk_model.py:54
↓ 2 callersFunctionrope_apply
(x, grid_sizes, freqs)
wan/modules/model.py:43
↓ 2 callersFunctionsave_video_ffmpeg
(gen_video_samples, save_path, vocal_audio_list, fps=25, quality=5, high_quality_save=False)
wan/utils/multitalk_utils.py:237
↓ 2 callersMethodset_seq_len
(self, seq_len)
wan/utils/vace_processor.py:109
↓ 2 callersFunctionsmart_nframes
calculate the number of frames for video used for model inputs. Args: ele (dict): a dict contains the configuration of video.
wan/utils/qwen_vl_utils.py:133
↓ 2 callersFunctionsplit_token_counts_and_frame_ids
(T, token_frame, world_size, rank)
wan/utils/multitalk_utils.py:49
↓ 2 callersMethodtokens_to_text
(tokens: List[en.MToken])
kokoro/pipeline.py:205
↓ 2 callersFunctiontorch_gc
()
wan/utils/multitalk_utils.py:43
↓ 2 callersMethodtransform
(self, input_data)
kokoro/istftnet.py:89
↓ 2 callersFunctionumt5_xxl
(**kwargs)
wan/modules/t5.py:461
↓ 2 callersMethodvace_encode_frames
(self, frames, ref_images, masks=None, vae=None)
wan/vace.py:139
↓ 2 callersMethodvace_encode_masks
(self, masks, ref_images=None, vae_stride=None)
wan/vace.py:174
↓ 2 callersMethodvace_latent
(self, z, m)
wan/vace.py:209
↓ 2 callersFunctionwhitespace_clean
(text)
wan/modules/tokenizers.py:18
↓ 1 callersMethodF0Ntrain
(self, x, s)
kokoro/modules.py:124
↓ 1 callersMethod__init__
( self, dim: int, encoder_hidden_states_dim: int, num_heads: int, qkv_
wan/modules/attention.py:192
↓ 1 callersMethod__init__
(self, momentum: float)
wan/utils/multitalk_utils.py:317
↓ 1 callersMethod__init__
( self, repo_id: Optional[str] = None, config: Union[Dict, str, None] = None,
kokoro/model.py:32
↓ 1 callersMethod_apply_lora_weights
(self, lora_weights, alpha, device)
wan/wan_lora.py:63
next →1–100 of 446, ranked by callers