Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/antgroup/echomimic
/ functions
Functions
352 in github.com/antgroup/echomimic
⨍
Functions
352
◇
Types & classes
83
Method
apply
(self, logits: Tensor, tokens: Tensor)
src/models/whisper/whisper/decoding.py:413
Method
attn_processors
r""" Returns: `dict` of attention processors: A dictionary containing all attention processors used in the model with
src/models/unet_3d.py:254
Method
attn_processors
r""" Returns: `dict` of attention processors: A dictionary containing all attention processors used in the model with
src/models/unet_2d_condition.py:672
Method
attn_processors
r""" Returns: `dict` of attention processors: A dictionary containing all attention processors used in the model with
src/models/unet_3d_echo.py:262
Method
cleanup_caching
(self)
src/models/whisper/whisper/decoding.py:151
Method
combine_cents
(m: Match)
src/models/whisper/whisper/normalizers/english.py:411
Method
create_custom_forward
(module, return_dict=None)
src/models/transformer_2d.py:333
Method
create_custom_forward
(module, return_dict=None)
src/models/unet_2d_blocks.py:470
Method
create_custom_forward
(module, return_dict=None)
src/models/unet_2d_blocks.py:629
Method
create_custom_forward
(module)
src/models/unet_2d_blocks.py:748
Method
create_custom_forward
(module, return_dict=None)
src/models/unet_2d_blocks.py:916
Method
create_custom_forward
(module)
src/models/unet_2d_blocks.py:1050
Method
create_custom_forward
(module, return_dict=None)
src/models/unet_3d_blocks.py:416
Method
create_custom_forward
(module)
src/models/unet_3d_blocks.py:552
Method
create_custom_forward
(module, return_dict=None)
src/models/unet_3d_blocks.py:707
Method
create_custom_forward
(module)
src/models/unet_3d_blocks.py:841
Method
create_from_model_path
Creates an `FaceLandmarker` object from a TensorFlow Lite model and the default `FaceLandmarkerOptions`. Note that the created `FaceLandmarker` i
src/utils/face_landmark.py:3074
Method
custom_forward
(*inputs)
src/models/transformer_2d.py:334
Method
custom_forward
(*inputs)
src/models/unet_2d_blocks.py:471
Method
custom_forward
(*inputs)
src/models/unet_2d_blocks.py:630
Method
custom_forward
(*inputs)
src/models/unet_2d_blocks.py:749
Method
custom_forward
(*inputs)
src/models/unet_2d_blocks.py:917
Method
custom_forward
(*inputs)
src/models/unet_2d_blocks.py:1051
Method
custom_forward
(*inputs)
src/models/unet_3d_blocks.py:417
Method
custom_forward
(*inputs)
src/models/unet_3d_blocks.py:553
Method
custom_forward
(*inputs)
src/models/unet_3d_blocks.py:708
Method
custom_forward
(*inputs)
src/models/unet_3d_blocks.py:842
Function
decode
Performs decoding of 30-second audio segment(s), provided as Mel spectrogram(s). Parameters ---------- model: Whisper the Wh
src/models/whisper/whisper/decoding.py:700
Method
decode_with_timestamps
Timestamp tokens are above the special tokens' id range and are ignored by `decode()`. This method decodes given tokens with timestam
src/models/whisper/whisper/tokenizer.py:143
Function
delete_additional_ckpt
(base_path, num_keep)
src/utils/util.py:35
Method
detect_async
Sends live image data to perform face landmarks detection. The results will be available via the "result_callback" provided in the FaceLandma
src/utils/face_landmark.py:3259
Function
detect_language
Detect the spoken language in the audio, and return them as list of strings, along with the ids of the most probable language tokens and the
src/models/whisper/whisper/decoding.py:19
Method
disable_freeu
Disables the FreeU mechanism.
src/models/unet_2d_condition.py:861
Method
disable_vae_slicing
(self)
src/pipelines/pipeline_echo_mimic_pose.py:80
Method
disable_vae_slicing
(self)
src/pipelines/pipeline_echo_mimic.py:87
Method
disable_vae_slicing
(self)
src/pipelines/pipeline_echo_mimic_acc.py:88
Method
disable_vae_slicing
(self)
src/pipelines/pipeline_echo_mimic_pose_acc.py:81
Method
embed_audio
(self, mel: torch.Tensor)
src/models/whisper/whisper/model.py:239
Method
enable_freeu
r"""Enables the FreeU mechanism from https://arxiv.org/abs/2309.11497. The suffixes after the scaling factors represent the stage blocks wher
src/models/unet_2d_condition.py:837
Method
enable_sequential_cpu_offload
(self, gpu_id=0)
src/pipelines/pipeline_echo_mimic_pose.py:83
Method
enable_sequential_cpu_offload
(self, gpu_id=0)
src/pipelines/pipeline_echo_mimic.py:90
Method
enable_sequential_cpu_offload
(self, gpu_id=0)
src/pipelines/pipeline_echo_mimic_acc.py:91
Method
enable_sequential_cpu_offload
(self, gpu_id=0)
src/pipelines/pipeline_echo_mimic_pose_acc.py:84
Method
enable_vae_slicing
(self)
src/pipelines/pipeline_echo_mimic_pose.py:77
Method
enable_vae_slicing
(self)
src/pipelines/pipeline_echo_mimic.py:84
Method
enable_vae_slicing
(self)
src/pipelines/pipeline_echo_mimic_acc.py:85
Method
enable_vae_slicing
(self)
src/pipelines/pipeline_echo_mimic_pose_acc.py:78
Method
eot
(self)
src/models/whisper/whisper/tokenizer.py:161
Method
extra_repr
(self)
src/models/motion_module.py:306
Method
extract_cents
(m: Match)
src/models/whisper/whisper/normalizers/english.py:420
Method
finalize
(self, tokens: Tensor, sum_logprobs: Tensor)
src/models/whisper/whisper/decoding.py:275
Method
finalize
(self, preceding_tokens: Tensor, sum_logprobs: Tensor)
src/models/whisper/whisper/decoding.py:351
Method
fn_recursive_add_processors
( name: str, module: torch.nn.Module, processors: Dict[str, AttentionProce
src/models/unet_3d.py:263
Method
fn_recursive_add_processors
( name: str, module: torch.nn.Module, processors: Dict[str, AttentionProce
src/models/unet_2d_condition.py:681
Method
fn_recursive_add_processors
( name: str, module: torch.nn.Module, processors: Dict[str, AttentionProce
src/models/unet_3d_echo.py:271
Method
fn_recursive_attn_processor
(name: str, module: torch.nn.Module, processor)
src/models/unet_3d.py:382
Method
fn_recursive_attn_processor
(name: str, module: torch.nn.Module, processor)
src/models/unet_2d_condition.py:726
Method
fn_recursive_attn_processor
(name: str, module: torch.nn.Module, processor)
src/models/unet_3d_echo.py:390
Method
fn_recursive_retrieve_slicable_dims
(module: torch.nn.Module)
src/models/unet_3d.py:299
Method
fn_recursive_retrieve_slicable_dims
(module: torch.nn.Module)
src/models/unet_3d_echo.py:307
Method
fn_recursive_retrieve_sliceable_dims
(module: torch.nn.Module)
src/models/unet_2d_condition.py:778
Method
fn_recursive_set_attention_slice
( module: torch.nn.Module, slice_size: List[int] )
src/models/unet_3d.py:341
Method
fn_recursive_set_attention_slice
( module: torch.nn.Module, slice_size: List[int] )
src/models/unet_2d_condition.py:820
Method
fn_recursive_set_attention_slice
( module: torch.nn.Module, slice_size: List[int] )
src/models/unet_3d_echo.py:349
Method
forward
( self, hidden_states, encoder_hidden_states=None, audio_cond_fea=None,
src/models/transformer_3d.py:103
Method
forward
The [`Transformer2DModel`] forward method. Args: hidden_states (`torch.LongTensor` of shape `(batch size, num latent pix
src/models/transformer_2d.py:213
Method
forward
r""" Args: sample (`torch.FloatTensor`): (batch, channel, height, width) noisy inputs tensor timestep (`torch.FloatTen
src/models/unet_3d.py:397
Method
forward
r""" The [`UNet2DConditionModel`] forward method. Args: sample (`torch.FloatTensor`): The noisy input ten
src/models/unet_2d_condition.py:872
Method
forward
( self, hidden_states: torch.FloatTensor, attention_mask: Optional[torch.FloatTensor]
src/models/attention.py:150
Method
forward
( self, hidden_states, encoder_hidden_states=None, audio_cond_fea = None,
src/models/attention.py:327
Method
forward
r""" Args: sample (`torch.FloatTensor`): (batch, channel, height, width) noisy inputs tensor timestep (`torch.FloatTen
src/models/unet_3d_echo.py:405
Method
forward
(self, x: torch.FloatTensor)
src/models/unet_2d_blocks.py:219
Method
forward
( self, hidden_states: torch.FloatTensor, temb: Optional[torch.FloatTensor] = None )
src/models/unet_2d_blocks.py:344
Method
forward
( self, hidden_states: torch.FloatTensor, temb: Optional[torch.FloatTensor] = None,
src/models/unet_2d_blocks.py:452
Method
forward
( self, hidden_states: torch.FloatTensor, temb: Optional[torch.FloatTensor] = None,
src/models/unet_2d_blocks.py:606
Method
forward
( self, hidden_states: torch.FloatTensor, temb: Optional[torch.FloatTensor] = None,
src/models/unet_2d_blocks.py:737
Method
forward
( self, hidden_states: torch.FloatTensor, res_hidden_states_tuple: Tuple[torch.FloatTe
src/models/unet_2d_blocks.py:872
Method
forward
( self, hidden_states: torch.FloatTensor, res_hidden_states_tuple: Tuple[torch.FloatTe
src/models/unet_2d_blocks.py:1014
Method
forward
( self, hidden_states, temb=None, encoder_hidden_states=None, audio_co
src/models/unet_3d_blocks.py:269
Method
forward
( self, hidden_states, temb=None, encoder_hidden_states=None, audio_co
src/models/unet_3d_blocks.py:400
Method
forward
(self, hidden_states, temb=None, encoder_hidden_states=None)
src/models/unet_3d_blocks.py:545
Method
forward
( self, hidden_states, res_hidden_states_tuple, temb=None, encoder_hid
src/models/unet_3d_blocks.py:687
Method
forward
( self, hidden_states, res_hidden_states_tuple, temb=None, upsample_si
src/models/unet_3d_blocks.py:824
Method
forward
(self, conditioning)
src/models/face_locator.py:47
Method
forward
(self, x)
src/models/resnet.py:10
Method
forward
(self, x)
src/models/resnet.py:21
Method
forward
(self, hidden_states, output_size=None)
src/models/resnet.py:53
Method
forward
(self, hidden_states)
src/models/resnet.py:112
Method
forward
(self, input_tensor, temb)
src/models/resnet.py:217
Method
forward
( self, input_tensor, temb, encoder_hidden_states, attention_mask=None
src/models/motion_module.py:77
Method
forward
(self, hidden_states, encoder_hidden_states=None, attention_mask=None)
src/models/motion_module.py:146
Method
forward
( self, hidden_states, encoder_hidden_states=None, attention_mask=None,
src/models/motion_module.py:236
Method
forward
(self, x)
src/models/motion_module.py:275
Method
forward
( self, hidden_states, encoder_hidden_states=None, attention_mask=None,
src/models/motion_module.py:351
Method
forward
(self, x: Tensor)
src/models/whisper/whisper/model.py:30
Method
forward
( self, x: Tensor, xa: Optional[Tensor] = None, mask: Optional[Tensor] = None,
src/models/whisper/whisper/model.py:66
Method
forward
( self, x: Tensor, xa: Optional[Tensor] = None, mask: Optional[Tensor] = None,
src/models/whisper/whisper/model.py:117
Method
forward
x : torch.Tensor, shape = (batch_size, n_mels, n_ctx) the mel spectrogram of the audio include_embeddings: bool
src/models/whisper/whisper/model.py:143
Method
forward
x : torch.LongTensor, shape = (batch_size, <= n_ctx) the text tokens xa : torch.Tensor, shape = (batch_size, n_mels, n_au
src/models/whisper/whisper/model.py:189
Method
forward
(self, mel: torch.Tensor, tokens: torch.Tensor)
src/models/whisper/whisper/model.py:245
← previous
next →
201–300 of 352, ranked by callers