MCPcopy Create free account

hub / github.com/antgroup/echomimic / functions

Functions352 in github.com/antgroup/echomimic

Methodapply
(self, logits: Tensor, tokens: Tensor)
src/models/whisper/whisper/decoding.py:413
Methodattn_processors
r""" Returns: `dict` of attention processors: A dictionary containing all attention processors used in the model with
src/models/unet_3d.py:254
Methodattn_processors
r""" Returns: `dict` of attention processors: A dictionary containing all attention processors used in the model with
src/models/unet_2d_condition.py:672
Methodattn_processors
r""" Returns: `dict` of attention processors: A dictionary containing all attention processors used in the model with
src/models/unet_3d_echo.py:262
Methodcleanup_caching
(self)
src/models/whisper/whisper/decoding.py:151
Methodcombine_cents
(m: Match)
src/models/whisper/whisper/normalizers/english.py:411
Methodcreate_custom_forward
(module, return_dict=None)
src/models/transformer_2d.py:333
Methodcreate_custom_forward
(module, return_dict=None)
src/models/unet_2d_blocks.py:470
Methodcreate_custom_forward
(module, return_dict=None)
src/models/unet_2d_blocks.py:629
Methodcreate_custom_forward
(module)
src/models/unet_2d_blocks.py:748
Methodcreate_custom_forward
(module, return_dict=None)
src/models/unet_2d_blocks.py:916
Methodcreate_custom_forward
(module)
src/models/unet_2d_blocks.py:1050
Methodcreate_custom_forward
(module, return_dict=None)
src/models/unet_3d_blocks.py:416
Methodcreate_custom_forward
(module)
src/models/unet_3d_blocks.py:552
Methodcreate_custom_forward
(module, return_dict=None)
src/models/unet_3d_blocks.py:707
Methodcreate_custom_forward
(module)
src/models/unet_3d_blocks.py:841
Methodcreate_from_model_path
Creates an `FaceLandmarker` object from a TensorFlow Lite model and the default `FaceLandmarkerOptions`. Note that the created `FaceLandmarker` i
src/utils/face_landmark.py:3074
Methodcustom_forward
(*inputs)
src/models/transformer_2d.py:334
Methodcustom_forward
(*inputs)
src/models/unet_2d_blocks.py:471
Methodcustom_forward
(*inputs)
src/models/unet_2d_blocks.py:630
Methodcustom_forward
(*inputs)
src/models/unet_2d_blocks.py:749
Methodcustom_forward
(*inputs)
src/models/unet_2d_blocks.py:917
Methodcustom_forward
(*inputs)
src/models/unet_2d_blocks.py:1051
Methodcustom_forward
(*inputs)
src/models/unet_3d_blocks.py:417
Methodcustom_forward
(*inputs)
src/models/unet_3d_blocks.py:553
Methodcustom_forward
(*inputs)
src/models/unet_3d_blocks.py:708
Methodcustom_forward
(*inputs)
src/models/unet_3d_blocks.py:842
Functiondecode
Performs decoding of 30-second audio segment(s), provided as Mel spectrogram(s). Parameters ---------- model: Whisper the Wh
src/models/whisper/whisper/decoding.py:700
Methoddecode_with_timestamps
Timestamp tokens are above the special tokens' id range and are ignored by `decode()`. This method decodes given tokens with timestam
src/models/whisper/whisper/tokenizer.py:143
Functiondelete_additional_ckpt
(base_path, num_keep)
src/utils/util.py:35
Methoddetect_async
Sends live image data to perform face landmarks detection. The results will be available via the "result_callback" provided in the FaceLandma
src/utils/face_landmark.py:3259
Functiondetect_language
Detect the spoken language in the audio, and return them as list of strings, along with the ids of the most probable language tokens and the
src/models/whisper/whisper/decoding.py:19
Methoddisable_freeu
Disables the FreeU mechanism.
src/models/unet_2d_condition.py:861
Methoddisable_vae_slicing
(self)
src/pipelines/pipeline_echo_mimic_pose.py:80
Methoddisable_vae_slicing
(self)
src/pipelines/pipeline_echo_mimic.py:87
Methoddisable_vae_slicing
(self)
src/pipelines/pipeline_echo_mimic_acc.py:88
Methoddisable_vae_slicing
(self)
src/pipelines/pipeline_echo_mimic_pose_acc.py:81
Methodembed_audio
(self, mel: torch.Tensor)
src/models/whisper/whisper/model.py:239
Methodenable_freeu
r"""Enables the FreeU mechanism from https://arxiv.org/abs/2309.11497. The suffixes after the scaling factors represent the stage blocks wher
src/models/unet_2d_condition.py:837
Methodenable_sequential_cpu_offload
(self, gpu_id=0)
src/pipelines/pipeline_echo_mimic_pose.py:83
Methodenable_sequential_cpu_offload
(self, gpu_id=0)
src/pipelines/pipeline_echo_mimic.py:90
Methodenable_sequential_cpu_offload
(self, gpu_id=0)
src/pipelines/pipeline_echo_mimic_acc.py:91
Methodenable_sequential_cpu_offload
(self, gpu_id=0)
src/pipelines/pipeline_echo_mimic_pose_acc.py:84
Methodenable_vae_slicing
(self)
src/pipelines/pipeline_echo_mimic_pose.py:77
Methodenable_vae_slicing
(self)
src/pipelines/pipeline_echo_mimic.py:84
Methodenable_vae_slicing
(self)
src/pipelines/pipeline_echo_mimic_acc.py:85
Methodenable_vae_slicing
(self)
src/pipelines/pipeline_echo_mimic_pose_acc.py:78
Methodeot
(self)
src/models/whisper/whisper/tokenizer.py:161
Methodextra_repr
(self)
src/models/motion_module.py:306
Methodextract_cents
(m: Match)
src/models/whisper/whisper/normalizers/english.py:420
Methodfinalize
(self, tokens: Tensor, sum_logprobs: Tensor)
src/models/whisper/whisper/decoding.py:275
Methodfinalize
(self, preceding_tokens: Tensor, sum_logprobs: Tensor)
src/models/whisper/whisper/decoding.py:351
Methodfn_recursive_add_processors
( name: str, module: torch.nn.Module, processors: Dict[str, AttentionProce
src/models/unet_3d.py:263
Methodfn_recursive_add_processors
( name: str, module: torch.nn.Module, processors: Dict[str, AttentionProce
src/models/unet_2d_condition.py:681
Methodfn_recursive_add_processors
( name: str, module: torch.nn.Module, processors: Dict[str, AttentionProce
src/models/unet_3d_echo.py:271
Methodfn_recursive_attn_processor
(name: str, module: torch.nn.Module, processor)
src/models/unet_3d.py:382
Methodfn_recursive_attn_processor
(name: str, module: torch.nn.Module, processor)
src/models/unet_2d_condition.py:726
Methodfn_recursive_attn_processor
(name: str, module: torch.nn.Module, processor)
src/models/unet_3d_echo.py:390
Methodfn_recursive_retrieve_slicable_dims
(module: torch.nn.Module)
src/models/unet_3d.py:299
Methodfn_recursive_retrieve_slicable_dims
(module: torch.nn.Module)
src/models/unet_3d_echo.py:307
Methodfn_recursive_retrieve_sliceable_dims
(module: torch.nn.Module)
src/models/unet_2d_condition.py:778
Methodfn_recursive_set_attention_slice
( module: torch.nn.Module, slice_size: List[int] )
src/models/unet_3d.py:341
Methodfn_recursive_set_attention_slice
( module: torch.nn.Module, slice_size: List[int] )
src/models/unet_2d_condition.py:820
Methodfn_recursive_set_attention_slice
( module: torch.nn.Module, slice_size: List[int] )
src/models/unet_3d_echo.py:349
Methodforward
( self, hidden_states, encoder_hidden_states=None, audio_cond_fea=None,
src/models/transformer_3d.py:103
Methodforward
The [`Transformer2DModel`] forward method. Args: hidden_states (`torch.LongTensor` of shape `(batch size, num latent pix
src/models/transformer_2d.py:213
Methodforward
r""" Args: sample (`torch.FloatTensor`): (batch, channel, height, width) noisy inputs tensor timestep (`torch.FloatTen
src/models/unet_3d.py:397
Methodforward
r""" The [`UNet2DConditionModel`] forward method. Args: sample (`torch.FloatTensor`): The noisy input ten
src/models/unet_2d_condition.py:872
Methodforward
( self, hidden_states: torch.FloatTensor, attention_mask: Optional[torch.FloatTensor]
src/models/attention.py:150
Methodforward
( self, hidden_states, encoder_hidden_states=None, audio_cond_fea = None,
src/models/attention.py:327
Methodforward
r""" Args: sample (`torch.FloatTensor`): (batch, channel, height, width) noisy inputs tensor timestep (`torch.FloatTen
src/models/unet_3d_echo.py:405
Methodforward
(self, x: torch.FloatTensor)
src/models/unet_2d_blocks.py:219
Methodforward
( self, hidden_states: torch.FloatTensor, temb: Optional[torch.FloatTensor] = None )
src/models/unet_2d_blocks.py:344
Methodforward
( self, hidden_states: torch.FloatTensor, temb: Optional[torch.FloatTensor] = None,
src/models/unet_2d_blocks.py:452
Methodforward
( self, hidden_states: torch.FloatTensor, temb: Optional[torch.FloatTensor] = None,
src/models/unet_2d_blocks.py:606
Methodforward
( self, hidden_states: torch.FloatTensor, temb: Optional[torch.FloatTensor] = None,
src/models/unet_2d_blocks.py:737
Methodforward
( self, hidden_states: torch.FloatTensor, res_hidden_states_tuple: Tuple[torch.FloatTe
src/models/unet_2d_blocks.py:872
Methodforward
( self, hidden_states: torch.FloatTensor, res_hidden_states_tuple: Tuple[torch.FloatTe
src/models/unet_2d_blocks.py:1014
Methodforward
( self, hidden_states, temb=None, encoder_hidden_states=None, audio_co
src/models/unet_3d_blocks.py:269
Methodforward
( self, hidden_states, temb=None, encoder_hidden_states=None, audio_co
src/models/unet_3d_blocks.py:400
Methodforward
(self, hidden_states, temb=None, encoder_hidden_states=None)
src/models/unet_3d_blocks.py:545
Methodforward
( self, hidden_states, res_hidden_states_tuple, temb=None, encoder_hid
src/models/unet_3d_blocks.py:687
Methodforward
( self, hidden_states, res_hidden_states_tuple, temb=None, upsample_si
src/models/unet_3d_blocks.py:824
Methodforward
(self, conditioning)
src/models/face_locator.py:47
Methodforward
(self, x)
src/models/resnet.py:10
Methodforward
(self, x)
src/models/resnet.py:21
Methodforward
(self, hidden_states, output_size=None)
src/models/resnet.py:53
Methodforward
(self, hidden_states)
src/models/resnet.py:112
Methodforward
(self, input_tensor, temb)
src/models/resnet.py:217
Methodforward
( self, input_tensor, temb, encoder_hidden_states, attention_mask=None
src/models/motion_module.py:77
Methodforward
(self, hidden_states, encoder_hidden_states=None, attention_mask=None)
src/models/motion_module.py:146
Methodforward
( self, hidden_states, encoder_hidden_states=None, attention_mask=None,
src/models/motion_module.py:236
Methodforward
(self, x)
src/models/motion_module.py:275
Methodforward
( self, hidden_states, encoder_hidden_states=None, attention_mask=None,
src/models/motion_module.py:351
Methodforward
(self, x: Tensor)
src/models/whisper/whisper/model.py:30
Methodforward
( self, x: Tensor, xa: Optional[Tensor] = None, mask: Optional[Tensor] = None,
src/models/whisper/whisper/model.py:66
Methodforward
( self, x: Tensor, xa: Optional[Tensor] = None, mask: Optional[Tensor] = None,
src/models/whisper/whisper/model.py:117
Methodforward
x : torch.Tensor, shape = (batch_size, n_mels, n_ctx) the mel spectrogram of the audio include_embeddings: bool
src/models/whisper/whisper/model.py:143
Methodforward
x : torch.LongTensor, shape = (batch_size, <= n_ctx) the text tokens xa : torch.Tensor, shape = (batch_size, n_mels, n_au
src/models/whisper/whisper/model.py:189
Methodforward
(self, mel: torch.Tensor, tokens: torch.Tensor)
src/models/whisper/whisper/model.py:245
← previousnext →201–300 of 352, ranked by callers