MCPcopy Create free account

hub / github.com/antgroup/echomimic / types & classes

Types & classes83 in github.com/antgroup/echomimic

↓ 2,688 callersClassConnection
The connection class for face landmarks.
src/utils/face_landmark.py:127
↓ 13 callersClassInflatedConv3d
src/models/resnet.py:9
↓ 8 callersClassReferenceAttentionControl
src/models/mutual_self_attention.py:19
↓ 6 callersClassLinear
src/models/whisper/whisper/model.py:34
↓ 6 callersClassResnetBlock3D
src/models/resnet.py:123
↓ 5 callersClassFaceLandmarkerResult
The face landmarks detection result from FaceLandmarker, where each vector element represents a single face detected in the image. Attributes:
src/utils/face_landmark.py:2859
↓ 5 callersClassFaceLocator
src/models/face_locator.py:12
↓ 5 callersClassLayerNorm
src/models/whisper/whisper/model.py:29
↓ 4 callersClassInflatedGroupNorm
src/models/resnet.py:20
↓ 3 callersClassFaceMeshVisualizer
src/utils/draw_utils.py:6
↓ 3 callersClassTransformer2DModel
A 2D Transformer model for image-like data. Parameters: num_attention_heads (`int`, *optional*, defaults to 16): The number of heads
src/models/transformer_2d.py:32
↓ 3 callersClassTransformer3DModel
src/models/transformer_3d.py:27
↓ 2 callersClassAudio2Feature
src/models/whisper/audio2feature.py:8
↓ 2 callersClassAudio2VideoPipeline
src/pipelines/pipeline_echo_mimic.py:43
↓ 2 callersClassConv1d
src/models/whisper/whisper/model.py:41
↓ 2 callersClassDecodingResult
src/models/whisper/whisper/decoding.py:104
↓ 2 callersClassDownsample3D
src/models/resnet.py:93
↓ 2 callersClassLMKExtractor
src/utils/mp_utils.py:19
↓ 2 callersClassMultiHeadAttention
src/models/whisper/whisper/model.py:57
↓ 2 callersClassResidualAttentionBlock
src/models/whisper/whisper/model.py:103
↓ 2 callersClassUNetMidBlock3DCrossAttn
src/models/unet_3d_blocks.py:171
↓ 2 callersClassUpsample3D
src/models/resnet.py:31
↓ 1 callersClassApplyTimestampRules
src/models/whisper/whisper/decoding.py:405
↓ 1 callersClassAudio2VideoPipeline
src/pipelines/pipeline_echo_mimic_acc.py:44
↓ 1 callersClassAudio2VideoPipelineOutput
src/pipelines/pipeline_echo_mimic.py:39
↓ 1 callersClassAudio2VideoPipelineOutput
src/pipelines/pipeline_echo_mimic_acc.py:40
↓ 1 callersClassAudioEncoder
src/models/whisper/whisper/model.py:131
↓ 1 callersClassAudioPose2VideoPipeline
src/pipelines/pipeline_echo_mimic_pose.py:35
↓ 1 callersClassAudioPose2VideoPipeline
src/pipelines/pipeline_echo_mimic_pose_acc.py:36
↓ 1 callersClassAudioPose2VideoPipelineOutput
src/pipelines/pipeline_echo_mimic_pose.py:31
↓ 1 callersClassAudioPose2VideoPipelineOutput
src/pipelines/pipeline_echo_mimic_pose_acc.py:32
↓ 1 callersClassBasicTransformerBlock
r""" A basic Transformer block. Parameters: dim (`int`): The number of channels in the input and output. num_attention_heads
src/models/attention.py:12
↓ 1 callersClassBeamSearchDecoder
src/models/whisper/whisper/decoding.py:281
↓ 1 callersClassCrossAttnDownBlock2D
src/models/unet_2d_blocks.py:510
↓ 1 callersClassCrossAttnDownBlock3D
src/models/unet_3d_blocks.py:298
↓ 1 callersClassCrossAttnUpBlock2D
src/models/unet_2d_blocks.py:779
↓ 1 callersClassCrossAttnUpBlock3D
src/models/unet_3d_blocks.py:591
↓ 1 callersClassDecodingOptions
src/models/whisper/whisper/decoding.py:72
↓ 1 callersClassDecodingTask
src/models/whisper/whisper/decoding.py:444
↓ 1 callersClassDownBlock2D
src/models/unet_2d_blocks.py:681
↓ 1 callersClassDownBlock3D
src/models/unet_3d_blocks.py:472
↓ 1 callersClassEnglishNumberNormalizer
Convert any spelled-out numbers into arabic numbers, while handling: - remove any commas - keep the suffixes such as: `1960s`, `274th`,
src/models/whisper/whisper/normalizers/english.py:12
↓ 1 callersClassEnglishSpellingNormalizer
Applies British-American spelling mappings as listed in [1]. [1] https://www.tysto.com/uk-us-spelling-list.html
src/models/whisper/whisper/normalizers/english.py:443
↓ 1 callersClassFaceLandmarkerOptions
Options for the face landmarker task. Attributes: base_options: Base options for the face landmarker task. running_mode: The running mode o
src/utils/face_landmark.py:2996
↓ 1 callersClassGreedyDecoder
src/models/whisper/whisper/decoding.py:253
↓ 1 callersClassMaximumLikelihoodRanker
Select the sample with the highest log probabilities, penalized using either a simple length normalization or Google NMT paper's length penal
src/models/whisper/whisper/decoding.py:173
↓ 1 callersClassMish
src/models/resnet.py:250
↓ 1 callersClassModelDimensions
src/models/whisper/whisper/model.py:16
↓ 1 callersClassPositionalEncoding
src/models/motion_module.py:262
↓ 1 callersClassPyTorchInference
src/models/whisper/whisper/decoding.py:132
↓ 1 callersClassSuppressBlank
src/models/whisper/whisper/decoding.py:387
↓ 1 callersClassSuppressTokens
src/models/whisper/whisper/decoding.py:397
↓ 1 callersClassTemporalBasicTransformerBlock
src/models/attention.py:244
↓ 1 callersClassTemporalTransformer3DModel
src/models/motion_module.py:94
↓ 1 callersClassTemporalTransformerBlock
src/models/motion_module.py:185
↓ 1 callersClassTextDecoder
src/models/whisper/whisper/model.py:174
↓ 1 callersClassTokenizer
A thin wrapper around `GPT2TokenizerFast` providing quick access to special tokens
src/models/whisper/whisper/tokenizer.py:130
↓ 1 callersClassTransformer2DModelOutput
The output of [`Transformer2DModel`]. Args: sample (`torch.FloatTensor` of shape `(batch_size, num_channels, height, width)` or `(ba
src/models/transformer_2d.py:18
↓ 1 callersClassTransformer3DModelOutput
src/models/transformer_3d.py:16
↓ 1 callersClassUNet2DConditionOutput
The output of [`UNet2DConditionModel`]. Args: sample (`torch.FloatTensor` of shape `(batch_size, num_channels, height, width)`):
src/models/unet_2d_condition.py:51
↓ 1 callersClassUNet3DConditionOutput
src/models/unet_3d.py:26
↓ 1 callersClassUNet3DConditionOutput
src/models/unet_3d_echo.py:34
↓ 1 callersClassUNetMidBlock2D
A 2D UNet mid-block [`UNetMidBlock2D`] with multiple residual blocks and optional attention blocks. Args: in_channels (`int`): The n
src/models/unet_2d_blocks.py:223
↓ 1 callersClassUNetMidBlock2DCrossAttn
src/models/unet_2d_blocks.py:356
↓ 1 callersClassUpBlock2D
src/models/unet_2d_blocks.py:962
↓ 1 callersClassUpBlock3D
src/models/unet_3d_blocks.py:757
↓ 1 callersClassVanillaTemporalModule
src/models/motion_module.py:44
↓ 1 callersClassVersatileAttention
src/models/motion_module.py:280
↓ 1 callersClassWhisper
src/models/whisper/whisper/model.py:220
ClassAutoencoderTinyBlock
Tiny Autoencoder block used in [`AutoencoderTiny`]. It is a mini residual module consisting of plain conv + ReLU blocks. Args: i
src/models/unet_2d_blocks.py:186
ClassBasicTextNormalizer
src/models/whisper/whisper/normalizers/basic.py:55
ClassBlendshapes
The 52 blendshape coefficients.
src/utils/face_landmark.py:66
ClassEchoUNet3DConditionModel
src/models/unet_3d_echo.py:38
ClassEnglishTextNormalizer
src/models/whisper/whisper/normalizers/english.py:458
ClassFaceLandmarker
Class that performs face landmarks detection on images.
src/utils/face_landmark.py:3070
ClassFaceLandmarksConnections
The connections between face landmarks.
src/utils/face_landmark.py:123
ClassInference
src/models/whisper/whisper/decoding.py:118
ClassLogitFilter
src/models/whisper/whisper/decoding.py:371
ClassSequenceRanker
src/models/whisper/whisper/decoding.py:164
ClassTemporalTransformer3DModelOutput
src/models/motion_module.py:23
ClassTokenDecoder
src/models/whisper/whisper/decoding.py:199
ClassUNet2DConditionModel
r""" A conditional 2D UNet model that takes a noisy sample, conditional state, and a timestep and returns a sample shaped output. This mo
src/models/unet_2d_condition.py:64
ClassUNet3DConditionModel
src/models/unet_3d.py:30