Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/TMElyralab/MuseTalk
/ types & classes
Types & classes
84 in github.com/TMElyralab/MuseTalk
⨍
Functions
394
◇
Types & classes
84
↓ 31 callers
Class
Conv2d
musetalk/loss/conv.py:5
↓ 10 callers
Class
ConvBNReLU
musetalk/utils/face_parsing/model.py:14
↓ 8 callers
Class
ConvBlock
musetalk/utils/face_detection/models.py:13
↓ 7 callers
Class
FaceParsing
musetalk/utils/face_parsing/__init__.py:10
↓ 6 callers
Class
Linear
musetalk/whisper/whisper/model.py:34
↓ 5 callers
Class
LayerNorm
musetalk/whisper/whisper/model.py:29
↓ 5 callers
Class
_ConvBlock
A Convolutional block.
musetalk/loss/vgg_face.py:102
↓ 4 callers
Class
AudioProcessor
musetalk/utils/audio_processor.py:11
↓ 4 callers
Class
MultiScaleDiscriminator
Multi-scale (scale) discriminator
musetalk/loss/discriminator.py:68
↓ 3 callers
Class
BiSeNetOutput
musetalk/utils/face_parsing/model.py:37
↓ 3 callers
Class
DiscriminatorFullModel
Merge all discriminator related updates into single model for better multi-gpu usage
musetalk/loss/discriminator.py:95
↓ 3 callers
Class
L2Norm
musetalk/utils/face_detection/detection/sfd/net_s3fd.py:6
↓ 2 callers
Class
AttentionRefinementModule
musetalk/utils/face_parsing/model.py:67
↓ 2 callers
Class
BasicBlock
musetalk/utils/face_parsing/resnet.py:20
↓ 2 callers
Class
BiSeNet
musetalk/utils/face_parsing/model.py:230
↓ 2 callers
Class
Conv1d
musetalk/whisper/whisper/model.py:41
↓ 2 callers
Class
DecodingResult
musetalk/whisper/whisper/decoding.py:104
↓ 2 callers
Class
DownEncoder2D
musetalk/models/syncnet.py:183
↓ 2 callers
Class
FaceAlignment
musetalk/utils/face_detection/api.py:46
↓ 2 callers
Class
HDTFDataset
HDTF dataset class
musetalk/data/dataset.py:501
↓ 2 callers
Class
Interpolate
musetalk/loss/basic_loss.py:11
↓ 2 callers
Class
MultiHeadAttention
musetalk/whisper/whisper/model.py:57
↓ 2 callers
Class
PositionalEncoding
musetalk/models/unet.py:12
↓ 2 callers
Class
ResidualAttentionBlock
musetalk/whisper/whisper/model.py:103
↓ 2 callers
Class
Resnet18
musetalk/utils/face_parsing/resnet.py:58
↓ 2 callers
Class
UNet
musetalk/models/unet.py:29
↓ 2 callers
Class
VAE
VAE (Variational Autoencoder) class for image processing.
musetalk/models/vae.py:10
↓ 2 callers
Class
VFHQDataset
VFHQ dataset class
musetalk/data/dataset.py:514
↓ 1 callers
Class
AnalyzeFace
scripts/preprocess.py:33
↓ 1 callers
Class
AntiAliasInterpolation2d
Band-limited downsampling, for better preservation of the input signal.
musetalk/loss/vgg_face.py:173
↓ 1 callers
Class
ApplyTimestampRules
musetalk/whisper/whisper/decoding.py:405
↓ 1 callers
Class
AttentionBlock2D
musetalk/models/syncnet.py:142
↓ 1 callers
Class
Audio2Feature
musetalk/whisper/audio2feature.py:9
↓ 1 callers
Class
AudioEncoder
musetalk/whisper/whisper/model.py:131
↓ 1 callers
Class
Avatar
scripts/realtime_inference.py:57
↓ 1 callers
Class
BeamSearchDecoder
musetalk/whisper/whisper/decoding.py:281
↓ 1 callers
Class
ContextPath
musetalk/utils/face_parsing/model.py:92
↓ 1 callers
Class
DecodingOptions
musetalk/whisper/whisper/decoding.py:72
↓ 1 callers
Class
DecodingTask
musetalk/whisper/whisper/decoding.py:444
↓ 1 callers
Class
Discriminator
Discriminator similar to Pix2Pix
musetalk/loss/discriminator.py:35
↓ 1 callers
Class
DownBlock2d
Simple block for processing video (encoder).
musetalk/loss/discriminator.py:6
↓ 1 callers
Class
EnglishNumberNormalizer
Convert any spelled-out numbers into arabic numbers, while handling: - remove any commas - keep the suffixes such as: `1960s`, `274th`,
musetalk/whisper/whisper/normalizers/english.py:12
↓ 1 callers
Class
EnglishSpellingNormalizer
Applies British-American spelling mappings as listed in [1]. [1] https://www.tysto.com/uk-us-spelling-list.html
musetalk/whisper/whisper/normalizers/english.py:443
↓ 1 callers
Class
FeatureFusionModule
musetalk/utils/face_parsing/model.py:180
↓ 1 callers
Class
GreedyDecoder
musetalk/whisper/whisper/decoding.py:253
↓ 1 callers
Class
HParams
musetalk/data/audio.py:7
↓ 1 callers
Class
HourGlass
musetalk/utils/face_detection/models.py:98
↓ 1 callers
Class
ImagePyramide
Create image pyramide for computing pyramide perceptual loss.
musetalk/loss/vgg_face.py:222
↓ 1 callers
Class
MaximumLikelihoodRanker
Select the sample with the highest log probabilities, penalized using either a simple length normalization or Google NMT paper's length penal
musetalk/whisper/whisper/decoding.py:173
↓ 1 callers
Class
ModelDimensions
musetalk/whisper/whisper/model.py:16
↓ 1 callers
Class
Net
musetalk/utils/training_utils.py:25
↓ 1 callers
Class
PyTorchInference
musetalk/whisper/whisper/decoding.py:132
↓ 1 callers
Class
ResNet
musetalk/loss/resnet.py:82
↓ 1 callers
Class
ResnetBlock2D
musetalk/models/syncnet.py:71
↓ 1 callers
Class
SuppressBlank
musetalk/whisper/whisper/decoding.py:387
↓ 1 callers
Class
SuppressTokens
musetalk/whisper/whisper/decoding.py:397
↓ 1 callers
Class
SyncNet
musetalk/models/syncnet.py:18
↓ 1 callers
Class
TextDecoder
musetalk/whisper/whisper/model.py:174
↓ 1 callers
Class
Tokenizer
A thin wrapper around `GPT2TokenizerFast` providing quick access to special tokens
musetalk/whisper/whisper/tokenizer.py:130
↓ 1 callers
Class
VggFace
musetalk/loss/vgg_face.py:63
↓ 1 callers
Class
Whisper
musetalk/whisper/whisper/model.py:220
↓ 1 callers
Class
s3fd
musetalk/utils/face_detection/detection/sfd/net_s3fd.py:22
Class
BasicBlock
musetalk/loss/resnet.py:12
Class
BasicTextNormalizer
musetalk/whisper/whisper/normalizers/basic.py:55
Class
Bottleneck
musetalk/utils/face_detection/models.py:58
Class
Bottleneck
musetalk/loss/resnet.py:44
Class
Conv2dTranspose
musetalk/loss/conv.py:33
Class
EnglishTextNormalizer
musetalk/whisper/whisper/normalizers/english.py:458
Class
FAN
musetalk/utils/face_detection/models.py:145
Class
FaceDataset
Dataset class for loading and processing video data Each video can be represented as: - Concatenated frame images - '.mp4' or '.gif'
musetalk/data/dataset.py:23
Class
FaceDetector
An abstract class representing a face detector. Any other face detection implementation must subclass it. All subclasses must implement ``det
musetalk/utils/face_detection/detection/core.py:9
Class
Inference
musetalk/whisper/whisper/decoding.py:118
Class
LandmarksType
Enum class defining the type of landmarks to detect. ``_2D`` - the detected points ``(x,y)`` are detected in a 2D space and follow the visible co
musetalk/utils/face_detection/api.py:17
Class
LogitFilter
musetalk/whisper/whisper/decoding.py:371
Class
NetworkSize
musetalk/utils/face_detection/api.py:30
Class
ResNetDepth
musetalk/utils/face_detection/models.py:204
Class
SFDDetector
musetalk/utils/face_detection/detection/sfd/sfd_detector.py:16
Class
SequenceRanker
musetalk/whisper/whisper/decoding.py:164
Class
SpatialPath
musetalk/utils/face_parsing/model.py:146
Class
SyncNet_color
musetalk/loss/syncnet.py:36
Class
TokenDecoder
musetalk/whisper/whisper/decoding.py:199
Class
Vgg19
Vgg19 network for perceptual loss.
musetalk/loss/vgg_face.py:129
Class
YOLOv8_face
musetalk/utils/face_detection/api.py:89
Class
nonorm_Conv2d
musetalk/loss/conv.py:21