Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/TMElyralab/MuseTalk
/ functions
Functions
394 in github.com/TMElyralab/MuseTalk
⨍
Functions
394
◇
Types & classes
84
Method
forward
(self, x)
musetalk/utils/face_parsing/model.py:26
Method
forward
(self, x)
musetalk/utils/face_parsing/model.py:44
Method
forward
(self, x)
musetalk/utils/face_parsing/model.py:76
Method
forward
(self, x)
musetalk/utils/face_parsing/model.py:104
Method
forward
(self, x)
musetalk/utils/face_parsing/model.py:155
Method
forward
(self, fsp, fcp)
musetalk/utils/face_parsing/model.py:200
Method
forward
(self, x)
musetalk/utils/face_parsing/model.py:241
Method
forward
(self, x)
musetalk/utils/face_parsing/resnet.py:36
Method
forward
(self, x)
musetalk/utils/face_parsing/resnet.py:71
Method
forward
(self, x: Tensor)
musetalk/whisper/whisper/model.py:30
Method
forward
( self, x: Tensor, xa: Optional[Tensor] = None, mask: Optional[Tensor] = None,
musetalk/whisper/whisper/model.py:66
Method
forward
( self, x: Tensor, xa: Optional[Tensor] = None, mask: Optional[Tensor] = None,
musetalk/whisper/whisper/model.py:117
Method
forward
x : torch.Tensor, shape = (batch_size, n_mels, n_ctx) the mel spectrogram of the audio include_embeddings: bool
musetalk/whisper/whisper/model.py:143
Method
forward
x : torch.LongTensor, shape = (batch_size, <= n_ctx) the text tokens xa : torch.Tensor, shape = (batch_size, n_mels, n_au
musetalk/whisper/whisper/model.py:189
Method
forward
(self, mel: torch.Tensor, tokens: torch.Tensor)
musetalk/whisper/whisper/model.py:245
Method
forward
(self, x)
musetalk/models/unet.py:23
Method
forward
(self, image_sequences, audio_sequences)
musetalk/models/syncnet.py:39
Method
forward
(self, input_tensor)
musetalk/models/syncnet.py:117
Method
forward
(self, hidden_states)
musetalk/models/syncnet.py:162
Method
forward
(self, hidden_states)
musetalk/models/syncnet.py:229
Method
forward
(self, input)
musetalk/loss/basic_loss.py:19
Method
forward
(self, audio_sequences, face_sequences)
musetalk/loss/syncnet.py:84
Method
forward
(self, x)
musetalk/loss/discriminator.py:24
Method
forward
(self, x)
musetalk/loss/discriminator.py:56
Method
forward
(self, x)
musetalk/loss/discriminator.py:81
Method
forward
(self, x, generated, gan_mode='ls')
musetalk/loss/discriminator.py:117
Method
forward
(self, x)
musetalk/loss/vgg_face.py:89
Method
forward
(self, x)
musetalk/loss/vgg_face.py:118
Method
forward
(self, X)
musetalk/loss/vgg_face.py:161
Method
forward
(self, input)
musetalk/loss/vgg_face.py:211
Method
forward
(self, x)
musetalk/loss/vgg_face.py:233
Method
forward
(self, x)
musetalk/loss/conv.py:15
Method
forward
(self, x)
musetalk/loss/conv.py:29
Method
forward
(self, x)
musetalk/loss/conv.py:42
Method
forward
(self, x)
musetalk/loss/resnet.py:25
Method
forward
(self, x)
musetalk/loss/resnet.py:59
Method
forward
(self, x)
musetalk/loss/resnet.py:126
Method
get_params
(self)
musetalk/utils/face_parsing/model.py:55
Method
get_params
(self)
musetalk/utils/face_parsing/model.py:133
Method
get_params
(self)
musetalk/utils/face_parsing/model.py:168
Method
get_params
(self)
musetalk/utils/face_parsing/model.py:218
Function
get_preds_fromhm
Obtain (x,y) coordinates given a set of N heatmaps. If the center and the scale is provided the function will return the points also in the or
musetalk/utils/face_detection/utils.py:132
Function
get_preds_fromhm_batch
Obtain (x,y) coordinates given a set of N heatmaps. If the centers and the scales is provided the function will return the points also in the
musetalk/utils/face_detection/utils.py:172
Method
get_sliced_feature_sparse
Get sliced features based on a given index :param feature_array: :param start_idx: the start index of the feature :p
musetalk/whisper/audio2feature.py:47
Function
inference
(audio_path, video_path, bbox_shift, extra_margin=10, parsing_mode="jaw", left_cheek_width=90,
app.py:184
Method
install_hooks
(layer: nn.Module)
musetalk/whisper/whisper/model.py:280
Function
inv_preemphasis
(wav, k, inv_preemphasize=True)
musetalk/data/audio.py:57
Method
is_multilingual
(self)
musetalk/whisper/whisper/model.py:253
Method
language_token
Returns the token id corresponding to the value of the `language` field
musetalk/whisper/whisper/tokenizer.py:196
Function
librosa_pad_lr
(x, fsize, fshift)
musetalk/data/audio.py:118
Function
linearspectrogram
(wav)
musetalk/data/audio.py:69
Function
load_wav
(path, sr)
musetalk/data/audio.py:36
Method
logits
(self, tokens: Tensor, audio_features: Tensor, include_embeddings=False)
musetalk/whisper/whisper/decoding.py:139
Method
logits
(self, tokens: torch.Tensor, audio_features: torch.Tensor)
musetalk/whisper/whisper/model.py:242
Function
main
()
musetalk/loss/discriminator.py:138
Function
melspectrogram
(wav)
musetalk/data/audio.py:77
Method
no_speech
(self)
musetalk/whisper/whisper/tokenizer.py:181
Method
no_timestamps
(self)
musetalk/whisper/whisper/tokenizer.py:186
Method
non_speech_tokens
Returns the list of tokens to suppress in order to avoid any speaker tags or non-speech annotations, to prevent sampling texts that a
musetalk/whisper/whisper/tokenizer.py:237
Function
optional_float
(string)
musetalk/whisper/whisper/utils.py:22
Function
optional_int
(string)
musetalk/whisper/whisper/utils.py:18
Function
pad_lr
Compute left and right padding
musetalk/data/audio.py:108
Function
print_directory_contents
(path)
app.py:125
Method
process_frames
(self, res_frame_queue, video_len, skip_save_images)
scripts/realtime_inference.py:212
Function
pts_to_bb
(pts)
musetalk/utils/face_detection/detection/sfd/detect.py:111
Function
rand_log_normal
Draws samples from an lognormal distribution.
musetalk/utils/utils.py:88
Method
rank
(self, tokens: List[List[Tensor]], sum_logprobs: List[List[float]])
musetalk/whisper/whisper/decoding.py:182
Method
rearrange_kv_cache
(self, source_indices)
musetalk/whisper/whisper/decoding.py:158
Method
reference_scale
(self)
musetalk/utils/face_detection/detection/core.py:104
Method
reference_scale
(self)
musetalk/utils/face_detection/detection/sfd/sfd_detector.py:50
Method
reference_x_shift
(self)
musetalk/utils/face_detection/detection/core.py:108
Method
reference_x_shift
(self)
musetalk/utils/face_detection/detection/sfd/sfd_detector.py:54
Method
reference_y_shift
(self)
musetalk/utils/face_detection/detection/core.py:112
Method
reference_y_shift
(self)
musetalk/utils/face_detection/detection/sfd/sfd_detector.py:58
Function
remove_symbols
Replace any other markers, symbols, punctuations with a space, keeping diacritics
musetalk/whisper/whisper/normalizers/basic.py:46
Method
reset
(self)
musetalk/whisper/whisper/decoding.py:292
Function
resize_landmark
(landmark, w, h, new_w, new_h)
musetalk/utils/preprocessing.py:28
Function
resnet50
Constructs a ResNet-50 model.
musetalk/loss/resnet.py:148
Method
save_to_cache
(module, _, output)
musetalk/whisper/whisper/model.py:273
Function
save_wav
(wav, path, sr)
musetalk/data/audio.py:44
Function
save_wavenet_wav
(wav, path, sr)
musetalk/data/audio.py:49
Method
scores
(logprobs, lengths)
musetalk/whisper/whisper/decoding.py:183
Method
sot
(self)
musetalk/whisper/whisper/tokenizer.py:166
Method
sot_lm
(self)
musetalk/whisper/whisper/tokenizer.py:171
Method
sot_prev
(self)
musetalk/whisper/whisper/tokenizer.py:176
Method
sot_sequence_including_notimestamps
(self)
musetalk/whisper/whisper/tokenizer.py:232
Function
str2bool
(string)
musetalk/whisper/whisper/utils.py:10
Function
summarize_tensor
(x)
musetalk/data/sample_method.py:4
Method
timestamp_begin
(self)
musetalk/whisper/whisper/tokenizer.py:191
Method
to_fraction
(s: str)
musetalk/whisper/whisper/normalizers/english.py:165
Method
update
(self, tokens: Tensor, logits: Tensor, sum_logprobs: Tensor)
musetalk/whisper/whisper/decoding.py:258
Method
update
(self, tokens: Tensor, logits: Tensor, sum_logprobs: Tensor)
musetalk/whisper/whisper/decoding.py:295
Function
vggface
VGGFace model. Args: pretrained (bool): If True, returns pre-trained model
musetalk/loss/vgg_face.py:50
Function
vggface2
(pretrained=True)
musetalk/loss/vgg_face.py:45
← previous
301–394 of 394, ranked by callers