MCPcopy Create free account

hub / github.com/ShmuelRonen/ComfyUI-LatentSyncWrapper / functions

Functions463 in github.com/ShmuelRonen/ComfyUI-LatentSyncWrapper

↓ 1 callersMethodpreprocess
(self, s: str)
latentsync/whisper/whisper/normalizers/english.py:381
↓ 1 callersMethodpreprocess_fixed_mask_image
(self, image: torch.Tensor, affine_transform=False)
latentsync/utils/image_processor.py:73
↓ 1 callersFunctionpreprocess_image
(image)
latentsync/trepa/utils/data_utils.py:71
↓ 1 callersMethodprocess_words
(self, words: List[str])
latentsync/whisper/whisper/normalizers/english.py:160
↓ 1 callersMethodqkv_attention
(self, q: Tensor, k: Tensor, v: Tensor, mask: Optional[Tensor] = None)
latentsync/whisper/whisper/model.py:88
↓ 1 callersMethodrank
Given a list of groups of samples and their cumulative log probabilities, return the indices of the samples in each group to select
latentsync/whisper/whisper/decoding.py:165
↓ 1 callersFunctionread_audio
(audio_path: str, audio_sample_rate: int = 16000)
latentsync/utils/util.py:103
↓ 1 callersFunctionread_video
(video_path: str)
preprocess/filter_visual_quality.py:44
↓ 1 callersFunctionread_video_cv2
(video_path: str)
latentsync/utils/util.py:73
↓ 1 callersFunctionread_video_decord
(video_path: str)
latentsync/utils/util.py:66
↓ 1 callersMethodrearrange_kv_cache
Update the key-value cache according to the updated beams
latentsync/whisper/whisper/decoding.py:123
↓ 1 callersFunctionred_text
(text: str)
latentsync/utils/util.py:208
↓ 1 callersFunctionremove_incorrect_affined_multiprocessing
(input_dir, num_workers)
preprocess/remove_incorrect_affined.py:67
↓ 1 callersFunctionremove_outdated_files
(input_dir, begin_date, end_date)
tools/remove_outdated_files.py:19
↓ 1 callersFunctionremove_symbols_and_diacritics
Replace any other markers, symbols, and punctuations with a space, and drop any diacritics (category 'Mn' and some manual mappings)
latentsync/whisper/whisper/normalizers/basic.py:27
↓ 1 callersFunctionresample_fps_hz
(video_input, video_output)
preprocess/resample_fps_hz.py:42
↓ 1 callersMethodreset
Initialize any stateful variables for decoding a new sequence
latentsync/whisper/whisper/decoding.py:200
↓ 1 callersMethodreset_parameters
(self)
eval/detectors/s3fd/nets.py:18
↓ 1 callersFunctionresnet50_backbone
Constructs a ResNet-50 model_hyper. Args: pretrained (bool): If True, returns a model_hyper pre-trained on ImageNet
eval/hyper_iqa.py:315
↓ 1 callersMethodrestore_img
(self, input_img, face, affine_matrix)
latentsync/utils/affine_transform.py:44
↓ 1 callersMethodrestore_video
(self, faces: torch.Tensor, video_frames: np.ndarray, boxes: list, affine_matrices: list)
latentsync/pipelines/lipsync_pipeline.py:268
↓ 1 callersMethodscene_detect
(self, video_dir)
eval/syncnet_detect.py:85
↓ 1 callersFunctionsegment_video
(video_input, video_output)
preprocess/segment_videos.py:36
↓ 1 callersMethodset_attention_slice
r""" Enable sliced attention computation. When this option is enabled, the attention module will split the input tensor in slices,
latentsync/models/unet.py:243
↓ 1 callersMethodset_num_features
Set the number of features diminsions. Args: num_features: Number of features diminsions.
latentsync/trepa/utils/metric_utils.py:39
↓ 1 callersFunctionsetup_models
Setup and pre-download all required models.
nodes.py:360
↓ 1 callersFunctionsinusoids
Returns sinusoids for positional embedding
latentsync/whisper/whisper/model.py:48
↓ 1 callersFunctionsplit
(a, n)
preprocess/filter_visual_quality.py:100
↓ 1 callersFunctionsplit
(a, n)
preprocess/sync_av.py:75
↓ 1 callersFunctionsplit
(a, n)
preprocess/affine_transform.py:74
↓ 1 callersMethodtrack_face
(self, scenefaces, num_failed_det=25, min_track=50, min_face_size=100)
eval/syncnet_detect.py:106
↓ 1 callersFunctiontranscribe
Transcribe an audio file using Whisper Parameters ---------- model: Whisper The Whisper model instance audio: U
latentsync/whisper/whisper/transcribe.py:19
↓ 1 callersMethodtransformation_from_points
(self, points1: torch.Tensor, points0: torch.Tensor, smooth=True, p_bias=None)
latentsync/utils/affine_transform.py:98
↓ 1 callersFunctionvalidation
(val_dataloader, device, syncnet, latent_space, lower_half, vae, num_val_batches)
scripts/train_syncnet.py:291
↓ 1 callersFunctionwrite_srt
Write a transcript to a file in SRT format. Example usage: from pathlib import Path from whisper.utils import write_srt
latentsync/whisper/whisper/utils.py:63
↓ 1 callersFunctionwrite_txt
(transcript: Iterator[dict], file: TextIO)
latentsync/whisper/whisper/utils.py:47
↓ 1 callersFunctionwrite_vtt
(transcript: Iterator[dict], file: TextIO)
latentsync/whisper/whisper/utils.py:52
MethodINPUT_TYPES
(s)
nodes.py:444
MethodINPUT_TYPES
(s)
nodes.py:728
Method__call__
(self, video_path: str, min_track=50, scale=False)
eval/syncnet_detect.py:25
Method__call__
(self, videos_fake, videos_real)
latentsync/trepa/loss.py:33
Method__call__
(self, frame, threshold=0.5)
latentsync/utils/face_detector.py:17
Method__call__
(self, s: str)
latentsync/whisper/whisper/normalizers/english.py:435
Method__call__
(self, s: str)
latentsync/whisper/whisper/normalizers/english.py:454
Method__call__
(self, s: str)
latentsync/whisper/whisper/normalizers/english.py:519
Method__call__
(self, s: str)
latentsync/whisper/whisper/normalizers/basic.py:60
Method__call__
( self, video_path: str, audio_path: str, video_out_path: str, vi
latentsync/pipelines/lipsync_pipeline.py:315
Method__enter__
(self)
latentsync/utils/util.py:285
Method__exit__
(self, *args)
latentsync/utils/util.py:288
Method__getitem__
(self, idx)
latentsync/trepa/utils/data_utils.py:197
Method__getitem__
(self, index)
latentsync/trepa/utils/data_utils.py:231
Method__getitem__
Get audio samples and video frame at `idx`. Parameters ---------- idx : int or slice The frame index, can be
latentsync/utils/av_reader.py:62
Method__getitem__
(self, idx)
latentsync/data/unet_dataset.py:90
Method__getitem__
(self, idx)
latentsync/data/syncnet_dataset.py:84
Method__init__
(self)
nodes.py:425
Method__init__
(self, fileslist_path: str)
tools/write_fileslist.py:20
Method__init__
(self)
eval/draw_syncnet_lines.py:20
Method__init__
(self, resolution=(224, 224))
eval/eval_fvd.py:26
Method__init__
(self, paras)
eval/hyper_iqa.py:127
Method__init__
(self, weight, bias)
eval/hyper_iqa.py:166
Method__init__
(self, inplanes, planes, stride=1, downsample=None)
eval/hyper_iqa.py:184
Method__init__
(self, lda_out_channels, in_chn, block, layers, num_classes=1000)
eval/hyper_iqa.py:222
Method__init__
(self, device, detect_results_dir="detect_results")
eval/syncnet_detect.py:21
Method__init__
(self, num_layers_in_fc_layers=1024)
eval/syncnet/syncnet.py:19
Method__init__
(self, dropout=0, num_layers_in_fc_layers=1024, device="cpu")
eval/syncnet/syncnet_eval.py:41
Method__init__
(self, device="cuda")
eval/detectors/s3fd/__init__.py:16
Method__init__
(self, input_size, feature_maps, variance=[0.1, 0.2], min_sizes=[16,
eval/detectors/s3fd/box_utils.py:182
Method__init__
(self, device='cuda')
eval/detectors/s3fd/nets.py:30
Method__init__
( self, device="cuda", ckpt_path="checkpoints/auxiliary/vit_g_hybrid_pt_1200e_ssv2_
latentsync/trepa/loss.py:23
Method__init__
(self, data_folder: str, sequence_length: int = 16, resolution: int = 128, sample_every_n_frames: int = 1)
latentsync/trepa/utils/data_utils.py:153
Method__init__
(self, data_folder, sequence_length, resolution=64, sample_every_n_frames=1)
latentsync/trepa/utils/data_utils.py:224
Method__init__
latentsync/trepa/utils/metric_utils.py:27
Method__init__
(self, resolution: int = 512, device: str = "cpu", mask_image=None)
latentsync/utils/image_processor.py:35
Method__init__
(self, resolution: int = 512, device: str = "cpu")
latentsync/utils/image_processor.py:104
Method__init__
(self, device="cuda")
latentsync/utils/face_detector.py:9
Method__init__
( self, uri, ctx=cpu(0), sample_rate=44100, mono=True, width=-1, height=-1, num_threads=0, fault_tol=
latentsync/utils/av_reader.py:42
Method__init__
(self, align_points=3, resolution=256, device="cpu", dtype=torch.float16)
latentsync/utils/affine_transform.py:11
Method__init__
(self, train_data_dir: str, config)
latentsync/data/unet_dataset.py:30
Method__init__
(self, data_dir: str, fileslist: str, config)
latentsync/data/syncnet_dataset.py:30
Method__init__
( self, model_path="checkpoints/whisper/tiny.pt", device=None, audio_embed
latentsync/whisper/audio2feature.py:11
Method__init__
(self, model: "Whisper", initial_token_length: int)
latentsync/whisper/whisper/decoding.py:133
Method__init__
(self, length_penalty: Optional[float])
latentsync/whisper/whisper/decoding.py:179
Method__init__
(self, temperature: float, eot: int)
latentsync/whisper/whisper/decoding.py:254
Method__init__
(self, beam_size: int, eot: int, inference: Inference, patience: Optional[float] = None)
latentsync/whisper/whisper/decoding.py:282
Method__init__
(self, tokenizer: Tokenizer, sample_begin: int)
latentsync/whisper/whisper/decoding.py:388
Method__init__
(self, suppress_tokens: Sequence[int])
latentsync/whisper/whisper/decoding.py:398
Method__init__
( self, tokenizer: Tokenizer, sample_begin: int, max_initial_timestamp_index: Optional[int] )
latentsync/whisper/whisper/decoding.py:406
Method__init__
(self, model: "Whisper", options: DecodingOptions)
latentsync/whisper/whisper/decoding.py:450
Method__init__
(self, n_state: int, n_head: int)
latentsync/whisper/whisper/model.py:58
Method__init__
(self, n_state: int, n_head: int, cross_attention: bool = False)
latentsync/whisper/whisper/model.py:104
Method__init__
(self, n_mels: int, n_ctx: int, n_state: int, n_head: int, n_layer: int)
latentsync/whisper/whisper/model.py:132
Method__init__
(self, n_vocab: int, n_ctx: int, n_state: int, n_head: int, n_layer: int)
latentsync/whisper/whisper/model.py:175
Method__init__
(self)
latentsync/whisper/whisper/normalizers/english.py:23
Method__init__
(self)
latentsync/whisper/whisper/normalizers/english.py:450
Method__init__
(self, remove_diacritics: bool = False, split_letters: bool = False)
latentsync/whisper/whisper/normalizers/basic.py:56
Method__init__
( self, vae: AutoencoderKL, audio_encoder: Audio2Feature, unet: UNet3DCond
latentsync/pipelines/lipsync_pipeline.py:46
Method__init__
( self, sample_size: Optional[int] = None, in_channels: int = 4, out_chann
latentsync/models/unet.py:43
Method__init__
(self, act_fn="leaky")
latentsync/models/wav2lip_syncnet.py:9
Method__init__
( self, in_channels: int, out_channels: int, dropout: float = 0.0,
latentsync/models/stable_syncnet.py:66
Method__init__
(self, query_dim, norm_num_groups=32, dropout=0.0)
latentsync/models/stable_syncnet.py:137
← previousnext →201–300 of 463, ranked by callers