MCPcopy Create free account

hub / github.com/bytedance/LatentSync / functions

Functions512 in github.com/bytedance/LatentSync

↓ 1 callersMethodprepare_extra_step_kwargs
(self, generator, eta)
latentsync/pipelines/lipsync_pipeline.py:146
↓ 1 callersMethodprepare_image_latents
(self, images, device, dtype, generator, do_classifier_free_guidance)
latentsync/pipelines/lipsync_pipeline.py:222
↓ 1 callersMethodprepare_latents
(self, num_frames, num_channels_latents, height, width, dtype, device, generator)
latentsync/pipelines/lipsync_pipeline.py:177
↓ 1 callersMethodprepare_mask_latents
( self, mask, masked_image, height, width, dtype, device, generator, do_classifier_free_guidance )
latentsync/pipelines/lipsync_pipeline.py:193
↓ 1 callersFunctionpreprocess
(video, resolution, sequence_length=None, in_channels=3, sample_every_n_frames=1)
latentsync/trepa/utils/data_utils.py:37
↓ 1 callersMethodpreprocess
(self, s: str)
latentsync/whisper/whisper/normalizers/english.py:381
↓ 1 callersMethodpreprocess_fixed_mask_image
(self, image: torch.Tensor, affine_transform=False)
latentsync/utils/image_processor.py:73
↓ 1 callersFunctionpreprocess_image
(image)
latentsync/trepa/utils/data_utils.py:71
↓ 1 callersMethodprocess_words
(self, words: List[str])
latentsync/whisper/whisper/normalizers/english.py:160
↓ 1 callersMethodqkv_attention
(self, q: Tensor, k: Tensor, v: Tensor, mask: Optional[Tensor] = None)
latentsync/whisper/whisper/model.py:88
↓ 1 callersMethodrank
Given a list of groups of samples and their cumulative log probabilities, return the indices of the samples in each group to select a
latentsync/whisper/whisper/decoding.py:165
↓ 1 callersFunctionread_audio
(audio_path: str, audio_sample_rate: int = 16000)
latentsync/utils/util.py:103
↓ 1 callersFunctionread_video
(video_path: str)
preprocess/filter_visual_quality.py:44
↓ 1 callersFunctionread_video_cv2
(video_path: str)
latentsync/utils/util.py:73
↓ 1 callersFunctionread_video_decord
(video_path: str)
latentsync/utils/util.py:66
↓ 1 callersMethodrearrange_kv_cache
Update the key-value cache according to the updated beams
latentsync/whisper/whisper/decoding.py:123
↓ 1 callersFunctionred_text
(text: str)
latentsync/utils/util.py:208
↓ 1 callersFunctionremove_incorrect_affined_multiprocessing
(input_dir, num_workers)
preprocess/remove_incorrect_affined.py:67
↓ 1 callersFunctionremove_outdated_files
(input_dir, begin_date, end_date)
tools/remove_outdated_files.py:19
↓ 1 callersFunctionremove_symbols_and_diacritics
Replace any other markers, symbols, and punctuations with a space, and drop any diacritics (category 'Mn' and some manual mappings)
latentsync/whisper/whisper/normalizers/basic.py:27
↓ 1 callersFunctionresample_fps_hz
(video_input, video_output)
preprocess/resample_fps_hz.py:42
↓ 1 callersMethodreset
Initialize any stateful variables for decoding a new sequence
latentsync/whisper/whisper/decoding.py:200
↓ 1 callersMethodreset_parameters
(self)
eval/detectors/s3fd/nets.py:18
↓ 1 callersFunctionresize
(vid, size, interpolation="bilinear")
latentsync/trepa/third_party/VideoMAEv2/utils.py:16
↓ 1 callersFunctionresnet50_backbone
Constructs a ResNet-50 model_hyper. Args: pretrained (bool): If True, returns a model_hyper pre-trained on ImageNet
eval/hyper_iqa.py:315
↓ 1 callersMethodrestore_img
(self, input_img, face, affine_matrix)
latentsync/utils/affine_transform.py:44
↓ 1 callersMethodrestore_video
(self, faces: torch.Tensor, video_frames: np.ndarray, boxes: list, affine_matrices: list)
latentsync/pipelines/lipsync_pipeline.py:266
↓ 1 callersMethodscene_detect
(self, video_dir)
eval/syncnet_detect.py:85
↓ 1 callersFunctionsegment_video
(video_input, video_output)
preprocess/segment_videos.py:36
↓ 1 callersMethodset_attention_slice
r""" Enable sliced attention computation. When this option is enabled, the attention module will split the input tensor in slices, to
latentsync/models/unet.py:243
↓ 1 callersMethodset_num_features
Set the number of features diminsions. Args: num_features: Number of features diminsions.
latentsync/trepa/utils/metric_utils.py:39
↓ 1 callersFunctionsinusoids
Returns sinusoids for positional embedding
latentsync/whisper/whisper/model.py:48
↓ 1 callersFunctionsplit
(a, n)
preprocess/filter_visual_quality.py:100
↓ 1 callersFunctionsplit
(a, n)
preprocess/sync_av.py:75
↓ 1 callersFunctionsplit
(a, n)
preprocess/affine_transform.py:74
↓ 1 callersFunctionto_normalized_float_tensor
(vid)
latentsync/trepa/third_party/VideoMAEv2/utils.py:9
↓ 1 callersMethodtrack_face
(self, scenefaces, num_failed_det=25, min_track=50, min_face_size=100)
eval/syncnet_detect.py:106
↓ 1 callersFunctiontranscribe
Transcribe an audio file using Whisper Parameters ---------- model: Whisper The Whisper model instance audio: Union[str
latentsync/whisper/whisper/transcribe.py:19
↓ 1 callersMethodtransformation_from_points
(self, points1: torch.Tensor, points0: torch.Tensor, smooth=True, p_bias=None)
latentsync/utils/affine_transform.py:98
↓ 1 callersFunctionvalidation
(val_dataloader, device, syncnet, latent_space, lower_half, vae, num_val_batches)
scripts/train_syncnet.py:291
↓ 1 callersFunctionvit_giant_patch14_224
(pretrained=False, **kwargs)
latentsync/trepa/third_party/VideoMAEv2/videomaev2_finetune.py:531
↓ 1 callersFunctionwrite_srt
Write a transcript to a file in SRT format. Example usage: from pathlib import Path from whisper.utils import write_srt
latentsync/whisper/whisper/utils.py:63
↓ 1 callersFunctionwrite_txt
(transcript: Iterator[dict], file: TextIO)
latentsync/whisper/whisper/utils.py:47
↓ 1 callersFunctionwrite_vtt
(transcript: Iterator[dict], file: TextIO)
latentsync/whisper/whisper/utils.py:52
Method__call__
(self, video_path: str, min_track=50, scale=False)
eval/syncnet_detect.py:25
Method__call__
(self, videos_fake, videos_real)
latentsync/trepa/loss.py:33
Method__call__
(self, vid)
latentsync/trepa/third_party/VideoMAEv2/utils.py:27
Method__call__
(self, vid)
latentsync/trepa/third_party/VideoMAEv2/utils.py:35
Method__call__
(self, frame, threshold=0.5)
latentsync/utils/face_detector.py:17
Method__call__
(self, s: str)
latentsync/whisper/whisper/normalizers/english.py:435
Method__call__
(self, s: str)
latentsync/whisper/whisper/normalizers/english.py:454
Method__call__
(self, s: str)
latentsync/whisper/whisper/normalizers/english.py:519
Method__call__
(self, s: str)
latentsync/whisper/whisper/normalizers/basic.py:60
Method__call__
( self, video_path: str, audio_path: str, video_out_path: str, num_fra
latentsync/pipelines/lipsync_pipeline.py:313
Method__enter__
(self)
latentsync/utils/util.py:285
Method__exit__
(self, *args)
latentsync/utils/util.py:288
Method__getitem__
(self, idx)
latentsync/trepa/utils/data_utils.py:197
Method__getitem__
(self, index)
latentsync/trepa/utils/data_utils.py:231
Method__getitem__
Get audio samples and video frame at `idx`. Parameters ---------- idx : int or slice The frame index, can be nega
latentsync/utils/av_reader.py:62
Method__getitem__
(self, idx)
latentsync/data/unet_dataset.py:90
Method__getitem__
(self, idx)
latentsync/data/syncnet_dataset.py:84
Method__init__
(self, fileslist_path: str)
tools/write_fileslist.py:20
Method__init__
(self)
eval/draw_syncnet_lines.py:20
Method__init__
(self, resolution=(224, 224))
eval/eval_fvd.py:26
Method__init__
(self, paras)
eval/hyper_iqa.py:127
Method__init__
(self, weight, bias)
eval/hyper_iqa.py:166
Method__init__
(self, inplanes, planes, stride=1, downsample=None)
eval/hyper_iqa.py:184
Method__init__
(self, lda_out_channels, in_chn, block, layers, num_classes=1000)
eval/hyper_iqa.py:222
Method__init__
(self, device, detect_results_dir="detect_results")
eval/syncnet_detect.py:21
Method__init__
(self, num_layers_in_fc_layers=1024)
eval/syncnet/syncnet.py:19
Method__init__
(self, dropout=0, num_layers_in_fc_layers=1024, device="cpu")
eval/syncnet/syncnet_eval.py:41
Method__init__
(self, device="cuda")
eval/detectors/s3fd/__init__.py:16
Method__init__
(self, input_size, feature_maps, variance=[0.1, 0.2], min_sizes=[16, 3
eval/detectors/s3fd/box_utils.py:182
Method__init__
(self, device='cuda')
eval/detectors/s3fd/nets.py:30
Method__init__
( self, device="cuda", ckpt_path="checkpoints/auxiliary/vit_g_hybrid_pt_1200e_ssv2_ft.
latentsync/trepa/loss.py:23
Method__init__
(self, data_folder: str, sequence_length: int = 16, resolution: int = 128, sample_every_n_frames: int = 1)
latentsync/trepa/utils/data_utils.py:153
Method__init__
(self, data_folder, sequence_length, resolution=64, sample_every_n_frames=1)
latentsync/trepa/utils/data_utils.py:224
Method__init__
latentsync/trepa/utils/metric_utils.py:27
Method__init__
(self, img_size=224, patch_size=16, in_chans=3,
latentsync/trepa/third_party/VideoMAEv2/videomaev2_pretrain.py:31
Method__init__
(self, patch_size=16, num_classes=768, embed_dim=768,
latentsync/trepa/third_party/VideoMAEv2/videomaev2_pretrain.py:150
Method__init__
(self, size)
latentsync/trepa/third_party/VideoMAEv2/utils.py:32
Method__init__
(self, drop_prob=None)
latentsync/trepa/third_party/VideoMAEv2/videomaev2_finetune.py:122
Method__init__
( self, dim, num_heads=8, qkv_bias=False, qk_scale=None, attn_drop=0.0, proj_drop=0.0, attn_head_dim=N
latentsync/trepa/third_party/VideoMAEv2/videomaev2_finetune.py:156
Method__init__
( self, dim, num_heads=8, qkv_bias=False, qk_scale=None, attn_drop=0.0, proj_drop=0.0, attn_head_dim=N
latentsync/trepa/third_party/VideoMAEv2/videomaev2_finetune.py:212
Method__init__
( self, dim, num_heads, mlp_ratio=4.0, qkv_bias=False, qk_scal
latentsync/trepa/third_party/VideoMAEv2/videomaev2_finetune.py:263
Method__init__
(self, img_size=224, patch_size=16, in_chans=3, embed_dim=768, num_frames=16, tubelet_size=2)
latentsync/trepa/third_party/VideoMAEv2/videomaev2_finetune.py:326
Method__init__
( self, img_size=224, patch_size=16, in_chans=3, num_classes=1000,
latentsync/trepa/third_party/VideoMAEv2/videomaev2_finetune.py:374
Method__init__
(self, resolution: int = 512, device: str = "cpu", mask_image=None)
latentsync/utils/image_processor.py:35
Method__init__
(self, resolution: int = 512, device: str = "cpu")
latentsync/utils/image_processor.py:104
Method__init__
(self, device="cuda")
latentsync/utils/face_detector.py:9
Method__init__
( self, uri, ctx=cpu(0), sample_rate=44100, mono=True, width=-1, height=-1, num_threads=0, fault_tol=-
latentsync/utils/av_reader.py:42
Method__init__
(self, align_points=3, resolution=256, device="cpu", dtype=torch.float16)
latentsync/utils/affine_transform.py:11
Method__init__
(self, train_data_dir: str, config)
latentsync/data/unet_dataset.py:30
Method__init__
(self, data_dir: str, fileslist: str, config)
latentsync/data/syncnet_dataset.py:30
Method__init__
( self, model_path="checkpoints/whisper/tiny.pt", device=None, audio_embeds_ca
latentsync/whisper/audio2feature.py:11
Method__init__
(self, model: "Whisper", initial_token_length: int)
latentsync/whisper/whisper/decoding.py:133
Method__init__
(self, length_penalty: Optional[float])
latentsync/whisper/whisper/decoding.py:179
Method__init__
(self, temperature: float, eot: int)
latentsync/whisper/whisper/decoding.py:254
Method__init__
(self, beam_size: int, eot: int, inference: Inference, patience: Optional[float] = None)
latentsync/whisper/whisper/decoding.py:282
Method__init__
(self, tokenizer: Tokenizer, sample_begin: int)
latentsync/whisper/whisper/decoding.py:388
← previousnext →201–300 of 512, ranked by callers