MCPcopy Create free account

hub / github.com/Songluchuan/TDMM-LM_data / functions

Functions434 in github.com/Songluchuan/TDMM-LM_data

↓ 1 callersFunctionbatch_rigid_transform
Applies a batch of rigid transformations to the joints Parameters ---------- rot_mats : torch.tensor BxNx3x3 Tensor of rotat
tools/smirk_inverse/src/FLAME/lbs.py:321
↓ 1 callersFunctionbatch_rodrigues
same as batch_matrix2axis Calculates the rotation matrices for a batch of rotation vectors Parameters ---------- rot_vec
tools/spectre_inverse/src/utils/rotation_converter.py:342
↓ 1 callersFunctionblend_shapes
Calculates the per vertex displacement due to the blend shapes Parameters ---------- betas : torch.tensor Bx(num_betas) Blend s
tools/spectre_inverse/src/models/lbs.py:250
↓ 1 callersFunctionblend_shapes
Calculates the per vertex displacement due to the blend shapes Parameters ---------- betas : torch.tensor Bx(num_betas) Blend s
tools/smirk_inverse/src/FLAME/lbs.py:250
↓ 1 callersMethodbuild_conv_block
Construct a convolutional block. Parameters: dim (int) -- the number of channels in the conv layer. padding
tools/smirk_inverse/src/smirk_generator.py:135
↓ 1 callersMethodcalculate_mica_shape_loss
Runs MICA on the input image and calculates the L2 loss between the input shape_params and the shape_params calculated by MICA.
tools/smirk_inverse/src/models/MICA/mica.py:80
↓ 1 callersMethodconfigure_optimizers
(self)
tools/spectre_inverse/src/utils/trainer.py:72
↓ 1 callersMethodconfigure_optimizers
(self, n_steps)
tools/smirk_inverse/src/base_trainer.py:28
↓ 1 callersFunctionconv1x1
1x1 convolution
tools/smirk_inverse/src/models/MICA/arcface.py:23
↓ 1 callersFunctionconvert
()
tools/spectre_inverse/6DRepNet/sixdrepnet/convert.py:22
↓ 1 callersFunctioncreate_LRS3_lists
(lrs3_path)
tools/spectre_inverse/datasets/data_utils.py:41
↓ 1 callersFunctioncreate_LRS3_lists
(lrs3_path, lrs3_landmarks_path)
tools/smirk_inverse/datasets/data_utils.py:105
↓ 1 callersMethodcreate_base_encoder
(self)
tools/smirk_inverse/src/base_trainer.py:236
↓ 1 callersMethodcreate_visualizations
(self, batch, outputs)
tools/smirk_inverse/src/base_trainer.py:165
↓ 1 callersFunctioncrop_face
(frame, landmarks, scale=1.0)
tools/spectre_inverse/demo_batch.py:75
↓ 1 callersFunctioncrop_face
(frame, landmarks, scale=1.0)
tools/spectre_inverse/demo.py:66
↓ 1 callersFunctioncrop_face
(frame, landmarks, scale=1.0, image_size=224)
tools/smirk_inverse/datawheel_sample.py:23
↓ 1 callersFunctioncrop_face
(frame, landmarks, scale=1.0, image_size=224)
tools/smirk_inverse/demo_video.py:17
↓ 1 callersFunctioncrop_face
(frame, landmarks, scale=1.0, image_size=224)
tools/smirk_inverse/demo.py:16
↓ 1 callersMethodcrop_face
(self, frame, landmarks, scale=1.0)
tools/spectre_inverse/datasets/datasets.py:25
↓ 1 callersMethodcrop_face
(self, frame, landmarks, scale=1.0)
tools/spectre_inverse/datasets/build_datasets.py:34
↓ 1 callersMethodcrop_face
(frame, landmarks, scale=1.0, image_size=224)
tools/smirk_inverse/datasets/base_dataset.py:78
↓ 1 callersFunctioncrop_tensor
for batch image Args: image (torch.Tensor): the reference tensor of shape BXHxWXC. center: [bz, 2] bboxsize: [bz, 1]
tools/spectre_inverse/src/utils/tensor_cropper.py:38
↓ 1 callersFunctiondecode_fn
(x)
tools/spectre_inverse/utils/run_av_hubert.py:71
↓ 1 callersMethoddecompose_code
Convert a flattened parameter vector to a dictionary of parameters code_dict.keys() = ['shape', 'tex', 'exp', 'pose', 'cam', 'light']
tools/spectre_inverse/src/spectre.py:125
↓ 1 callersMethodestimate_norm
(self, lmk, image_size=112,mode='arcface')
tools/smirk_inverse/datasets/base_dataset.py:61
↓ 1 callersFunctionextract
(video, tmpl='%06d.jpg')
tools/spectre_inverse/utils/extract_frames_LRS3.py:12
↓ 1 callersFunctionextract_frames
(video_path, detect_landmarks=True)
tools/spectre_inverse/demo_batch.py:32
↓ 1 callersFunctionextract_frames
(video_path, detect_landmarks=True)
tools/spectre_inverse/demo.py:21
↓ 1 callersMethodfit
(self)
tools/spectre_inverse/src/utils/trainer.py:262
↓ 1 callersMethodforward
(self, images)
tools/smirk_inverse/src/models/MICA/mica.py:68
↓ 1 callersMethodforward_arcface
(self, x)
tools/smirk_inverse/src/models/MICA/arcface.py:181
↓ 1 callersMethodfreeze_encoder
(self)
tools/smirk_inverse/src/smirk_trainer.py:334
↓ 1 callersMethodfreezer
(self, layers)
tools/smirk_inverse/src/models/MICA/arcface.py:172
↓ 1 callersFunctiongather_LRS3_split
(folder_list, split="trainval")
tools/smirk_inverse/datasets/lrs3_dataset.py:75
↓ 1 callersFunctiongauss_fcn
(x)
tools/spectre_inverse/src/utils/util.py:298
↓ 1 callersFunctiongaussian
(window_size, sigma)
tools/spectre_inverse/src/utils/util.py:297
↓ 1 callersFunctionget_RepVGG_func_by_name
(name)
tools/spectre_inverse/6DRepNet/sixdrepnet/backbone/repvgg.py:273
↓ 1 callersFunctionget_cfg_defaults
Get a yacs CfgNode object with default values for my_project.
tools/spectre_inverse/config.py:109
↓ 1 callersFunctionget_datasets_CelebA
(config=None)
tools/smirk_inverse/datasets/celeba_dataset.py:54
↓ 1 callersFunctionget_datasets_FFHQ
(config)
tools/smirk_inverse/datasets/ffhq_dataset.py:41
↓ 1 callersFunctionget_datasets_LRS3
(config=None)
tools/spectre_inverse/datasets/datasets.py:123
↓ 1 callersFunctionget_datasets_LRS3
(config)
tools/smirk_inverse/datasets/lrs3_dataset.py:54
↓ 1 callersFunctionget_datasets_MEAD
(config=None)
tools/spectre_inverse/datasets/extra_datasets.py:5
↓ 1 callersFunctionget_datasets_MEAD
(config=None)
tools/smirk_inverse/datasets/mead_dataset.py:61
↓ 1 callersFunctionget_datasets_MEAD_sides
(config=None)
tools/smirk_inverse/datasets/mead_sides_dataset.py:51
↓ 1 callersFunctionget_datasets_TCDTIMIT
(config=None)
tools/spectre_inverse/datasets/extra_datasets.py:14
↓ 1 callersMethodget_equivalent_kernel_bias
(self)
tools/spectre_inverse/6DRepNet/sixdrepnet/backbone/repvgg.py:85
↓ 1 callersFunctionget_gaussian_kernel2d
r"""Function that returns Gaussian filter matrix coefficients. Args: kernel_size (Tuple[int, int]): filter sizes in the x and y direction
tools/spectre_inverse/src/utils/util.py:332
↓ 1 callersFunctionget_laplacian_kernel2d
r"""Function that returns Gaussian filter matrix coefficients. Args: kernel_size (int): filter size should be odd. Returns:
tools/spectre_inverse/src/utils/util.py:400
↓ 1 callersFunctionget_phoneme_to_viseme_map
()
tools/spectre_inverse/utils/lipread_utils.py:15
↓ 1 callersFunctionget_version
(rel_path)
tools/spectre_inverse/6DRepNet/setup.py:11
↓ 1 callersFunctioninference_one
(args, video_path, debug_path, params_path)
tools/smirk_inverse/datawheel_sample.py:52
↓ 1 callersMethodinit_weights
(self)
tools/smirk_inverse/src/smirk_encoder.py:26
↓ 1 callersMethodinit_weights
(self)
tools/smirk_inverse/src/smirk_encoder.py:61
↓ 1 callersMethodinit_weights
(self)
tools/smirk_inverse/src/smirk_encoder.py:90
↓ 1 callersFunctionkeep_vertices_and_update_faces
Keep specified vertices in the mesh and update the faces. Parameters: faces (torch.Tensor): Tensor of shape (F, 3) representing faces, w
tools/smirk_inverse/src/renderer/renderer.py:11
↓ 1 callersFunctionlandmarks_interpolate
landmarks_interpolate. :param landmarks: List, the raw landmark (in-place)
tools/smirk_inverse/datasets/data_utils.py:79
↓ 1 callersFunctionlbs
Performs Linear Blend Skinning with the given shape and pose parameters Parameters ---------- betas : torch.tensor BxNB
tools/spectre_inverse/src/models/lbs.py:140
↓ 1 callersFunctionlbs
Performs Linear Blend Skinning with the given shape and pose parameters Parameters ---------- betas : torch.tensor BxNB
tools/smirk_inverse/src/FLAME/lbs.py:140
↓ 1 callersFunctionlinear_interpolate
linear_interpolate. :param landmarks: ndarray, input landmarks to be interpolated. :param start_idx: int, the start index for linear interpol
tools/spectre_inverse/datasets/data_utils.py:3
↓ 1 callersFunctionlinear_interpolate
linear_interpolate. :param landmarks: ndarray, input landmarks to be interpolated. :param start_idx: int, the start index for linear interpol
tools/smirk_inverse/datasets/data_utils.py:65
↓ 1 callersMethodload_checkpoint
(self)
tools/spectre_inverse/src/utils/trainer.py:78
↓ 1 callersFunctionload_dataloaders
(config)
tools/smirk_inverse/datasets/data_utils.py:11
↓ 1 callersFunctionload_filtered_state_dict
(model, snapshot)
tools/spectre_inverse/6DRepNet/sixdrepnet/convert.py:14
↓ 1 callersMethodload_model
(self, resume, load_fuse_generator=True, load_encoder=True, device='cuda')
tools/smirk_inverse/src/base_trainer.py:242
↓ 1 callersMethodload_random_template
(self, num_expressions=50)
tools/smirk_inverse/src/base_trainer.py:69
↓ 1 callersMethodlogging
(self, batch_idx, losses, phase)
tools/smirk_inverse/src/base_trainer.py:18
↓ 1 callersFunctionmain
(args)
tools/spectre_inverse/demo_batch.py:97
↓ 1 callersFunctionmain
(cfg)
tools/spectre_inverse/main.py:9
↓ 1 callersFunctionmain
(args)
tools/spectre_inverse/demo.py:88
↓ 1 callersFunctionmain
()
tools/spectre_inverse/utils/extract_wavs_LRS3.py:20
↓ 1 callersFunctionmain
(args)
tools/spectre_inverse/utils/extract_frames_and_audio.py:30
↓ 1 callersFunctionmain
()
tools/spectre_inverse/utils/extract_frames_LRS3.py:61
↓ 1 callersFunctionmake_grid_from_opencv_images
Create a grid of images from the list of cv2 images in images
tools/smirk_inverse/src/utils/utils.py:83
↓ 1 callersFunctionparse_args
()
tools/spectre_inverse/config.py:119
↓ 1 callersFunctionparse_args
Parse input arguments.
tools/spectre_inverse/6DRepNet/sixdrepnet/train.py:29
↓ 1 callersFunctionparse_args
Parse input arguments.
tools/spectre_inverse/6DRepNet/sixdrepnet/test.py:28
↓ 1 callersFunctionparse_args
Parse input arguments.
tools/spectre_inverse/6DRepNet/sixdrepnet/create_filename_list.py:13
↓ 1 callersFunctionparse_args
Parse input arguments.
tools/spectre_inverse/6DRepNet/sixdrepnet/demo.py:35
↓ 1 callersFunctionparse_args
()
tools/smirk_inverse/train.py:10
↓ 1 callersFunctionplot_kpts
Draw 68 key points Args: image: the input image kpt: (68, 3).
tools/spectre_inverse/src/utils/util.py:589
↓ 1 callersFunctionpoints2bbox
(points, points_scale=None)
tools/spectre_inverse/src/utils/tensor_cropper.py:13
↓ 1 callersFunctionpredict_text
(lipreader, mouth_sequence)
tools/spectre_inverse/utils/lipread_utils.py:75
↓ 1 callersMethodprepare_data
(self)
tools/spectre_inverse/src/trainer_spectre.py:666
↓ 1 callersMethodprepare_training_losses
(self)
tools/spectre_inverse/src/trainer_spectre.py:45
↓ 1 callersFunctionprocess_file
(root, file_name, face_detector)
tools/smirk_inverse/datasets/preprocess_scripts/apply_mediapipe_to_dataset.py:91
↓ 1 callersFunctionprocess_image
(image_file, output_file, vis_file, face_detector)
tools/smirk_inverse/datasets/preprocess_scripts/apply_mediapipe_to_dataset.py:21
↓ 1 callersFunctionprocess_video
(video_file, output_file, vis_file, face_detector)
tools/smirk_inverse/datasets/preprocess_scripts/apply_mediapipe_to_dataset.py:49
↓ 1 callersFunctionrandom_barycentric
(num=1)
tools/smirk_inverse/src/utils/masking.py:54
↓ 1 callersFunctionread
(rel_path)
tools/spectre_inverse/6DRepNet/setup.py:6
↓ 1 callersFunctionrepvgg_model_convert
(model:torch.nn.Module, save_path=None, do_copy=True)
tools/spectre_inverse/6DRepNet/sixdrepnet/backbone/repvgg.py:294
↓ 1 callersMethodreset
(self)
tools/spectre_inverse/utils/run_av_hubert.py:18
↓ 1 callersFunctionresnet50
Constructs a ResNet-50 model.
tools/smirk_inverse/src/losses/resnet.py:157
↓ 1 callersFunctionrotation_matrix_to_quaternion
Convert 3x4 rotation matrix to 4d quaternion vector This algorithm is based on algorithm described in https://github.com/KieranWynn/pyquatern
tools/spectre_inverse/src/utils/rotation_converter.py:88
↓ 1 callersFunctionrun_lipreading
:param videos: list of videos :param transcriptions: list of transcriptions :return:
tools/spectre_inverse/utils/run_av_hubert.py:31
↓ 1 callersFunctionsave2avi
save2avi. - function taken from Visual Speech Recognition repository :param filename: str, the filename to save the video (.avi). :param data
tools/spectre_inverse/utils/lipread_utils.py:59
↓ 1 callersFunctionsave_coeffs_as_pickle
( params: dict, out_path: str, )
tools/smirk_inverse/datawheel_sample.py:43
↓ 1 callersMethodsave_model
(self, state_dict, save_path)
tools/smirk_inverse/src/base_trainer.py:226
↓ 1 callersMethodsave_visualizations
(self, outputs, save_path, show_landmarks=False)
tools/smirk_inverse/src/base_trainer.py:130
← previousnext →101–200 of 434, ranked by callers