Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/Songluchuan/TDMM-LM_data
/ functions
Functions
434 in github.com/Songluchuan/TDMM-LM_data
⨍
Functions
434
◇
Types & classes
64
↓ 1 callers
Function
batch_rigid_transform
Applies a batch of rigid transformations to the joints Parameters ---------- rot_mats : torch.tensor BxNx3x3 Tensor of rotat
tools/smirk_inverse/src/FLAME/lbs.py:321
↓ 1 callers
Function
batch_rodrigues
same as batch_matrix2axis Calculates the rotation matrices for a batch of rotation vectors Parameters ---------- rot_vec
tools/spectre_inverse/src/utils/rotation_converter.py:342
↓ 1 callers
Function
blend_shapes
Calculates the per vertex displacement due to the blend shapes Parameters ---------- betas : torch.tensor Bx(num_betas) Blend s
tools/spectre_inverse/src/models/lbs.py:250
↓ 1 callers
Function
blend_shapes
Calculates the per vertex displacement due to the blend shapes Parameters ---------- betas : torch.tensor Bx(num_betas) Blend s
tools/smirk_inverse/src/FLAME/lbs.py:250
↓ 1 callers
Method
build_conv_block
Construct a convolutional block. Parameters: dim (int) -- the number of channels in the conv layer. padding
tools/smirk_inverse/src/smirk_generator.py:135
↓ 1 callers
Method
calculate_mica_shape_loss
Runs MICA on the input image and calculates the L2 loss between the input shape_params and the shape_params calculated by MICA.
tools/smirk_inverse/src/models/MICA/mica.py:80
↓ 1 callers
Method
configure_optimizers
(self)
tools/spectre_inverse/src/utils/trainer.py:72
↓ 1 callers
Method
configure_optimizers
(self, n_steps)
tools/smirk_inverse/src/base_trainer.py:28
↓ 1 callers
Function
conv1x1
1x1 convolution
tools/smirk_inverse/src/models/MICA/arcface.py:23
↓ 1 callers
Function
convert
()
tools/spectre_inverse/6DRepNet/sixdrepnet/convert.py:22
↓ 1 callers
Function
create_LRS3_lists
(lrs3_path)
tools/spectre_inverse/datasets/data_utils.py:41
↓ 1 callers
Function
create_LRS3_lists
(lrs3_path, lrs3_landmarks_path)
tools/smirk_inverse/datasets/data_utils.py:105
↓ 1 callers
Method
create_base_encoder
(self)
tools/smirk_inverse/src/base_trainer.py:236
↓ 1 callers
Method
create_visualizations
(self, batch, outputs)
tools/smirk_inverse/src/base_trainer.py:165
↓ 1 callers
Function
crop_face
(frame, landmarks, scale=1.0)
tools/spectre_inverse/demo_batch.py:75
↓ 1 callers
Function
crop_face
(frame, landmarks, scale=1.0)
tools/spectre_inverse/demo.py:66
↓ 1 callers
Function
crop_face
(frame, landmarks, scale=1.0, image_size=224)
tools/smirk_inverse/datawheel_sample.py:23
↓ 1 callers
Function
crop_face
(frame, landmarks, scale=1.0, image_size=224)
tools/smirk_inverse/demo_video.py:17
↓ 1 callers
Function
crop_face
(frame, landmarks, scale=1.0, image_size=224)
tools/smirk_inverse/demo.py:16
↓ 1 callers
Method
crop_face
(self, frame, landmarks, scale=1.0)
tools/spectre_inverse/datasets/datasets.py:25
↓ 1 callers
Method
crop_face
(self, frame, landmarks, scale=1.0)
tools/spectre_inverse/datasets/build_datasets.py:34
↓ 1 callers
Method
crop_face
(frame, landmarks, scale=1.0, image_size=224)
tools/smirk_inverse/datasets/base_dataset.py:78
↓ 1 callers
Function
crop_tensor
for batch image Args: image (torch.Tensor): the reference tensor of shape BXHxWXC. center: [bz, 2] bboxsize: [bz, 1]
tools/spectre_inverse/src/utils/tensor_cropper.py:38
↓ 1 callers
Function
decode_fn
(x)
tools/spectre_inverse/utils/run_av_hubert.py:71
↓ 1 callers
Method
decompose_code
Convert a flattened parameter vector to a dictionary of parameters code_dict.keys() = ['shape', 'tex', 'exp', 'pose', 'cam', 'light']
tools/spectre_inverse/src/spectre.py:125
↓ 1 callers
Method
estimate_norm
(self, lmk, image_size=112,mode='arcface')
tools/smirk_inverse/datasets/base_dataset.py:61
↓ 1 callers
Function
extract
(video, tmpl='%06d.jpg')
tools/spectre_inverse/utils/extract_frames_LRS3.py:12
↓ 1 callers
Function
extract_frames
(video_path, detect_landmarks=True)
tools/spectre_inverse/demo_batch.py:32
↓ 1 callers
Function
extract_frames
(video_path, detect_landmarks=True)
tools/spectre_inverse/demo.py:21
↓ 1 callers
Method
fit
(self)
tools/spectre_inverse/src/utils/trainer.py:262
↓ 1 callers
Method
forward
(self, images)
tools/smirk_inverse/src/models/MICA/mica.py:68
↓ 1 callers
Method
forward_arcface
(self, x)
tools/smirk_inverse/src/models/MICA/arcface.py:181
↓ 1 callers
Method
freeze_encoder
(self)
tools/smirk_inverse/src/smirk_trainer.py:334
↓ 1 callers
Method
freezer
(self, layers)
tools/smirk_inverse/src/models/MICA/arcface.py:172
↓ 1 callers
Function
gather_LRS3_split
(folder_list, split="trainval")
tools/smirk_inverse/datasets/lrs3_dataset.py:75
↓ 1 callers
Function
gauss_fcn
(x)
tools/spectre_inverse/src/utils/util.py:298
↓ 1 callers
Function
gaussian
(window_size, sigma)
tools/spectre_inverse/src/utils/util.py:297
↓ 1 callers
Function
get_RepVGG_func_by_name
(name)
tools/spectre_inverse/6DRepNet/sixdrepnet/backbone/repvgg.py:273
↓ 1 callers
Function
get_cfg_defaults
Get a yacs CfgNode object with default values for my_project.
tools/spectre_inverse/config.py:109
↓ 1 callers
Function
get_datasets_CelebA
(config=None)
tools/smirk_inverse/datasets/celeba_dataset.py:54
↓ 1 callers
Function
get_datasets_FFHQ
(config)
tools/smirk_inverse/datasets/ffhq_dataset.py:41
↓ 1 callers
Function
get_datasets_LRS3
(config=None)
tools/spectre_inverse/datasets/datasets.py:123
↓ 1 callers
Function
get_datasets_LRS3
(config)
tools/smirk_inverse/datasets/lrs3_dataset.py:54
↓ 1 callers
Function
get_datasets_MEAD
(config=None)
tools/spectre_inverse/datasets/extra_datasets.py:5
↓ 1 callers
Function
get_datasets_MEAD
(config=None)
tools/smirk_inverse/datasets/mead_dataset.py:61
↓ 1 callers
Function
get_datasets_MEAD_sides
(config=None)
tools/smirk_inverse/datasets/mead_sides_dataset.py:51
↓ 1 callers
Function
get_datasets_TCDTIMIT
(config=None)
tools/spectre_inverse/datasets/extra_datasets.py:14
↓ 1 callers
Method
get_equivalent_kernel_bias
(self)
tools/spectre_inverse/6DRepNet/sixdrepnet/backbone/repvgg.py:85
↓ 1 callers
Function
get_gaussian_kernel2d
r"""Function that returns Gaussian filter matrix coefficients. Args: kernel_size (Tuple[int, int]): filter sizes in the x and y direction
tools/spectre_inverse/src/utils/util.py:332
↓ 1 callers
Function
get_laplacian_kernel2d
r"""Function that returns Gaussian filter matrix coefficients. Args: kernel_size (int): filter size should be odd. Returns:
tools/spectre_inverse/src/utils/util.py:400
↓ 1 callers
Function
get_phoneme_to_viseme_map
()
tools/spectre_inverse/utils/lipread_utils.py:15
↓ 1 callers
Function
get_version
(rel_path)
tools/spectre_inverse/6DRepNet/setup.py:11
↓ 1 callers
Function
inference_one
(args, video_path, debug_path, params_path)
tools/smirk_inverse/datawheel_sample.py:52
↓ 1 callers
Method
init_weights
(self)
tools/smirk_inverse/src/smirk_encoder.py:26
↓ 1 callers
Method
init_weights
(self)
tools/smirk_inverse/src/smirk_encoder.py:61
↓ 1 callers
Method
init_weights
(self)
tools/smirk_inverse/src/smirk_encoder.py:90
↓ 1 callers
Function
keep_vertices_and_update_faces
Keep specified vertices in the mesh and update the faces. Parameters: faces (torch.Tensor): Tensor of shape (F, 3) representing faces, w
tools/smirk_inverse/src/renderer/renderer.py:11
↓ 1 callers
Function
landmarks_interpolate
landmarks_interpolate. :param landmarks: List, the raw landmark (in-place)
tools/smirk_inverse/datasets/data_utils.py:79
↓ 1 callers
Function
lbs
Performs Linear Blend Skinning with the given shape and pose parameters Parameters ---------- betas : torch.tensor BxNB
tools/spectre_inverse/src/models/lbs.py:140
↓ 1 callers
Function
lbs
Performs Linear Blend Skinning with the given shape and pose parameters Parameters ---------- betas : torch.tensor BxNB
tools/smirk_inverse/src/FLAME/lbs.py:140
↓ 1 callers
Function
linear_interpolate
linear_interpolate. :param landmarks: ndarray, input landmarks to be interpolated. :param start_idx: int, the start index for linear interpol
tools/spectre_inverse/datasets/data_utils.py:3
↓ 1 callers
Function
linear_interpolate
linear_interpolate. :param landmarks: ndarray, input landmarks to be interpolated. :param start_idx: int, the start index for linear interpol
tools/smirk_inverse/datasets/data_utils.py:65
↓ 1 callers
Method
load_checkpoint
(self)
tools/spectre_inverse/src/utils/trainer.py:78
↓ 1 callers
Function
load_dataloaders
(config)
tools/smirk_inverse/datasets/data_utils.py:11
↓ 1 callers
Function
load_filtered_state_dict
(model, snapshot)
tools/spectre_inverse/6DRepNet/sixdrepnet/convert.py:14
↓ 1 callers
Method
load_model
(self, resume, load_fuse_generator=True, load_encoder=True, device='cuda')
tools/smirk_inverse/src/base_trainer.py:242
↓ 1 callers
Method
load_random_template
(self, num_expressions=50)
tools/smirk_inverse/src/base_trainer.py:69
↓ 1 callers
Method
logging
(self, batch_idx, losses, phase)
tools/smirk_inverse/src/base_trainer.py:18
↓ 1 callers
Function
main
(args)
tools/spectre_inverse/demo_batch.py:97
↓ 1 callers
Function
main
(cfg)
tools/spectre_inverse/main.py:9
↓ 1 callers
Function
main
(args)
tools/spectre_inverse/demo.py:88
↓ 1 callers
Function
main
()
tools/spectre_inverse/utils/extract_wavs_LRS3.py:20
↓ 1 callers
Function
main
(args)
tools/spectre_inverse/utils/extract_frames_and_audio.py:30
↓ 1 callers
Function
main
()
tools/spectre_inverse/utils/extract_frames_LRS3.py:61
↓ 1 callers
Function
make_grid_from_opencv_images
Create a grid of images from the list of cv2 images in images
tools/smirk_inverse/src/utils/utils.py:83
↓ 1 callers
Function
parse_args
()
tools/spectre_inverse/config.py:119
↓ 1 callers
Function
parse_args
Parse input arguments.
tools/spectre_inverse/6DRepNet/sixdrepnet/train.py:29
↓ 1 callers
Function
parse_args
Parse input arguments.
tools/spectre_inverse/6DRepNet/sixdrepnet/test.py:28
↓ 1 callers
Function
parse_args
Parse input arguments.
tools/spectre_inverse/6DRepNet/sixdrepnet/create_filename_list.py:13
↓ 1 callers
Function
parse_args
Parse input arguments.
tools/spectre_inverse/6DRepNet/sixdrepnet/demo.py:35
↓ 1 callers
Function
parse_args
()
tools/smirk_inverse/train.py:10
↓ 1 callers
Function
plot_kpts
Draw 68 key points Args: image: the input image kpt: (68, 3).
tools/spectre_inverse/src/utils/util.py:589
↓ 1 callers
Function
points2bbox
(points, points_scale=None)
tools/spectre_inverse/src/utils/tensor_cropper.py:13
↓ 1 callers
Function
predict_text
(lipreader, mouth_sequence)
tools/spectre_inverse/utils/lipread_utils.py:75
↓ 1 callers
Method
prepare_data
(self)
tools/spectre_inverse/src/trainer_spectre.py:666
↓ 1 callers
Method
prepare_training_losses
(self)
tools/spectre_inverse/src/trainer_spectre.py:45
↓ 1 callers
Function
process_file
(root, file_name, face_detector)
tools/smirk_inverse/datasets/preprocess_scripts/apply_mediapipe_to_dataset.py:91
↓ 1 callers
Function
process_image
(image_file, output_file, vis_file, face_detector)
tools/smirk_inverse/datasets/preprocess_scripts/apply_mediapipe_to_dataset.py:21
↓ 1 callers
Function
process_video
(video_file, output_file, vis_file, face_detector)
tools/smirk_inverse/datasets/preprocess_scripts/apply_mediapipe_to_dataset.py:49
↓ 1 callers
Function
random_barycentric
(num=1)
tools/smirk_inverse/src/utils/masking.py:54
↓ 1 callers
Function
read
(rel_path)
tools/spectre_inverse/6DRepNet/setup.py:6
↓ 1 callers
Function
repvgg_model_convert
(model:torch.nn.Module, save_path=None, do_copy=True)
tools/spectre_inverse/6DRepNet/sixdrepnet/backbone/repvgg.py:294
↓ 1 callers
Method
reset
(self)
tools/spectre_inverse/utils/run_av_hubert.py:18
↓ 1 callers
Function
resnet50
Constructs a ResNet-50 model.
tools/smirk_inverse/src/losses/resnet.py:157
↓ 1 callers
Function
rotation_matrix_to_quaternion
Convert 3x4 rotation matrix to 4d quaternion vector This algorithm is based on algorithm described in https://github.com/KieranWynn/pyquatern
tools/spectre_inverse/src/utils/rotation_converter.py:88
↓ 1 callers
Function
run_lipreading
:param videos: list of videos :param transcriptions: list of transcriptions :return:
tools/spectre_inverse/utils/run_av_hubert.py:31
↓ 1 callers
Function
save2avi
save2avi. - function taken from Visual Speech Recognition repository :param filename: str, the filename to save the video (.avi). :param data
tools/spectre_inverse/utils/lipread_utils.py:59
↓ 1 callers
Function
save_coeffs_as_pickle
( params: dict, out_path: str, )
tools/smirk_inverse/datawheel_sample.py:43
↓ 1 callers
Method
save_model
(self, state_dict, save_path)
tools/smirk_inverse/src/base_trainer.py:226
↓ 1 callers
Method
save_visualizations
(self, outputs, save_path, show_landmarks=False)
tools/smirk_inverse/src/base_trainer.py:130
← previous
next →
101–200 of 434, ranked by callers