MCPcopy Create free account

hub / github.com/Songluchuan/TDMM-LM_data / functions

Functions434 in github.com/Songluchuan/TDMM-LM_data

↓ 20 callersMethodforward
(self, param_dictionary, zero_expression=False, zero_shape=False, zero_pose=False)
tools/smirk_inverse/src/FLAME/FLAME.py:234
↓ 18 callersMethodeval
(self)
tools/spectre_inverse/src/spectre.py:272
↓ 17 callersMethodeval
(self)
tools/smirk_inverse/src/base_trainer.py:113
↓ 17 callersMethodupdate
(self, val, n=1)
tools/spectre_inverse/utils/run_av_hubert.py:24
↓ 9 callersMethod_block
(in_channels, features, name)
tools/smirk_inverse/src/smirk_generator.py:89
↓ 9 callersMethoddecode
(self, codedict, rendering=True, vis_lmk=True, return_vis=True, render_orig=False, original_ima
tools/spectre_inverse/src/spectre.py:157
↓ 8 callersMethodstep
(self, batch, phase='train')
tools/spectre_inverse/src/trainer_spectre.py:103
↓ 7 callersFunctionface_vertices
:param vertices: [batch size, number of vertices, 3] :param faces: [batch size, number of faces, 3] :return: [batch size, number of face
tools/smirk_inverse/src/renderer/util.py:10
↓ 7 callersFunctionto_np
(array, dtype=np.float32)
tools/spectre_inverse/src/models/FLAME.py:27
↓ 7 callersFunctionto_np
(array, dtype=np.float32)
tools/smirk_inverse/src/FLAME/FLAME.py:34
↓ 7 callersFunctionto_tensor
(array, dtype=torch.float32)
tools/spectre_inverse/src/models/FLAME.py:24
↓ 7 callersFunctionto_tensor
(array, dtype=torch.float32)
tools/smirk_inverse/src/FLAME/FLAME.py:31
↓ 7 callersFunctionvertices2landmarks
Calculates landmarks by barycentric interpolation Parameters ---------- vertices: torch.tensor BxVx3, dtype = torch.float32
tools/smirk_inverse/src/FLAME/lbs.py:101
↓ 6 callersMethod__init__
(self, in_channels, out_channels, bilinear=True)
tools/spectre_inverse/src/models/resnet.py:229
↓ 6 callersMethodencode
(self, images)
tools/spectre_inverse/src/spectre.py:141
↓ 5 callersMethodprepare_data
(self, image, landmarks_fan, landmarks_mediapipe)
tools/smirk_inverse/datasets/base_dataset.py:124
↓ 5 callersMethodstep
(self, batch, batch_idx, phase='train')
tools/smirk_inverse/src/smirk_trainer.py:349
↓ 4 callersMethod_make_layer
(self, block, planes, blocks, stride=1)
tools/spectre_inverse/src/models/resnet.py:47
↓ 4 callersMethod_make_layer
(self, block, planes, blocks, stride=1)
tools/spectre_inverse/6DRepNet/sixdrepnet/model.py:78
↓ 4 callersMethod_make_layer
(self, block, planes, blocks, stride=1, dilate=False)
tools/smirk_inverse/src/models/MICA/arcface.py:121
↓ 4 callersMethod_make_layer
(self, block, planes, blocks, stride=1)
tools/smirk_inverse/src/losses/resnet.py:120
↓ 4 callersMethod_make_stage
(self, planes, num_blocks, stride)
tools/spectre_inverse/6DRepNet/sixdrepnet/backbone/repvgg.py:171
↓ 4 callersFunctionbatch_draw_keypoints
(images, landmarks, color=(255, 255, 255), radius=1)
tools/smirk_inverse/src/utils/utils.py:65
↓ 4 callersFunctionconvert_text_to_visemes
(text)
tools/spectre_inverse/utils/lipread_utils.py:37
↓ 4 callersFunctionget_list_from_filenames
(file_path)
tools/spectre_inverse/6DRepNet/sixdrepnet/datasets.py:15
↓ 4 callersFunctionlandmarks_interpolate
landmarks_interpolate. :param landmarks: List, the raw landmark (in-place)
tools/spectre_inverse/datasets/data_utils.py:17
↓ 4 callersMethodrender_shape
-- rendering shape with detail normal map
tools/spectre_inverse/src/utils/renderer.py:264
↓ 4 callersFunctiontensor2video
(tensor,gray=False)
tools/spectre_inverse/src/utils/util.py:539
↓ 3 callersMethod__init__
(self)
tools/smirk_inverse/src/smirk_encoder.py:15
↓ 3 callersMethod_fuse_bn_tensor
(self, branch)
tools/spectre_inverse/6DRepNet/sixdrepnet/backbone/repvgg.py:97
↓ 3 callersFunctionbatch_rodrigues
Calculates the rotation matrices for a batch of rotation vectors Parameters ---------- rot_vecs: torch.tensor Nx3
tools/spectre_inverse/src/models/lbs.py:274
↓ 3 callersFunctionbatch_rodrigues
Calculates the rotation matrices for a batch of rotation vectors Parameters ---------- rot_vecs: torch.tensor Nx3
tools/smirk_inverse/src/FLAME/lbs.py:274
↓ 3 callersFunctioncopy_parameter_from_resnet
(model, resnet_dict)
tools/spectre_inverse/src/models/resnet.py:156
↓ 3 callersFunctioncreate_backbone
(backbone_name, pretrained=True)
tools/smirk_inverse/src/smirk_encoder.py:7
↓ 3 callersFunctioncreate_mask
(landmarks, shape)
tools/smirk_inverse/datasets/base_dataset.py:9
↓ 3 callersMethodcrop
(self, image, points, points_scale=None)
tools/spectre_inverse/src/utils/tensor_cropper.py:91
↓ 3 callersMethodcut_mouth
function adapted from https://github.com/mpc001/Visual_Speech_Recognition_for_Multiple_Languages
tools/spectre_inverse/src/trainer_spectre.py:255
↓ 3 callersFunctiongather_LRS3_split
(folder_list, split="trainval")
tools/smirk_inverse/datasets/data_utils.py:114
↓ 3 callersMethodmodel_dict
(self)
tools/spectre_inverse/src/spectre.py:277
↓ 3 callersFunctionplot_verts
Draw 68 key points Args: image: the input image kpt: (68, 3).
tools/spectre_inverse/src/utils/util.py:620
↓ 3 callersFunctionrot_mat_to_euler
(rot_mats)
tools/spectre_inverse/src/models/lbs.py:26
↓ 3 callersFunctionrun_mediapipe
(image)
tools/smirk_inverse/utils/mediapipe_utils.py:18
↓ 3 callersMethodtrain
(self)
tools/smirk_inverse/src/base_trainer.py:108
↓ 3 callersFunctiontransform_points
(points, tform, points_scale=None, out_scale=None)
tools/spectre_inverse/src/utils/tensor_cropper.py:118
↓ 3 callersFunctionvertex_normals
:param vertices: [batch size, number of vertices, 3] :param faces: [batch size, number of faces, 3] :return: [batch size, number of verti
tools/smirk_inverse/src/renderer/util.py:30
↓ 3 callersFunctionvertices2landmarks
Calculates landmarks by barycentric interpolation Parameters ---------- vertices: torch.tensor BxVx3, dtype = torch.float32
tools/spectre_inverse/src/models/lbs.py:101
↓ 2 callersMethod__init__
(self, block, layers, dropout=0, num_features=512, zero_init_residual=False,
tools/smirk_inverse/src/models/MICA/arcface.py:68
↓ 2 callersMethod__init__
(self, block, layers, num_classes=1000, include_top=True, emoca_specific=False)
tools/smirk_inverse/src/losses/resnet.py:90
↓ 2 callersMethod_find_dynamic_lmk_idx_and_bcoords
Selects the face contour depending on the reletive position of the head Input: vertices: N X num_of_vertices
tools/smirk_inverse/src/FLAME/FLAME.py:119
↓ 2 callersMethodadd_SHlight
sh_coeff: [bz, 9, 3]
tools/spectre_inverse/src/utils/renderer.py:219
↓ 2 callersMethodadd_directionlight
normals: [bz, nv, 3] lights: [bz, nlight, 6] returns: shading: [bz, nv, 3]
tools/spectre_inverse/src/utils/renderer.py:248
↓ 2 callersMethodadd_directionlight
normals: [bz, nv, 3] lights: [bz, nlight, 6] returns: shading: [bz, nv, 3]
tools/smirk_inverse/src/renderer/renderer.py:239
↓ 2 callersFunctionbatch_kp_2d_l1_loss
Computes the l1 loss between the ground truth keypoints and the predicted keypoints Inputs: kp_gt : N x K x 3 kp_pred: N x K x 2
tools/spectre_inverse/src/utils/lossfunc.py:11
↓ 2 callersFunctionbatch_orth_proj
orthgraphic projection X: 3d vertices, [bz, n_point, 3] camera: scale and translation, [bz, 3], [scale, tx, ty]
tools/smirk_inverse/src/renderer/util.py:64
↓ 2 callersFunctionconv3x3
3x3 convolution with padding
tools/spectre_inverse/src/models/resnet.py:120
↓ 2 callersFunctionconv3x3
3x3 convolution with padding
tools/smirk_inverse/src/models/MICA/arcface.py:11
↓ 2 callersFunctionconv3x3
3x3 convolution with padding
tools/smirk_inverse/src/losses/resnet.py:6
↓ 2 callersFunctionconv_bn
(in_channels, out_channels, kernel_size, stride, padding, groups=1)
tools/spectre_inverse/6DRepNet/sixdrepnet/backbone/repvgg.py:9
↓ 2 callersFunctioncount_parameters
(model)
tools/smirk_inverse/src/utils/utils.py:42
↓ 2 callersMethodcreate_grid
(self, opdict)
tools/spectre_inverse/src/trainer_spectre.py:649
↓ 2 callersFunctioncross_product
(u, v)
tools/spectre_inverse/6DRepNet/sixdrepnet/utils.py:131
↓ 2 callersMethoddraw_axis
Prints the person's name and age. If the argument 'additional' is passed, then it is appended after the main info. Paramete
tools/spectre_inverse/6DRepNet/sixdrepnet/regressor.py:83
↓ 2 callersFunctioneuler_to_quaternion
(r)
tools/spectre_inverse/src/utils/rotation_converter.py:67
↓ 2 callersMethodevaluate
(self, datasets=None)
tools/spectre_inverse/src/trainer_spectre.py:397
↓ 2 callersMethodevaluate
NOW validation
tools/spectre_inverse/src/utils/trainer.py:208
↓ 2 callersFunctionget_gaussian_kernel
r"""Function that returns Gaussian filter coefficients. Args: kernel_size (int): filter size. It should be odd and positive. sigm
tools/spectre_inverse/src/utils/util.py:304
↓ 2 callersFunctionload_obj
Ref: https://github.com/facebookresearch/pytorch3d/blob/25c065e9dafa90163e7cec873dbb324a637c68b7/pytorch3d/io/obj_io.py Load a mesh from a file-l
tools/spectre_inverse/src/utils/util.py:158
↓ 2 callersFunctionnormalize_vector
(v)
tools/spectre_inverse/6DRepNet/sixdrepnet/utils.py:117
↓ 2 callersMethodoptimizers_step
(self, step_encoder=True, step_fuse_generator=True)
tools/smirk_inverse/src/base_trainer.py:123
↓ 2 callersMethodoptimizers_zero_grad
(self)
tools/smirk_inverse/src/base_trainer.py:118
↓ 2 callersMethodpredict
Predicts the persons head pose and returning it in euler angles. Parameters ---------- img : array Face
tools/spectre_inverse/6DRepNet/sixdrepnet/regressor.py:51
↓ 2 callersMethodprepare_data
(self)
tools/spectre_inverse/src/utils/trainer.py:247
↓ 2 callersFunctionquaternion_to_angle_axis
Convert quaternion vector to angle axis of rotation. TODO: CORRECT Adapted from ceres C++ library: ceres-solver/include/ceres/rotation.h Arg
tools/spectre_inverse/src/utils/rotation_converter.py:250
↓ 2 callersFunctionquaternion_to_rotation_matrix
Convert quaternion coefficients to rotation matrix. Args: quat: size = [B, 4] 4 <===>(w, x, y, z) Returns: Rotation matrix cor
tools/spectre_inverse/src/utils/rotation_converter.py:228
↓ 2 callersMethodrasterize
(self, vertices, faces, attributes=None, h=None, w=None)
tools/smirk_inverse/src/renderer/renderer.py:171
↓ 2 callersFunctionrel_dis
(landmarks)
tools/spectre_inverse/src/utils/lossfunc.py:66
↓ 2 callersMethodrender
Render the mesh with the given vertices. Transformed vertices includes vertices in NDC space. Note that due to this custom implementation of
tools/smirk_inverse/src/renderer/renderer.py:121
↓ 2 callersFunctionrot_mat_to_euler
(rot_mats)
tools/smirk_inverse/src/FLAME/lbs.py:26
↓ 2 callersMethodtrain
(self)
tools/spectre_inverse/src/spectre.py:266
↓ 1 callersMethod__getitem_aux__
(self, index)
tools/smirk_inverse/datasets/lrs3_dataset.py:16
↓ 1 callersMethod__init__
(self, image_size, obj_filename, uv_size=256, rasterizer_type='pytorch3d')
tools/spectre_inverse/src/utils/renderer.py:97
↓ 1 callersMethod__init__
(self, outsize)
tools/spectre_inverse/src/models/encoders.py:67
↓ 1 callersMethod__init__
(self, config)
tools/spectre_inverse/src/models/FLAME.py:43
↓ 1 callersMethod__init__
(self, backbone_name, backbone_file, deploy, pretrained=True)
tools/spectre_inverse/6DRepNet/sixdrepnet/model.py:10
↓ 1 callersMethod__init__
(self, num_blocks, num_classes=1000, width_multiplier=None, override_groups_map=None, deploy=False, use_se=Fal
tools/spectre_inverse/6DRepNet/sixdrepnet/backbone/repvgg.py:148
↓ 1 callersMethod__init__
Initialize the Resnet block A resnet block is a conv block with skip connections We construct a conv block with build_conv_block func
tools/smirk_inverse/src/smirk_generator.py:124
↓ 1 callersMethod__init__
(self)
tools/smirk_inverse/src/models/MICA/mica.py:49
↓ 1 callersFunction_compute_binary_kernel
r"""Creates a binary kernel to extract the patches. If the window size is HxW will create a (H*W)xHxW kernel.
tools/spectre_inverse/src/utils/util.py:380
↓ 1 callersMethod_cos_metric
(self, x1, x2)
tools/smirk_inverse/src/losses/ExpressionLoss.py:45
↓ 1 callersMethod_create_model
(self, model_cfg)
tools/spectre_inverse/src/spectre.py:59
↓ 1 callersMethod_find_dynamic_lmk_idx_and_bcoords
Selects the face contour depending on the reletive position of the head Input: vertices: N X num_of_vertices
tools/spectre_inverse/src/models/FLAME.py:93
↓ 1 callersFunction_get_params
(key)
tools/spectre_inverse/src/utils/util.py:508
↓ 1 callersMethod_pad_1x1_to_3x3_tensor
(self, kernel1x1)
tools/spectre_inverse/6DRepNet/sixdrepnet/backbone/repvgg.py:91
↓ 1 callersMethod_setup_renderer
(self, model_cfg)
tools/spectre_inverse/src/spectre.py:42
↓ 1 callersMethodadd_pointlight
vertices: [bz, nv, 3] lights: [bz, nlight, 6] returns: shading: [bz, nv, 3]
tools/spectre_inverse/src/utils/renderer.py:234
↓ 1 callersFunctionangle_axis_to_quaternion
Convert an angle axis to a quaternion. Adapted from ceres C++ library: ceres-solver/include/ceres/rotation.h Args: angle_axis (torch
tools/spectre_inverse/src/utils/rotation_converter.py:178
↓ 1 callersFunctionaugment_bbox
(center, bbox_size, scale=[1.0, 1.0], trans_scale=0.)
tools/spectre_inverse/src/utils/tensor_cropper.py:30
↓ 1 callersFunctionbatch_axis2matrix
(theta)
tools/spectre_inverse/src/utils/rotation_converter.py:318
↓ 1 callersFunctionbatch_matrix2euler
(rot_mats)
tools/spectre_inverse/src/utils/rotation_converter.py:306
↓ 1 callersFunctionbatch_rigid_transform
Applies a batch of rigid transformations to the joints Parameters ---------- rot_mats : torch.tensor BxNx3x3 Tensor of rotat
tools/spectre_inverse/src/models/lbs.py:321
next →1–100 of 434, ranked by callers