MCPcopy Create free account

hub / github.com/KlingAIResearch/LivePortrait / functions

Functions617 in github.com/KlingAIResearch/LivePortrait

Methodforward
The forward expects a NestedTensor, which consists of: - samples.tensor: batched images, of shape [batch_size x 3 x H x W]
src/utils/dependencies/XPose/models/UniPose/unipose.py:303
Methodforward
_summary_ Args: x (_type_): _description_ text_dict (_type_): _description_ { 'encoded_te
src/utils/dependencies/XPose/models/UniPose/unipose.py:586
Methodforward
Input: - srcs: List of multi features [bs, ci, hi, wi] - masks: List of multi masks [bs, hi, wi] - refpoi
src/utils/dependencies/XPose/models/UniPose/deformable_transformer.py:311
Methodforward
Input: - src: [bs, sum(hi*wi), 256] - pos: pos embed for src. [bs, sum(hi*wi), 256] - spatial_shapes: h,w
src/utils/dependencies/XPose/models/UniPose/deformable_transformer.py:592
Methodforward
Input: - tgt: nq, bs, d_model - memory: hw, bs, d_model - pos: hw, bs, d_model - refpoints_un
src/utils/dependencies/XPose/models/UniPose/deformable_transformer.py:769
Methodforward
(self, src, pos, reference_points, spatial_shapes, level_start_index, key_padding_mask=None)
src/utils/dependencies/XPose/models/UniPose/deformable_transformer.py:978
Methodforward
Input: - tgt/tgt_query_pos: nq, bs, d_model -
src/utils/dependencies/XPose/models/UniPose/deformable_transformer.py:1059
Methodforward
(self, encoder_features)
src/utils/dependencies/XPose/models/UniPose/fuse_modules.py:22
Methodforward
_summary_ Args: v (_type_): bs, n_img, dim l (_type_): bs, n_text, dim attention_mask_v (_type_, optional
src/utils/dependencies/XPose/models/UniPose/fuse_modules.py:144
Methodforward
(self, v, l, attention_mask_v=None, attention_mask_l=None)
src/utils/dependencies/XPose/models/UniPose/fuse_modules.py:267
Methodforward
(self, x)
src/utils/dependencies/XPose/models/UniPose/swin_transformer.py:26
Methodforward
Forward function. Args: x: input features with shape of (num_windows*B, N, C) mask: (0/-inf) mask with shape of (num_
src/utils/dependencies/XPose/models/UniPose/swin_transformer.py:112
Methodforward
Forward function. Args: x: Input feature, tensor size (B, H*W, C). H, W: Spatial resolution of the input feature.
src/utils/dependencies/XPose/models/UniPose/swin_transformer.py:187
Methodforward
Forward function. Args: x: Input feature, tensor size (B, H*W, C). H, W: Spatial resolution of the input feature.
src/utils/dependencies/XPose/models/UniPose/swin_transformer.py:258
Methodforward
Forward function. Args: x: Input feature, tensor size (B, H*W, C). H, W: Spatial resolution of the input feature.
src/utils/dependencies/XPose/models/UniPose/swin_transformer.py:347
Methodforward
Forward function.
src/utils/dependencies/XPose/models/UniPose/swin_transformer.py:412
Methodforward
(self, tensor_list: NestedTensor)
src/utils/dependencies/XPose/models/UniPose/swin_transformer.py:605
Methodforward
r""" Args: query, key, value: map a query and a set of key-value pairs to an output. See "Attention Is All You Need" for more
src/utils/dependencies/XPose/models/UniPose/attention.py:101
Methodforward
Args: text_attention_mask: bs, num_token memory_text: bs, num_token, d_model Raises: Ru
src/utils/dependencies/XPose/models/UniPose/transformer_vanilla.py:31
Methodforward
( self, src, src_mask: Optional[Tensor] = None, src_key_padding_mask: Optional
src/utils/dependencies/XPose/models/UniPose/transformer_vanilla.py:79
Methodforward
(self, x)
src/utils/dependencies/XPose/models/UniPose/backbone.py:58
Methodforward
(self, tensor_list: NestedTensor)
src/utils/dependencies/XPose/models/UniPose/backbone.py:98
Methodforward
(self, tensor_list: NestedTensor)
src/utils/dependencies/XPose/models/UniPose/backbone.py:141
Methodforward
(self, tensor_list: NestedTensor)
src/utils/dependencies/XPose/models/UniPose/position_encoding.py:40
Methodforward
(self, tensor_list: NestedTensor)
src/utils/dependencies/XPose/models/UniPose/position_encoding.py:83
Methodforward
(self, tensor_list: NestedTensor)
src/utils/dependencies/XPose/models/UniPose/position_encoding.py:128
Methodforward
:param query (N, Length_{query}, C) :param key (N, 1, C) :param reference_poin
src/utils/dependencies/XPose/models/UniPose/ops/modules/ms_deform_attn_key_aware.py:83
Methodforward
:param query (N, Length_{query}, C) :param reference_points (N, Length_{query}, n_levels, 2), range
src/utils/dependencies/XPose/models/UniPose/ops/modules/ms_deform_attn.py:82
Methodforward
(ctx, value, value_spatial_shapes, value_level_start_index, sampling_locations, attention_weights, im2col_step
src/utils/dependencies/XPose/models/UniPose/ops/functions/ms_deform_attn_func.py:23
Methodforward
(self, img, latent)
src/utils/dependencies/insightface/model_zoo/inswapper.py:41
Methodforward
(self, batch_data)
src/utils/dependencies/insightface/model_zoo/arcface_onnx.py:87
Functionfunc_attention
query: (n_context, queryL, d) context: (n_context, sourceL, d)
src/utils/dependencies/XPose/models/UniPose/fuse_modules.py:48
Functiongeneralized_box_iou
Generalized IoU from https://giou.stanford.edu/ The boxes should be in [x0, y0, x1, y1] format Returns a [N, M] pairwise matrix, where
src/utils/dependencies/XPose/util/box_ops.py:41
Functiongeneralized_box_iou_pairwise
Generalized IoU from https://giou.stanford.edu/ Input: - boxes1, boxes2: N,4 Output: - giou: N, 4
src/utils/dependencies/XPose/util/box_ops.py:85
Methodget
(self, img, max_num=0)
src/utils/dependencies/insightface/app/face_analysis.py:60
Methodget
(self, img, target_face, source_face, paste_back=True)
src/utils/dependencies/insightface/model_zoo/inswapper.py:46
Methodget
(self, img, face)
src/utils/dependencies/insightface/model_zoo/attribute.py:72
Methodget
(self, img, face)
src/utils/dependencies/insightface/model_zoo/arcface_onnx.py:65
Methodget_fs_and_kp_info
(self, source_prepared, driving_first_frame)
src/live_portrait_wrapper.py:165
Functionget_image
(name, to_rgb=False)
src/utils/dependencies/insightface/data/image.py:9
Functionget_model
(name, **kwargs)
src/utils/dependencies/insightface/model_zoo/model_zoo.py:76
Functionget_model_dir
(name, root='~/.insightface')
src/utils/dependencies/insightface/utils/filesystem.py:9
Methodget_pose_dct
(self, kp_info: dict)
src/live_portrait_wrapper.py:157
Functionget_retinaface
(name, download=False, root='~/.insightface/models', **kwargs)
src/utils/dependencies/insightface/model_zoo/retinaface.py:292
Functionget_sha
()
src/utils/dependencies/XPose/util/misc.py:346
Methodglobal_avg
(self)
src/utils/dependencies/XPose/util/misc.py:78
Functiongpu_wrapped_execute_image_retargeting
(*args, **kwargs)
app.py:63
Functiongpu_wrapped_execute_video
(*args, **kwargs)
app_animals.py:57
Functiongpu_wrapped_execute_video
(*args, **kwargs)
app.py:59
Functiongpu_wrapped_execute_video_retargeting
(*args, **kwargs)
app.py:67
Methodimgsize
(self)
src/utils/dependencies/XPose/util/misc.py:395
Functionimport_try_install
Try import the specified package. If the package not installed, try use pip to install and import if success. Parameters ---------- p
src/utils/dependencies/insightface/utils/filesystem.py:96
Functioninit_distributed_mode
(args)
src/utils/dependencies/XPose/util/misc.py:555
Methodinit_retargeting_image
initialize the retargeting slider
src/gradio_pipeline.py:377
Methodinitialize_weights_to_zero
(self)
src/modules/stitching_retargeting_network.py:31
Functionkeypoint_xyxyzz_to_xyzxyz
_summary_ Args: keypoints (torch.Tensor): ..., 51
src/utils/dependencies/XPose/util/keypoint_ops.py:3
Functionl1norm
L1-normalize columns of X
src/utils/dependencies/XPose/models/UniPose/fuse_modules.py:32
Functionload_lip_array
()
src/config/inference_config.py:14
Methodload_pretrained
(self, init_path: str)
src/modules/motion_extractor.py:26
Methodlog_every
(self, iterable, print_freq, header=None, logger=None)
src/utils/dependencies/XPose/util/misc.py:285
Functionmake_abs_path
(fn)
src/live_portrait_pipeline.py:31
Functionmake_abs_path
(fn)
src/live_portrait_pipeline_animal.py:35
Functionmake_abs_path
(fn)
src/utils/cropper.py:24
Functionmake_abs_path
(fn)
src/utils/crop.py:16
Functionmake_abs_path
(fn)
src/utils/human_landmark_runner.py:13
Functionmakedirs
Create directory recursively if not exists. Similar to `makedir -p`, you can skip checking existence before this function. Parameters ---
src/utils/dependencies/insightface/utils/filesystem.py:14
Functionmasks_to_boxes
Compute the bounding boxes around the provided masks The masks should be in format [N, H, W] where N is the number of masks, (H, W) are the spati
src/utils/dependencies/XPose/util/box_ops.py:109
Functionmatrix2angle
get three Euler angles from Rotation Matrix Args: R: (3,3). rotation matrix Returns: x: pitch y: yaw z: roll
src/utils/dependencies/insightface/utils/transform.py:91
Methodmedian
(self)
src/utils/dependencies/XPose/util/misc.py:66
Functionmerge_audio_video
(video_fp, audio_fp, wfp)
src/utils/video.py:67
Methodmerge_from_dict
Merge list into cfg_dict Merge the dict parsed by MultipleKVAction into this cfg. Examples: >>> options = {'model.backbo
src/utils/dependencies/XPose/util/config.py:353
Methodmodule_dict
(self)
src/utils/dependencies/XPose/models/registry.py:31
Methodname
(self)
src/utils/dependencies/XPose/models/registry.py:27
Functionnorm_crop
(img, landmark, image_size=112, mode='arcface')
src/utils/dependencies/insightface/utils/face_align.py:27
Functionnorm_crop2
(img, landmark, image_size=112, mode='arcface')
src/utils/dependencies/insightface/utils/face_align.py:32
Methodnormed_embedding
(self)
src/utils/dependencies/insightface/app/common.py:40
Methodopen_set_transfer_init
(self)
src/utils/dependencies/XPose/models/UniPose/unipose.py:242
Functionparse
(x)
src/modules/util.py:446
Methodprepare
(self, ctx_id, det_thresh=0.5, det_size=(640, 640))
src/utils/dependencies/insightface/app/face_analysis.py:49
Methodprepare
(self, ctx_id, **kwargs)
src/utils/dependencies/insightface/model_zoo/landmark.py:76
Methodprepare
(self, ctx_id, **kwargs)
src/utils/dependencies/insightface/model_zoo/attribute.py:68
Methodprepare
(self, ctx_id, **kwargs)
src/utils/dependencies/insightface/model_zoo/retinaface.py:130
Methodprepare
(self, ctx_id, **kwargs)
src/utils/dependencies/insightface/model_zoo/arcface_onnx.py:61
Methodpretty_text
(self)
src/utils/dependencies/XPose/util/config.py:223
Functionreduce_dict
Args: input_dict (dict): all the values will be reduced average (bool): whether to do average or sum Reduce the values in the
src/utils/dependencies/XPose/util/misc.py:220
Methodregiste_with_name
(self, module_name=None, force=False)
src/utils/dependencies/XPose/models/registry.py:37
Methodregister
Register a module build function. Args: module (:obj:`nn.Module`): Module to be registered.
src/utils/dependencies/XPose/models/registry.py:40
Functionreset_sliders
(*args, **kwargs)
app.py:71
Methodrm_self_attn_modules
(self)
src/utils/dependencies/XPose/models/UniPose/transformer_deformable.py:374
Functionsave_on_master
(*args, **kwargs)
src/utils/dependencies/XPose/util/misc.py:551
Functionscrfd_2p5gkps
(**kwargs)
src/utils/dependencies/insightface/model_zoo/scrfd.py:315
Methodsex
(self)
src/utils/dependencies/insightface/app/common.py:46
Methodshape
(self)
src/utils/dependencies/XPose/util/misc.py:449
Functionshort_hash
(name)
src/utils/dependencies/insightface/model_zoo/model_store.py:29
Functionsigmoid_focal_loss
Loss used in RetinaNet for dense detection: https://arxiv.org/abs/1708.02002. Args: inputs: A float tensor of arbitrary shape.
src/utils/dependencies/XPose/models/UniPose/utils.py:131
Functionsoftmax
(z)
src/utils/dependencies/insightface/model_zoo/retinaface.py:17
Functionsquare_crop
(im, S)
src/utils/dependencies/insightface/utils/face_align.py:37
Functionsqueeze_tensor_to_numpy
(tensor)
src/utils/helper.py:96
Methodsynchronize_between_processes
Warning: does not synchronize the deque!
src/utils/dependencies/XPose/util/misc.py:52
Methodsynchronize_between_processes
(self)
src/utils/dependencies/XPose/util/misc.py:278
← previousnext →501–600 of 617, ranked by callers