Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/KlingAIResearch/LivePortrait
/ functions
Functions
617 in github.com/KlingAIResearch/LivePortrait
⨍
Functions
617
◇
Types & classes
112
↓ 1 callers
Function
download_onnx
(sub_dir, model_file, force=False, root='~/.insightface', download_zip=False)
src/utils/dependencies/insightface/utils/storage.py:30
↓ 1 callers
Function
drop_path
Drop paths (Stochastic Depth) per sample (when applied in main path of residual blocks). This is the same as the DropConnect impl I created for
src/modules/util.py:408
↓ 1 callers
Function
ensure_available
(sub_dir, name, root='~/.insightface')
src/utils/dependencies/insightface/utils/storage.py:27
↓ 1 callers
Method
execute
(self, args: ArgumentConfig)
src/live_portrait_pipeline_animal.py:69
↓ 1 callers
Method
execute_image_retargeting
for single image retargeting
src/gradio_pipeline.py:231
↓ 1 callers
Method
execute_video_retargeting
retargeting the lip-open ratio of each source frame
src/gradio_pipeline.py:401
↓ 1 callers
Function
fast_check_args
(args: ArgumentConfig)
inference_animals.py:29
↓ 1 callers
Function
fast_check_args
(args: ArgumentConfig)
inference.py:29
↓ 1 callers
Function
fast_check_ffmpeg
()
app_animals.py:23
↓ 1 callers
Function
fast_check_ffmpeg
()
inference_animals.py:21
↓ 1 callers
Function
fast_check_ffmpeg
()
app.py:23
↓ 1 callers
Function
fast_check_ffmpeg
()
inference.py:21
↓ 1 callers
Function
filter_state_dict
(state_dict, remove_name='fc')
src/modules/util.py:320
↓ 1 callers
Function
find_onnx_file
(dir_path)
src/utils/dependencies/insightface/model_zoo/model_zoo.py:61
↓ 1 callers
Method
forward
(self, img, threshold)
src/utils/dependencies/insightface/model_zoo/retinaface.py:146
↓ 1 callers
Method
forward
(self, img, threshold)
src/utils/dependencies/insightface/model_zoo/scrfd.py:149
↓ 1 callers
Method
forward_ca
(self, # for tgt tgt: Optional[Tensor], # nq, bs, d_model tgt
src/utils/dependencies/XPose/models/UniPose/transformer_deformable.py:436
↓ 1 callers
Method
forward_features
(self, x)
src/modules/convnextv2.py:113
↓ 1 callers
Method
forward_ffn
(self, src)
src/utils/dependencies/XPose/models/UniPose/transformer_deformable.py:252
↓ 1 callers
Method
forward_ffn
(self, tgt)
src/utils/dependencies/XPose/models/UniPose/transformer_deformable.py:384
↓ 1 callers
Method
forward_ffn
(self, src)
src/utils/dependencies/XPose/models/UniPose/deformable_transformer.py:972
↓ 1 callers
Method
forward_ffn
(self, tgt, ipdb_flag=False)
src/utils/dependencies/XPose/models/UniPose/deformable_transformer.py:1050
↓ 1 callers
Method
forward_sa
(self, # for tgt tgt: Optional[Tensor], # nq, bs, d_model tgt
src/utils/dependencies/XPose/models/UniPose/transformer_deformable.py:390
↓ 1 callers
Method
freeze
(self, shouldFreeze=True)
src/utils/dependencies/XPose/util/addict.py:152
↓ 1 callers
Method
fromfile
(filename)
src/utils/dependencies/XPose/util/config.py:187
↓ 1 callers
Function
gen_encoder_output_proposals
Input: - memory: bs, \sum{hw}, d_model - memory_padding_mask: bs, \sum{hw} - spatial_shapes: nlevel, 2 - learnedw
src/utils/dependencies/XPose/models/UniPose/utils.py:58
↓ 1 callers
Method
gen_encoder_output_proposals
(self, memory, memory_padding_mask, spatial_shapes)
src/utils/dependencies/XPose/models/UniPose/transformer_deformable.py:95
↓ 1 callers
Function
get_default_provider_options
()
src/utils/dependencies/insightface/model_zoo/model_zoo.py:73
↓ 1 callers
Function
get_default_providers
()
src/utils/dependencies/insightface/model_zoo/model_zoo.py:70
↓ 1 callers
Function
get_extensions
()
src/utils/dependencies/XPose/models/UniPose/ops/setup.py:23
↓ 1 callers
Method
get_feat
(self, imgs)
src/utils/dependencies/insightface/model_zoo/arcface_onnx.py:77
↓ 1 callers
Function
get_object
(name)
src/utils/dependencies/insightface/data/pickle_object.py:7
↓ 1 callers
Method
get_proposal_pos_embed
(self, proposals)
src/utils/dependencies/XPose/models/UniPose/transformer_deformable.py:80
↓ 1 callers
Function
get_rank
()
src/utils/dependencies/XPose/util/misc.py:541
↓ 1 callers
Method
get_reference_points
(spatial_shapes, valid_ratios, device)
src/utils/dependencies/XPose/models/UniPose/transformer_deformable.py:287
↓ 1 callers
Method
get_reference_points
(spatial_shapes, valid_ratios, device)
src/utils/dependencies/XPose/models/UniPose/deformable_transformer.py:579
↓ 1 callers
Function
get_scrfd
(name, download=False, root='~/.insightface/models', **kwargs)
src/utils/dependencies/insightface/model_zoo/scrfd.py:305
↓ 1 callers
Function
get_size
(image_size, size, max_size=None)
src/utils/dependencies/XPose/transforms.py:171
↓ 1 callers
Function
get_size_with_aspect_ratio
(image_size, size, max_size=None)
src/utils/dependencies/XPose/transforms.py:151
↓ 1 callers
Method
get_unipose_output
(self, image, instance_text_prompt, keypoint_text_prompt, box_threshold, IoU_threshold)
src/utils/animal_landmark_runner.py:61
↓ 1 callers
Method
get_valid_ratio
(self, mask)
src/utils/dependencies/XPose/models/UniPose/transformer_deformable.py:127
↓ 1 callers
Method
get_valid_ratio
(self, mask)
src/utils/dependencies/XPose/models/UniPose/deformable_transformer.py:293
↓ 1 callers
Function
hflip
(image, target)
src/utils/dependencies/XPose/transforms.py:83
↓ 1 callers
Method
init_ref_points
(self, use_num_queries)
src/utils/dependencies/XPose/models/UniPose/unipose.py:275
↓ 1 callers
Method
init_ref_points
(self, use_num_queries)
src/utils/dependencies/XPose/models/UniPose/deformable_transformer.py:302
↓ 1 callers
Function
initialize_inputs
Generate random input tensors and move them to GPU
speed.py:20
↓ 1 callers
Function
interpolate
Equivalent to nn.functional.interpolate, but with support for empty batch sizes. This will eventually be supported natively by PyTorch, and t
src/utils/dependencies/XPose/util/misc.py:654
↓ 1 callers
Function
keypoint_xyzxyz_to_xyxyzz
_summary_ Args: keypoints (torch.Tensor): ..., 51
src/utils/dependencies/XPose/util/keypoint_ops.py:18
↓ 1 callers
Function
load_and_compile_models
Load and compile models for inference
speed.py:49
↓ 1 callers
Method
load_animal_model
(self, model_config_path, model_checkpoint_path, device)
src/utils/animal_landmark_runner.py:42
↓ 1 callers
Method
load_image
(self, input_image)
src/utils/animal_landmark_runner.py:51
↓ 1 callers
Function
main
Main function to benchmark speed and model parameters
speed.py:168
↓ 1 callers
Function
main
()
inference_animals.py:36
↓ 1 callers
Function
main
()
inference.py:36
↓ 1 callers
Method
make_motion_template
(self, I_lst, **kwargs)
src/live_portrait_pipeline_animal.py:44
↓ 1 callers
Function
measure_inference_times
Measure inference times for each model
speed.py:100
↓ 1 callers
Method
nms
(self, dets)
src/utils/dependencies/insightface/model_zoo/retinaface.py:262
↓ 1 callers
Method
nms
(self, dets)
src/utils/dependencies/insightface/model_zoo/scrfd.py:275
↓ 1 callers
Function
oks_loss
Oks loss. Computing the oks loss between a set of predicted poses and target poses. The loss is calculated as negative log of oks. Args:
src/utils/dependencies/XPose/models/UniPose/utils.py:243
↓ 1 callers
Function
oks_overlaps
(kpt_preds, kpt_gts, kpt_valids, kpt_areas, sigmas)
src/utils/dependencies/XPose/models/UniPose/utils.py:222
↓ 1 callers
Function
parse_bbox_from_landmark
(pts, **kwargs)
src/utils/crop.py:250
↓ 1 callers
Function
parse_pt2_from_pt106
parsing the 2 points according to the 106 points, which cancels the roll
src/utils/crop.py:63
↓ 1 callers
Function
parse_pt2_from_pt203
parsing the 2 points according to the 203 points, which cancels the roll
src/utils/crop.py:80
↓ 1 callers
Function
parse_pt2_from_pt5
parsing the 2 points according to the 5 points, which cancels the roll
src/utils/crop.py:123
↓ 1 callers
Function
parse_pt2_from_pt68
parsing the 2 points according to the 68 points, which cancels the roll
src/utils/crop.py:96
↓ 1 callers
Function
parse_pt2_from_pt9
parsing the 2 points according to the 9 points, which cancels the roll ['right eye right', 'right eye left', 'left eye right', 'left eye left
src/utils/crop.py:139
↓ 1 callers
Function
parse_pt2_from_pt_x
(pts, use_lip=True)
src/utils/crop.py:163
↓ 1 callers
Function
post_process
(outputs_class, outputs_coord, dn_meta, aux_loss, _set_aux_loss)
src/utils/dependencies/XPose/models/UniPose/mask_generate.py:40
↓ 1 callers
Function
prepare_for_mask
(kpt_mask)
src/utils/dependencies/XPose/models/UniPose/mask_generate.py:4
↓ 1 callers
Method
prepare_retargeting_image
for single image retargeting
src/gradio_pipeline.py:336
↓ 1 callers
Method
prepare_retargeting_video
for video retargeting
src/gradio_pipeline.py:488
↓ 1 callers
Method
prepare_video_lip_silence
for keeping lips in the source video silent
src/gradio_pipeline.py:544
↓ 1 callers
Function
print_benchmark_results
Print benchmark results with average and standard deviation of inference times
speed.py:146
↓ 1 callers
Method
reset_parameters
(self)
src/utils/dependencies/XPose/models/UniPose/position_encoding.py:124
↓ 1 callers
Method
rm_self_attn_modules
(self)
src/utils/dependencies/XPose/models/UniPose/deformable_transformer.py:1041
↓ 1 callers
Method
run
(self, img_rgb: np.ndarray, lmk=None)
src/utils/human_landmark_runner.py:60
↓ 1 callers
Method
setdefault
(self, key, default=None)
src/utils/dependencies/XPose/util/addict.py:145
↓ 1 callers
Function
setup_for_distributed
This function disables printing when not in master process
src/utils/dependencies/XPose/util/misc.py:512
↓ 1 callers
Method
shortcut
(self, x, seg1)
src/modules/util.py:309
↓ 1 callers
Function
sine_func
(x: torch.Tensor)
src/utils/dependencies/XPose/models/UniPose/utils.py:46
↓ 1 callers
Function
softmax
(z)
src/utils/dependencies/insightface/model_zoo/scrfd.py:17
↓ 1 callers
Function
sort_by_direction
(faces, direction: str = 'large-small', face_center=None)
src/utils/face_analysis_diy.py:14
↓ 1 callers
Method
stitch
kp_source: BxNx3 kp_driving: BxNx3 Return: Bx(3*num_kp+2)
src/live_portrait_wrapper.py:240
↓ 1 callers
Method
to_dict
(self)
src/utils/dependencies/XPose/util/addict.py:77
↓ 1 callers
Function
to_ndarray
(obj)
src/utils/human_landmark_runner.py:17
↓ 1 callers
Function
trans_points2d
(pts, M)
src/utils/dependencies/insightface/utils/face_align.py:71
↓ 1 callers
Function
trans_points2d
(pts, M)
src/utils/dependencies/insightface/utils/transform.py:26
↓ 1 callers
Function
trans_points3d
(pts, M)
src/utils/dependencies/insightface/utils/face_align.py:83
↓ 1 callers
Function
trans_points3d
(pts, M)
src/utils/dependencies/insightface/utils/transform.py:38
↓ 1 callers
Function
transform
(data, center, output_size, scale, rotation)
src/utils/dependencies/insightface/utils/transform.py:7
↓ 1 callers
Method
update_delta_new_eyeball_direction
(self, eyeball_direction_x, eyeball_direction_y, delta_new, **kwargs)
src/gradio_pipeline.py:47
↓ 1 callers
Method
update_delta_new_eyebrow
(self, eyebrow, delta_new, **kwargs)
src/gradio_pipeline.py:90
↓ 1 callers
Method
update_delta_new_lip_variation_one
(self, lip_variation_one, delta_new, **kwargs)
src/gradio_pipeline.py:108
↓ 1 callers
Method
update_delta_new_lip_variation_three
(self, lip_variation_three, delta_new, **kwargs)
src/gradio_pipeline.py:125
↓ 1 callers
Method
update_delta_new_lip_variation_two
(self, lip_variation_two, delta_new, **kwargs)
src/gradio_pipeline.py:117
↓ 1 callers
Method
update_delta_new_lip_variation_zero
(self, lip_variation_zero, delta_new, **kwargs)
src/gradio_pipeline.py:102
↓ 1 callers
Method
update_delta_new_mov_x
(self, mov_x, delta_new, **kwargs)
src/gradio_pipeline.py:133
↓ 1 callers
Method
update_delta_new_mov_y
(self, mov_y, delta_new, **kwargs)
src/gradio_pipeline.py:139
↓ 1 callers
Method
update_delta_new_smile
(self, smile, delta_new, **kwargs)
src/gradio_pipeline.py:67
↓ 1 callers
Method
update_delta_new_wink
(self, wink, delta_new, **kwargs)
src/gradio_pipeline.py:80
← previous
next →
201–300 of 617, ranked by callers