MCPcopy Create free account

hub / github.com/caiyuanhao1998/Open-OmniVCus / functions

Functions1,933 in github.com/caiyuanhao1998/Open-OmniVCus

↓ 2 callersMethod_get_maskmem_pos_enc
`maskmem_pos_enc` is the same across frames and objects, so we cache it as a constant in the inference session to reduce session stor
VideoCus-Factory/sam2/sam2_video_predictor.py:931
↓ 2 callersMethod_init_pipe_if_needed
(self)
DiffSynth-Studio/examples/wanvideo/model_training/validate_full/Wan2.1-VACE-14B_tensor_parallel_all.py:238
↓ 2 callersMethod_init_pipe_if_needed
(self)
DiffSynth-Studio/examples/wanvideo/model_training/validate_full/Wan2.2-VACE-Fun-A14B_tensor_parallel_all.py:242
↓ 2 callersMethod_init_pipe_if_needed
(self)
DiffSynth-Studio/examples/wanvideo/model_training/validate_full/Wan2.1-VACE-14B_tensor_parallel_all_reverse.py:263
↓ 2 callersMethod_init_pipe_if_needed
(self)
DiffSynth-Studio/examples/wanvideo/model_training/validate_full/Wan2.1-VACE-1.3B_tensor_parallel.py:167
↓ 2 callersMethod_init_pipe_if_needed
(self)
DiffSynth-Studio/examples/wanvideo/model_training/validate_full/Wan2.1-VACE-14B_tensor_parallel.py:166
↓ 2 callersMethod_init_pipe_if_needed
(self)
DiffSynth-Studio/examples/wanvideo/model_training/validate_full/Wan2.1-VACE-1.3B_tensor_parallel_all.py:245
↓ 2 callersMethod_init_pipe_if_needed
(self)
DiffSynth-Studio/examples/wanvideo/model_training/validate_full/Wan2.2-VACE-Fun-A14B_tensor_parallel.py:165
↓ 2 callersMethod_init_pipe_if_needed
确保 pipe 已创建,且每个 rank 绑定自己的 GPU。
DiffSynth-Studio/examples/wanvideo/model_inference/Wan2.1-VACE-1.3B_tensor_parallel_v2.py:171
↓ 2 callersMethod_init_pipe_if_needed
(self)
DiffSynth-Studio/examples/wanvideo/model_inference/Wan2.1-VACE-14B_tensor_parallel.py:172
↓ 2 callersMethod_init_pipe_if_needed
(self)
DiffSynth-Studio/examples/wanvideo/model_inference/Wan2.2-VACE-Fun-A14B_tensor_parallel.py:172
↓ 2 callersFunction_load_checkpoint
(model, ckpt_path)
VideoCus-Factory/sam2/build_sam.py:119
↓ 2 callersFunction_load_img_as_tensor
(img_path, image_size)
VideoCus-Factory/sam2/utils/misc.py:92
↓ 2 callersMethod_maybe_write_debug_file
(self)
DiffSynth-Studio/examples/wanvideo/model_inference/Wan2.1-VACE-1.3B_tensor_parallel.py:116
↓ 2 callersMethod_memory_efficient_attention_xformers
(self, query, key, value, attention_mask)
Video-Depth-Anything/video_depth_anything/motion_module/attention.py:256
↓ 2 callersMethod_obj_id_to_idx
Map client-side object id to model-side object index.
VideoCus-Factory/sam2/sam2_video_predictor.py:137
↓ 2 callersMethod_pe_encoding
Positionally encode points that are normalized to [0,1].
VideoCus-Factory/sam2/modeling/position_encoding.py:129
↓ 2 callersMethod_prep_prompts
( self, point_coords, point_labels, box, mask_logits, normalize_coords, img_idx=-1 )
VideoCus-Factory/sam2/sam2_image_predictor.py:305
↓ 2 callersMethod_process_cross_attn
(self, x, cond, kv_seqlen)
DiffSynth-Studio/diffsynth/models/longcat_video_dit.py:284
↓ 2 callersMethod_recombine_heads
(self, x: Tensor)
VideoCus-Factory/sam2/modeling/sam/transformer.py:225
↓ 2 callersMethodadd_new_points_or_box
Add new points to a frame.
VideoCus-Factory/sam2/sam2_video_predictor.py:180
↓ 2 callersMethodalign_res_stack_to_original_blocks
(self, res_stack, num_blocks, hidden_states)
DiffSynth-Studio/diffsynth/models/flux_controlnet.py:104
↓ 2 callersFunctionattention
(q, k, v, attn_mask, mode="torch")
DiffSynth-Studio/diffsynth/models/step1x_connector.py:12
↓ 2 callersFunctionbatch_iterator
(batch_size: int, *args)
VideoCus-Factory/sam2/utils/amg.py:100
↓ 2 callersFunctionbatched_mask_to_box
Calculates boxes in XYXY format around masks. Return [0,0,0,0] for an empty mask. For input shape C1xC2x...xHxW, the output shape is C1xC2x..
VideoCus-Factory/sam2/utils/amg.py:305
↓ 2 callersFunctionbox_xyxy_to_xywh
(box_xyxy: torch.Tensor)
VideoCus-Factory/sam2/utils/amg.py:93
↓ 2 callersMethodbuild_1d_mask
(self, length, left_bound, right_bound, border_width)
DiffSynth-Studio/diffsynth/models/wan_video_vae.py:1081
↓ 2 callersMethodbuild_mask
(self, data, is_bound, border_width)
DiffSynth-Studio/diffsynth/models/wan_video_vae.py:1090
↓ 2 callersFunctionbuild_sam2_hf
(model_id, **kwargs)
VideoCus-Factory/sam2/build_sam.py:81
↓ 2 callersMethodcal_audio_emb
(self, audio_input, motion_frames=[73, 19])
DiffSynth-Studio/diffsynth/models/wan_video_dit_s2v.py:484
↓ 2 callersFunctioncalculate_stability_score
Computes the stability score for a batch of masks. The stability score is the IoU between the binary masks obtained by thresholding the p
VideoCus-Factory/sam2/utils/amg.py:158
↓ 2 callersMethodcast_to
(self, weight, dtype, device)
DiffSynth-Studio/diffsynth/core/vram/layers.py:60
↓ 2 callersMethodcheck_free_vram
(self)
DiffSynth-Studio/diffsynth/core/vram/layers.py:65
↓ 2 callersMethodconvert_state_dict
(self, state_dict)
DiffSynth-Studio/diffsynth/utils/lora/flux.py:84
↓ 2 callersFunctionconvert_state_dict_keys_to_single_str
(state_dict, with_shape=True)
DiffSynth-Studio/diffsynth/core/loader/file.py:43
↓ 2 callersFunctioncount_conv3d
(model)
DiffSynth-Studio/diffsynth/models/wan_video_vae.py:943
↓ 2 callersFunctioncount_data_rows
Count data rows (exclude header).
VideoCus-Factory/mix_csv.py:8
↓ 2 callersFunctioncreate_custom_forward
(module)
DiffSynth-Studio/diffsynth/utils/xfuser/xdit_context_parallel.py:85
↓ 2 callersFunctioncreate_custom_forward
(module)
DiffSynth-Studio/diffsynth/core/gradient/gradient_checkpoint.py:4
↓ 2 callersFunctioncreate_custom_forward_vap
(block, vap)
DiffSynth-Studio/diffsynth/pipelines/wan_video.py:1324
↓ 2 callersFunctioncrop_len
(orig_len, n_crops, overlap)
VideoCus-Factory/sam2/utils/amg.py:217
↓ 2 callersFunctiondo_pool
(x: torch.Tensor, pool: nn.Module, norm: nn.Module = None)
VideoCus-Factory/sam2/modeling/backbones/hieradet.py:25
↓ 2 callersFunctiondrop_add_residual_stochastic_depth
( x: Tensor, residual_func: Callable[[Tensor], Tensor], sample_drop_ratio: float = 0.0, )
Video-Depth-Anything/video_depth_anything/dinov2_layers/block.py:110
↓ 2 callersFunctiondrop_add_residual_stochastic_depth_list
( x_list: List[Tensor], residual_func: Callable[[Tensor, Any], Tensor], sample_drop_ratio: float =
Video-Depth-Anything/video_depth_anything/dinov2_layers/block.py:181
↓ 2 callersMethodedit_image_auto_resize
(self, edit_image)
DiffSynth-Studio/diffsynth/pipelines/qwen_image.py:546
↓ 2 callersMethodenable_lora_merger
(self)
DiffSynth-Studio/diffsynth/pipelines/flux_image.py:107
↓ 2 callersMethodencode_images_using_qwenvl
(self, pipe: QwenImagePipeline, images: list[Image.Image], highres=False)
DiffSynth-Studio/diffsynth/pipelines/qwen_image.py:621
↓ 2 callersMethodencode_prompt
(self, pipe: WanVideoPipeline, prompt)
DiffSynth-Studio/diffsynth/pipelines/wan_video.py:688
↓ 2 callersFunctionensure_even
(value)
Video-Depth-Anything/utils/dc_utils.py:16
↓ 2 callersFunctionexample
(pipe, seeds, example_id, global_prompt, entity_prompts)
DiffSynth-Studio/examples/qwen_image/model_inference/Qwen-Image-EliGen.py:65
↓ 2 callersFunctionexample
(pipe, seeds, example_id, global_prompt, entity_prompts)
DiffSynth-Studio/examples/qwen_image/model_inference/Qwen-Image-EliGen-V2.py:64
↓ 2 callersFunctionexample
(pipe, seeds, example_id, global_prompt, entity_prompts)
DiffSynth-Studio/examples/qwen_image/model_inference_low_vram/Qwen-Image-EliGen.py:65
↓ 2 callersFunctionexample
(pipe, seeds, example_id, global_prompt, entity_prompts)
DiffSynth-Studio/examples/qwen_image/model_inference_low_vram/Qwen-Image-EliGen-V2.py:64
↓ 2 callersMethodexport_trainable_state_dict
(self, state_dict, remove_prefix=None)
DiffSynth-Studio/diffsynth/diffusion/training_module.py:54
↓ 2 callersFunctionextract_vid
JSON entry -> vid (stem, no .mp4). Supports: - {"vid": "..."} - {"video": "..."} / {"video_path": "..."} / {"name": "..."} / {"fi
Video-Depth-Anything/process_data_depth.py:33
↓ 2 callersFunctionfix_path
(doc_root_path)
DiffSynth-Studio/examples/dev_tools/fix_path.py:16
↓ 2 callersMethodflush_files
(self)
DiffSynth-Studio/diffsynth/core/vram/disk_map.py:46
↓ 2 callersMethodforward
imgs: [B, 3, H, W] of torch.float32. - mean: [0.48145466, 0.4578275, 0.40821073] - std: [0.26862954, 0.2613025
DiffSynth-Studio/diffsynth/models/wan_video_image_encoder.py:571
↓ 2 callersMethodforward
(self, x: torch.Tensor, first_chunk=False)
DiffSynth-Studio/diffsynth/models/wan_video_vae.py:417
↓ 2 callersMethodforward
Forward pass through the upsampling block. Args: x (torch.Tensor): Input tensor feat_cache (list, optional):
DiffSynth-Studio/diffsynth/models/qwen_image_vae.py:496
↓ 2 callersMethodforward_with_coords
Positionally encode points that are not normalized to [0,1].
VideoCus-Factory/sam2/modeling/position_encoding.py:151
↓ 2 callersFunctionfp16_clamp
(x)
DiffSynth-Studio/diffsynth/models/wan_video_text_encoder.py:11
↓ 2 callersFunctionfused_leaky_relu
(input, bias, negative_slope=0.2, scale=2 ** 0.5)
DiffSynth-Studio/diffsynth/models/wan_video_animate_adapter.py:321
↓ 2 callersFunctiongenerate_image
(lora_path, prompt, seed)
DiffSynth-Studio/examples/qwen_image/model_inference/Qwen-Image-i2L.py:88
↓ 2 callersFunctiongenerate_image
(lora_path, prompt, seed)
DiffSynth-Studio/examples/qwen_image/model_inference_low_vram/Qwen-Image-i2L.py:111
↓ 2 callersFunctionget_attn_bias_and_cat
this will perform the index select, cat the tensors, and provide the attn_bias from cache
Video-Depth-Anything/video_depth_anything/dinov2_layers/block.py:157
↓ 2 callersFunctionget_clones
(module, N)
VideoCus-Factory/sam2/modeling/sam2_utils.py:84
↓ 2 callersMethodget_dense_pe
Returns the positional encoding used to encode point prompts, applied to a dense set of points the shape of the image encoding.
VideoCus-Factory/sam2/modeling/sam/prompt_encoder.py:68
↓ 2 callersMethodget_grid_sizes
(self, grid_size_x, grid_size_ref)
DiffSynth-Studio/diffsynth/models/wan_video_dit_s2v.py:491
↓ 2 callersMethodget_i2v_mask
(self, lat_t, lat_h, lat_w, mask_len=1, mask_pixel_values=None, device="cuda")
DiffSynth-Studio/diffsynth/pipelines/wan_video.py:963
↓ 2 callersFunctionget_local_rank
()
DiffSynth-Studio/examples/wanvideo/model_training/validate_full/Wan2.1-VACE-14B_tensor_parallel_all.py:69
↓ 2 callersFunctionget_local_rank
()
DiffSynth-Studio/examples/wanvideo/model_training/validate_full/Wan2.2-VACE-Fun-A14B_tensor_parallel_all.py:69
↓ 2 callersFunctionget_local_rank
()
DiffSynth-Studio/examples/wanvideo/model_training/validate_full/Wan2.1-VACE-14B_tensor_parallel_all_reverse.py:69
↓ 2 callersFunctionget_local_rank
()
DiffSynth-Studio/examples/wanvideo/model_training/validate_full/Wan2.1-VACE-1.3B_tensor_parallel.py:70
↓ 2 callersFunctionget_local_rank
()
DiffSynth-Studio/examples/wanvideo/model_training/validate_full/Wan2.1-VACE-14B_tensor_parallel.py:70
↓ 2 callersFunctionget_local_rank
()
DiffSynth-Studio/examples/wanvideo/model_training/validate_full/Wan2.1-VACE-1.3B_tensor_parallel_all.py:69
↓ 2 callersFunctionget_local_rank
()
DiffSynth-Studio/examples/wanvideo/model_training/validate_full/Wan2.2-VACE-Fun-A14B_tensor_parallel.py:72
↓ 2 callersFunctionget_local_rank
()
DiffSynth-Studio/examples/wanvideo/model_inference/Wan2.1-VACE-1.3B_tensor_parallel_v2.py:64
↓ 2 callersFunctionget_local_rank
()
DiffSynth-Studio/examples/wanvideo/model_inference/Wan2.1-VACE-14B_tensor_parallel.py:63
↓ 2 callersFunctionget_local_rank
()
DiffSynth-Studio/examples/wanvideo/model_inference/Wan2.2-VACE-Fun-A14B_tensor_parallel.py:63
↓ 2 callersFunctionget_norm_layer
Get the normalization layer. Args: norm_layer (str): The type of normalization layer. Returns: norm_layer (nn.Module):
DiffSynth-Studio/diffsynth/models/step1x_connector.py:246
↓ 2 callersMethodget_num_image_tokens
(self, image_grid_thw)
DiffSynth-Studio/diffsynth/models/nexus_gen_ar_model.py:738
↓ 2 callersMethodget_position_ids
Generates position ids for the input embeddings grid. modified from the qwen2_vl mrope.
DiffSynth-Studio/diffsynth/models/nexus_gen_projector.py:327
↓ 2 callersMethodget_target_embeddings
(self, images, messages, processor, model, num_img_tokens=81)
DiffSynth-Studio/diffsynth/models/nexus_gen.py:116
↓ 2 callersMethodget_tensor
(self, name)
DiffSynth-Studio/diffsynth/core/vram/disk_map.py:21
↓ 2 callersFunctionhash_state_dict_keys
(state_dict, with_shape=True)
DiffSynth-Studio/diffsynth/core/loader/file.py:59
↓ 2 callersMethodinit_state
Initialize an inference state.
VideoCus-Factory/sam2/sam2_video_predictor.py:40
↓ 2 callersMethodinit_weight
(self, conv)
DiffSynth-Studio/diffsynth/models/wan_video_vae.py:176
↓ 2 callersMethodinject_motion
(self, x, rope_embs, mask_input, motion_latents, drop_motion_frames=True, add_last_motion=2)
DiffSynth-Studio/diffsynth/models/wan_video_dit_s2v.py:448
↓ 2 callersFunctioninteract_with_ipadapter
(hidden_states, q, ip_k, ip_v, scale=1.0)
DiffSynth-Studio/diffsynth/models/flux_dit.py:6
↓ 2 callersFunctionload_ann_png
Load a PNG file as a mask and its palette.
VideoCus-Factory/tools/vos_inference.py:20
↓ 2 callersFunctionload_state_dict_from_bin
(file_path, torch_dtype=None, device="cpu")
DiffSynth-Studio/diffsynth/core/loader/file.py:27
↓ 2 callersFunctionmake_2tuple
(x)
Video-Depth-Anything/video_depth_anything/dinov2_layers/patch_embed.py:17
↓ 2 callersFunctionmask_to_rle_pytorch
Encodes masks to an uncompressed RLE, in the format expected by pycoco tools.
VideoCus-Factory/sam2/utils/amg.py:109
↓ 2 callersMethodoffload
(self)
DiffSynth-Studio/diffsynth/core/vram/layers.py:71
↓ 2 callersMethodonload
(self)
DiffSynth-Studio/diffsynth/core/vram/layers.py:76
↓ 2 callersMethodparam_name
(self, name)
DiffSynth-Studio/diffsynth/core/vram/layers.py:81
↓ 2 callersMethodparse_vram_config
(self, fp8=False, offload=False, device="cpu")
DiffSynth-Studio/diffsynth/diffusion/training_module.py:87
↓ 2 callersMethodpatchify
(self, x: torch.Tensor)
DiffSynth-Studio/diffsynth/models/wan_video_dit_s2v.py:424
↓ 2 callersMethodpatchify
(self, hidden_states)
DiffSynth-Studio/diffsynth/models/flux_controlnet.py:99
← previousnext →201–300 of 1,933, ranked by callers