MCPcopy Create free account

hub / github.com/caiyuanhao1998/Open-OmniVCus / functions

Functions1,933 in github.com/caiyuanhao1998/Open-OmniVCus

↓ 2 callersMethodpre_calculate_audio_pose
(pipe: WanVideoPipeline, input_audio=None, audio_sample_rate=16000, s2v_pose_video=None, num_frames=81, height
DiffSynth-Studio/diffsynth/pipelines/wan_video.py:879
↓ 2 callersMethodprocess_audio
(self, pipe: WanVideoPipeline, input_audio, audio_sample_rate, num_frames, fps=16, audio_embeds=None, return_a
DiffSynth-Studio/diffsynth/pipelines/wan_video.py:815
↓ 2 callersMethodprocess_entity_masks
(self, hidden_states, prompt_emb, entity_prompt_emb, entity_masks, text_ids, image_ids, repeat_dim)
DiffSynth-Studio/diffsynth/models/flux_dit.py:358
↓ 2 callersMethodprocess_pose_cond
(self, pipe: WanVideoPipeline, s2v_pose_video, num_frames, height, width, tiled, tile_size, tile_stride, s2v_p
DiffSynth-Studio/diffsynth/pipelines/wan_video.py:840
↓ 2 callersMethodpropagate_in_video
Propagate the input points across frames to track in the entire video.
VideoCus-Factory/sam2/sam2_video_predictor.py:658
↓ 2 callersFunctionread_prompt_txt
(path: str)
DiffSynth-Studio/examples/wanvideo/model_training/validate_full/Wan2.1-VACE-14B_tensor_parallel_all.py:76
↓ 2 callersFunctionread_prompt_txt
(path: str)
DiffSynth-Studio/examples/wanvideo/model_training/validate_full/Wan2.2-VACE-Fun-A14B_tensor_parallel_all.py:76
↓ 2 callersFunctionread_prompt_txt
(path: str)
DiffSynth-Studio/examples/wanvideo/model_training/validate_full/Wan2.1-VACE-14B_tensor_parallel_all_reverse.py:76
↓ 2 callersFunctionread_prompt_txt
(path: str)
DiffSynth-Studio/examples/wanvideo/model_training/validate_full/Wan2.1-VACE-1.3B_tensor_parallel_all.py:76
↓ 2 callersFunctionread_video_local
Read a local video using imageio. Returns: frames: list of (H, W, 3) uint8 RGB frames
VideoCus-Factory/process_data_track.py:34
↓ 2 callersFunctionremove_small_regions
Removes small disconnected regions and holes in a mask. Returns the mask and an indicator of if the mask has been modified.
VideoCus-Factory/sam2/utils/amg.py:269
↓ 2 callersFunctionrepeat_kv
This is the equivalent of torch.repeat_interleave(x, dim=1, repeats=n_rep). The hidden states go from (batch, num_key_value_heads, seqlen, he
DiffSynth-Studio/diffsynth/models/nexus_gen_projector.py:93
↓ 2 callersMethodreshape_batch_dim_to_heads
(self, tensor)
Video-Depth-Anything/video_depth_anything/motion_module/attention.py:106
↓ 2 callersFunctionrle_to_mask
Compute a binary mask from an uncompressed RLE.
VideoCus-Factory/sam2/utils/amg.py:140
↓ 2 callersFunctionrope_apply
(x, freqs, num_heads)
DiffSynth-Studio/diffsynth/utils/xfuser/xdit_context_parallel.py:42
↓ 2 callersFunctionrotate_half
Rotates half the hidden dims of the input.
DiffSynth-Studio/diffsynth/models/nexus_gen_projector.py:8
↓ 2 callersFunctionrotate_half
(x)
DiffSynth-Studio/diffsynth/models/longcat_video_dit.py:48
↓ 2 callersMethodrun
(self, model_fn, sliding_window_size, sliding_window_stride, computation_device, computation_dtype, model_kwar
DiffSynth-Studio/diffsynth/pipelines/wan_video.py:1091
↓ 2 callersFunctionsafe_makedirs
Create directory if it does not exist.
VideoCus-Factory/process_data_track.py:53
↓ 2 callersFunctionsave_ann_png
Save a mask as a PNG file with the given palette.
VideoCus-Factory/tools/vos_inference.py:28
↓ 2 callersMethodsave_model
(self, accelerator: Accelerator, model: torch.nn.Module, file_name)
DiffSynth-Studio/diffsynth/diffusion/logger.py:35
↓ 2 callersMethodset_dtype_and_device
( self, offload_dtype: torch.dtype = None, offload_device: Union[str, torch.device] =
DiffSynth-Studio/diffsynth/core/vram/layers.py:38
↓ 2 callersFunctionspeech_to_video
( prompt, input_image, audio_path, negative_prompt="", num_clip=None, audio_sample_rat
DiffSynth-Studio/examples/wanvideo/model_inference/Wan2.2-S2V-14B_multi_clips.py:9
↓ 2 callersFunctionspeech_to_video
( prompt, input_image, audio_path, negative_prompt="", num_clip=None, audio_sample_rat
DiffSynth-Studio/examples/wanvideo/model_inference_low_vram/Wan2.2-S2V-14B_multi_clips.py:9
↓ 2 callersFunctionsplit_list
Split a list into N contiguous chunks and return the K-th chunk (1-indexed).
VideoCus-Factory/process_data_track.py:17
↓ 2 callersMethodstate_dict_converter
()
DiffSynth-Studio/diffsynth/models/wan_video_vae.py:1251
↓ 2 callersMethodtiled_forward
(self, forward_fn, model_input, tile_size, tile_stride, tile_batch_size=1, tile_device="cpu", tile_dtype=torch
DiffSynth-Studio/diffsynth/models/flux_vae.py:83
↓ 2 callersFunctiontorch_sdpa
(q: torch.Tensor, k: torch.Tensor, v: torch.Tensor, q_pattern="b n s d", k_pattern="b n s d", v_pattern="b n s
DiffSynth-Studio/diffsynth/core/attention/attention.py:66
↓ 2 callersMethodtrack_step
( self, frame_idx, is_init_cond_frame, current_vision_feats, current_v
VideoCus-Factory/sam2/modeling/sam2_base.py:704
↓ 2 callersMethodtraining_weight
(self, timestep)
DiffSynth-Studio/diffsynth/diffusion/flow_match.py:176
↓ 2 callersFunctionuncrop_boxes_xyxy
(boxes: torch.Tensor, crop_box: List[int])
VideoCus-Factory/sam2/utils/amg.py:239
↓ 2 callersFunctionwhitespace_clean
(text)
DiffSynth-Studio/diffsynth/models/wan_video_text_encoder.py:266
↓ 1 callersFunctionDINOv2
(model_name)
Video-Depth-Anything/video_depth_anything/dinov2.py:398
↓ 1 callersFunctionFeedForward
(dim, mult=4)
DiffSynth-Studio/diffsynth/models/flux_infiniteyou.py:7
↓ 1 callersMethod__getattr__
(self, name)
DiffSynth-Studio/diffsynth/core/vram/layers.py:200
↓ 1 callersMethod__init__
( self, seperate_cfg: bool = False, take_over: bool = False, input_params: tup
DiffSynth-Studio/diffsynth/diffusion/base_pipeline.py:13
↓ 1 callersMethod__init__
(self, *, dim, dim_head=64, heads=8)
DiffSynth-Studio/diffsynth/models/flux_infiniteyou.py:30
↓ 1 callersMethod__init__
(self, encoders=())
DiffSynth-Studio/diffsynth/models/flux_value_control.py:6
↓ 1 callersMethod__init__
(self, dim: int = 3072)
DiffSynth-Studio/diffsynth/models/qwen_image_controlnet.py:8
↓ 1 callersMethod__init__
( self, vace_layers=(0, 2, 4, 6, 8, 10, 12, 14, 16, 18, 20, 22, 24, 26, 28), vace_in_d
DiffSynth-Studio/diffsynth/models/wan_video_vace.py:28
↓ 1 callersMethod__init__
(self, image_processor=None, tokenizer=None, chat_template=None, **kwargs)
DiffSynth-Studio/diffsynth/models/nexus_gen_ar_model.py:970
↓ 1 callersMethod__init__
(self, tasks: List[InferTask])
DiffSynth-Studio/examples/wanvideo/model_training/validate_full/Wan2.1-VACE-14B_tensor_parallel_all.py:46
↓ 1 callersMethod__init__
(self, tasks: List[InferTask])
DiffSynth-Studio/examples/wanvideo/model_training/validate_full/Wan2.2-VACE-Fun-A14B_tensor_parallel_all.py:46
↓ 1 callersMethod__init__
(self, tasks: List[InferTask])
DiffSynth-Studio/examples/wanvideo/model_training/validate_full/Wan2.1-VACE-14B_tensor_parallel_all_reverse.py:46
↓ 1 callersMethod__init__
(self, tasks: List[InferTask])
DiffSynth-Studio/examples/wanvideo/model_training/validate_full/Wan2.1-VACE-1.3B_tensor_parallel.py:47
↓ 1 callersMethod__init__
(self, tasks: List[InferTask])
DiffSynth-Studio/examples/wanvideo/model_training/validate_full/Wan2.1-VACE-14B_tensor_parallel.py:47
↓ 1 callersMethod__init__
(self, tasks: List[InferTask])
DiffSynth-Studio/examples/wanvideo/model_training/validate_full/Wan2.1-VACE-1.3B_tensor_parallel_all.py:46
↓ 1 callersMethod__init__
(self, tasks: List[InferTask])
DiffSynth-Studio/examples/wanvideo/model_training/validate_full/Wan2.2-VACE-Fun-A14B_tensor_parallel.py:49
↓ 1 callersMethod__init__
(self, tasks: List[InferTask])
DiffSynth-Studio/examples/wanvideo/model_inference/Wan2.1-VACE-1.3B_tensor_parallel_v2.py:46
↓ 1 callersMethod__init__
(self, tasks)
DiffSynth-Studio/examples/wanvideo/model_inference/Wan2.1-VACE-1.3B_tensor_parallel.py:30
↓ 1 callersMethod__init__
(self, tasks: List[InferTask])
DiffSynth-Studio/examples/wanvideo/model_inference/Wan2.1-VACE-14B_tensor_parallel.py:45
↓ 1 callersMethod__init__
(self, tasks: List[InferTask])
DiffSynth-Studio/examples/wanvideo/model_inference/Wan2.2-VACE-Fun-A14B_tensor_parallel.py:45
↓ 1 callersMethod__init__
( self, in_channels, features=256, use_bn=False, out_channels=[256
Video-Depth-Anything/video_depth_anything/dpt.py:48
↓ 1 callersMethod__init__
Init. Args: features (int): number of features
Video-Depth-Anything/video_depth_anything/util/blocks.py:40
↓ 1 callersMethod__init__
( self, in_features: int, hidden_features: Optional[int] = None, out_features:
Video-Depth-Anything/video_depth_anything/dinov2_layers/swiglu_ffn.py:14
↓ 1 callersMethod__init__
( self, d_model: int, pos_enc_at_input: bool, layer: nn.Module, num_la
VideoCus-Factory/sam2/modeling/memory_attention.py:103
↓ 1 callersMethod__init__
( self, num_pos_feats, temperature: int = 10000, normalize: bool = True,
VideoCus-Factory/sam2/modeling/position_encoding.py:22
↓ 1 callersMethod__init__
Initialize the neck :param trunk: the backbone :param position_encoding: the positional encoding to use :param d_model: the di
VideoCus-Factory/sam2/modeling/backbones/image_encoder.py:52
↓ 1 callersMethod__rshift__
(self, pipe)
DiffSynth-Studio/diffsynth/core/data/operators.py:15
↓ 1 callersMethod_build_sam_heads
Build SAM-style prompt encoder and mask decoder.
VideoCus-Factory/sam2/modeling/sam2_base.py:201
↓ 1 callersMethod_calculate_shift_qwen_image
(image_seq_len, base_seq_len=256, max_seq_len=8192, base_shift=0.5, max_shift=0.9)
DiffSynth-Studio/diffsynth/diffusion/flow_match.py:42
↓ 1 callersMethod_clean
(self, text)
DiffSynth-Studio/diffsynth/models/wan_video_text_encoder.py:323
↓ 1 callersFunction_clip
(pretrained=False, pretrained_name=None, model_cls=CLIP, return_transforms=False
DiffSynth-Studio/diffsynth/models/wan_video_image_encoder.py:738
↓ 1 callersMethod_compute_condition_freqs
(self, frame, height, width)
DiffSynth-Studio/diffsynth/models/qwen_image_dit.py:324
↓ 1 callersMethod_compute_video_freqs
(self, frame, height, width, idx=0)
DiffSynth-Studio/diffsynth/models/qwen_image_dit.py:305
↓ 1 callersMethod_create_multi_lora_forward
(self, module, loras)
DiffSynth-Studio/diffsynth/models/longcat_video_dit.py:719
↓ 1 callersMethod_detect_face
(self, id_image_cv2)
DiffSynth-Studio/diffsynth/pipelines/flux_image.py:811
↓ 1 callersMethod_dynamic_frequency_update
dynamic RoPE layers should recompute `inv_freq` in the following situations: 1 - growing beyond the cached sequence length (allow sca
DiffSynth-Studio/diffsynth/models/nexus_gen_projector.py:49
↓ 1 callersMethod_dynamic_multimask_via_stability
When outputting a single mask, if the stability score from the current single-mask output (based on output token 0) falls below a thr
VideoCus-Factory/sam2/modeling/sam/mask_decoder.py:259
↓ 1 callersMethod_embed_boxes
Embeds box prompts.
VideoCus-Factory/sam2/modeling/sam/prompt_encoder.py:123
↓ 1 callersMethod_embed_masks
Embeds mask inputs.
VideoCus-Factory/sam2/modeling/sam/prompt_encoder.py:134
↓ 1 callersMethod_embed_points
Embeds point prompts.
VideoCus-Factory/sam2/modeling/sam/prompt_encoder.py:79
↓ 1 callersFunction_find_backbone_module
(obj: Any)
DiffSynth-Studio/examples/wanvideo/model_training/validate_full/Wan2.1-VACE-14B_tensor_parallel_all.py:180
↓ 1 callersFunction_find_backbone_module
(obj: Any)
DiffSynth-Studio/examples/wanvideo/model_training/validate_full/Wan2.1-VACE-14B_tensor_parallel_all_reverse.py:205
↓ 1 callersFunction_find_backbone_module
(obj: Any)
DiffSynth-Studio/examples/wanvideo/model_training/validate_full/Wan2.1-VACE-1.3B_tensor_parallel.py:109
↓ 1 callersFunction_find_backbone_module
(obj: Any)
DiffSynth-Studio/examples/wanvideo/model_training/validate_full/Wan2.1-VACE-14B_tensor_parallel.py:108
↓ 1 callersFunction_find_backbone_module
(obj: Any)
DiffSynth-Studio/examples/wanvideo/model_training/validate_full/Wan2.1-VACE-1.3B_tensor_parallel_all.py:187
↓ 1 callersFunction_find_backbone_module
尝试在 pipe 里找到“主干网络”,不同版本可能叫: - dit / transformer / unet / model / diffusion_model / backbone 等 找到就返回,否则报错。
DiffSynth-Studio/examples/wanvideo/model_inference/Wan2.1-VACE-1.3B_tensor_parallel_v2.py:103
↓ 1 callersMethod_forward_ca
(self, tgt, memory, query_pos, pos, num_k_exclude_rope=0)
VideoCus-Factory/sam2/modeling/memory_attention.py:66
↓ 1 callersMethod_forward_sa
(self, tgt, query_pos)
VideoCus-Factory/sam2/modeling/memory_attention.py:58
↓ 1 callersMethod_forward_silu_gating
(self, x1, x3)
DiffSynth-Studio/diffsynth/models/z_image_dit.py:65
↓ 1 callersMethod_generate_masks
(self, image: np.ndarray)
VideoCus-Factory/sam2/automatic_mask_generator.py:224
↓ 1 callersMethod_get_batch_size
Gets the batch size of the output given the batch size of the input prompts.
VideoCus-Factory/sam2/modeling/sam/prompt_encoder.py:139
↓ 1 callersMethod_get_device
(self)
VideoCus-Factory/sam2/modeling/sam/prompt_encoder.py:157
↓ 1 callersMethod_get_empty_mask_ptr
Get a dummy object pointer based on an empty mask on the current frame.
VideoCus-Factory/sam2/sam2_video_predictor.py:551
↓ 1 callersMethod_get_image_nums_and_video_nums
Get the number of images and videos for each sample to calculate the separation length of the sample tensor. These parameters are not
DiffSynth-Studio/diffsynth/models/nexus_gen_ar_model.py:809
↓ 1 callersMethod_get_intermediate_layers_chunked
(self, x, n=1)
Video-Depth-Anything/video_depth_anything/dinov2.py:283
↓ 1 callersMethod_get_intermediate_layers_not_chunked
(self, x, n=1)
Video-Depth-Anything/video_depth_anything/dinov2.py:271
↓ 1 callersMethod_get_module_by_name
(self, module_name)
DiffSynth-Studio/diffsynth/models/longcat_video_dit.py:736
↓ 1 callersMethod_get_pos_embed
(self, hw: Tuple[int, int])
VideoCus-Factory/sam2/modeling/backbones/hieradet.py:273
↓ 1 callersFunction_get_projections
(attn: "Flux2Attention", hidden_states, encoder_hidden_states=None)
DiffSynth-Studio/diffsynth/models/flux2_dit.py:297
↓ 1 callersFunction_get_qkv_projections
(attn: "Flux2Attention", hidden_states, encoder_hidden_states=None)
DiffSynth-Studio/diffsynth/models/flux2_dit.py:321
↓ 1 callersMethod_get_stability_scores
Compute stability scores of the mask logits based on the IoU between upper and lower thresholds.
VideoCus-Factory/sam2/modeling/sam/mask_decoder.py:247
↓ 1 callersFunction_make_scratch
(in_shape, out_shape, groups=1, expand=False)
Video-Depth-Anything/video_depth_anything/util/blocks.py:4
↓ 1 callersMethod_memory_efficient_attention_split
(self, query, key, value, attention_mask)
Video-Depth-Anything/video_depth_anything/motion_module/attention.py:275
↓ 1 callersFunction_modules_to_parallelize
(pipe: Any)
DiffSynth-Studio/examples/wanvideo/model_training/validate_full/Wan2.2-VACE-Fun-A14B_tensor_parallel_all.py:187
↓ 1 callersFunction_modules_to_parallelize
Wan2.2 A14B 常见:vace/vace2(以及可能的 dit/dit2) 都做 TP。
DiffSynth-Studio/examples/wanvideo/model_training/validate_full/Wan2.2-VACE-Fun-A14B_tensor_parallel.py:106
↓ 1 callersFunction_modules_to_parallelize
WanVideoPipeline 里真正会在 denoise loop 里跑的大块通常是: - dit / dit2 - vace / vace2 有就都做 TP(比只对一个 backbone 更合理)
DiffSynth-Studio/examples/wanvideo/model_inference/Wan2.2-VACE-Fun-A14B_tensor_parallel.py:100
↓ 1 callersMethod_norm
Apply the RMSNorm normalization to the input tensor. Args: x (torch.Tensor): The input tensor. Returns:
DiffSynth-Studio/diffsynth/models/step1x_connector.py:216
↓ 1 callersMethod_norm
(self, x)
DiffSynth-Studio/diffsynth/models/longcat_video_dit.py:21
← previousnext →301–400 of 1,933, ranked by callers