MCPcopy Create free account

hub / github.com/caiyuanhao1998/Open-OmniVCus / functions

Functions1,933 in github.com/caiyuanhao1998/Open-OmniVCus

↓ 1 callersMethod_norm
Apply the RMSNorm normalization to the input tensor. Args: x (torch.Tensor): The input tensor. Returns:
DiffSynth-Studio/diffsynth/models/wan_video_animate_adapter.py:145
↓ 1 callersMethod_prepare_memory_conditioned_features
Fuse the current frame's visual feature map with previous memory.
VideoCus-Factory/sam2/modeling/sam2_base.py:493
↓ 1 callersMethod_process_batch
( self, points: np.ndarray, im_size: Tuple[int, ...], crop_box: List[int],
VideoCus-Factory/sam2/automatic_mask_generator.py:294
↓ 1 callersMethod_process_crop
( self, image: np.ndarray, crop_box: List[int], crop_layer_idx: int, o
VideoCus-Factory/sam2/automatic_mask_generator.py:251
↓ 1 callersMethod_rank
(self)
DiffSynth-Studio/examples/wanvideo/model_inference/Wan2.1-VACE-1.3B_tensor_parallel.py:80
↓ 1 callersMethod_relative_position_bucket
(self, rel_pos)
DiffSynth-Studio/diffsynth/models/wan_video_text_encoder.py:174
↓ 1 callersMethod_reset_tracking_results
Reset all tracking inputs and results across the videos.
VideoCus-Factory/sam2/sam2_video_predictor.py:784
↓ 1 callersMethod_run_memory_encoder
Run the memory encoder on `high_res_masks`. This is usually after applying non-overlapping constraints to object scores. Since their
VideoCus-Factory/sam2/sam2_video_predictor.py:902
↓ 1 callersMethod_sliced_attention
(self, query, key, value, sequence_length, dim, attention_mask)
Video-Depth-Anything/video_depth_anything/motion_module/attention.py:213
↓ 1 callersMethod_tiled_encode
r"""Encode a batch of images using a tiled encoder. When this option is enabled, the VAE will split the input tensor into tiles to compute en
DiffSynth-Studio/diffsynth/models/flux2_vae.py:2148
↓ 1 callersFunction_tp_plan_for_module
(mod: nn.Module)
DiffSynth-Studio/examples/wanvideo/model_training/validate_full/Wan2.1-VACE-14B_tensor_parallel_all.py:162
↓ 1 callersFunction_tp_plan_for_module
(mod: nn.Module)
DiffSynth-Studio/examples/wanvideo/model_training/validate_full/Wan2.2-VACE-Fun-A14B_tensor_parallel_all.py:169
↓ 1 callersFunction_tp_plan_for_module
(mod: nn.Module)
DiffSynth-Studio/examples/wanvideo/model_training/validate_full/Wan2.1-VACE-14B_tensor_parallel_all_reverse.py:187
↓ 1 callersFunction_tp_plan_for_module
(mod: nn.Module)
DiffSynth-Studio/examples/wanvideo/model_training/validate_full/Wan2.1-VACE-1.3B_tensor_parallel.py:91
↓ 1 callersFunction_tp_plan_for_module
(mod: nn.Module)
DiffSynth-Studio/examples/wanvideo/model_training/validate_full/Wan2.1-VACE-14B_tensor_parallel.py:90
↓ 1 callersFunction_tp_plan_for_module
(mod: nn.Module)
DiffSynth-Studio/examples/wanvideo/model_training/validate_full/Wan2.1-VACE-1.3B_tensor_parallel_all.py:169
↓ 1 callersFunction_tp_plan_for_module
(mod: nn.Module)
DiffSynth-Studio/examples/wanvideo/model_training/validate_full/Wan2.2-VACE-Fun-A14B_tensor_parallel.py:88
↓ 1 callersFunction_tp_plan_for_module
给 parallelize_module 的 plan: - Linear: attention 的 qkv / out / mlp 走 Col/Row 切分 - attention block: 尽量启用 SequenceParallel(对 token 维做 Shard
DiffSynth-Studio/examples/wanvideo/model_inference/Wan2.1-VACE-1.3B_tensor_parallel_v2.py:76
↓ 1 callersFunction_tp_plan_for_module
给 parallelize_module 的 plan: - Linear: attention 的 qkv / out / mlp 走 Col/Row 切分 - 其他不确定 Linear -> Replicate(保守)
DiffSynth-Studio/examples/wanvideo/model_inference/Wan2.1-VACE-14B_tensor_parallel.py:75
↓ 1 callersFunction_tp_plan_for_module
给 parallelize_module 的 plan(通用名字匹配): - qkv: Colwise - out proj: Rowwise - ffn up/gate: Colwise - ffn down: Rowwise
DiffSynth-Studio/examples/wanvideo/model_inference/Wan2.2-VACE-Fun-A14B_tensor_parallel.py:75
↓ 1 callersMethod_use_mask_as_output
Directly turn binary `mask_inputs` into a output mask logits without using SAM. (same input and output shapes as in _forward_sam_head
VideoCus-Factory/sam2/modeling/sam2_base.py:411
↓ 1 callersMethod_use_multimask
Whether to use multimask output in the SAM head.
VideoCus-Factory/sam2/modeling/sam2_base.py:801
↓ 1 callersMethod_world_size
(self)
DiffSynth-Studio/examples/wanvideo/model_inference/Wan2.1-VACE-1.3B_tensor_parallel.py:85
↓ 1 callersFunctionadd_dataset_base_config
(parser: argparse.ArgumentParser)
DiffSynth-Studio/diffsynth/diffusion/parsers.py:4
↓ 1 callersFunctionadd_gradient_config
(parser: argparse.ArgumentParser)
DiffSynth-Studio/diffsynth/diffusion/parsers.py:57
↓ 1 callersFunctionadd_lora_config
(parser: argparse.ArgumentParser)
DiffSynth-Studio/diffsynth/diffusion/parsers.py:48
↓ 1 callersMethodadd_lora_to_model
(self, model, target_modules, lora_rank, lora_alpha=None, upcast_dtype=None)
DiffSynth-Studio/diffsynth/diffusion/training_module.py:29
↓ 1 callersFunctionadd_model_config
(parser: argparse.ArgumentParser)
DiffSynth-Studio/diffsynth/diffusion/parsers.py:25
↓ 1 callersMethodadd_new_mask
Add new mask to a frame.
VideoCus-Factory/sam2/sam2_video_predictor.py:328
↓ 1 callersFunctionadd_output_config
(parser: argparse.ArgumentParser)
DiffSynth-Studio/diffsynth/diffusion/parsers.py:42
↓ 1 callersFunctionadd_residual
(x, brange, residual, residual_scale_factor, scaling_vector=None)
Video-Depth-Anything/video_depth_anything/dinov2_layers/block.py:142
↓ 1 callersMethodadd_to_text_embedding
(self, prompt_emb, text_ids, value_emb)
DiffSynth-Studio/diffsynth/pipelines/flux_image.py:775
↓ 1 callersMethodadd_to_text_embedding
(self, prompt_emb, text_ids, lora_emb)
DiffSynth-Studio/diffsynth/pipelines/flux_image.py:880
↓ 1 callersFunctionadd_training_config
(parser: argparse.ArgumentParser)
DiffSynth-Studio/diffsynth/diffusion/parsers.py:33
↓ 1 callersFunctionadd_video_size_config
(parser: argparse.ArgumentParser)
DiffSynth-Studio/diffsynth/diffusion/parsers.py:18
↓ 1 callersMethodafter_patch_embedding
(self, x: List[torch.Tensor], pose_latents, face_pixel_values)
DiffSynth-Studio/diffsynth/models/wan_video_animate_adapter.py:623
↓ 1 callersMethodalign_trajectory
(self, pipe: BasePipeline, timesteps_teacher, trajectory_teacher, inputs_shared, inputs_posi, inputs_nega, num
DiffSynth-Studio/diffsynth/diffusion/loss.py:63
↓ 1 callersFunctionapply_color_exposure_jitter
( img: Image.Image, rng: random.Random, jitter_prob: float = 0.9, brightness: Tuple[float, flo
VideoCus-Factory/data_augmentation.py:101
↓ 1 callersMethodapply_controlnet_mask_on_image
(self, pipe, image, mask)
DiffSynth-Studio/diffsynth/pipelines/flux_image.py:465
↓ 1 callersMethodapply_controlnet_mask_on_image
(self, pipe, image, mask)
DiffSynth-Studio/diffsynth/pipelines/qwen_image.py:500
↓ 1 callersMethodapply_controlnet_mask_on_latents
(self, pipe, latents, mask)
DiffSynth-Studio/diffsynth/pipelines/flux_image.py:458
↓ 1 callersMethodapply_controlnet_mask_on_latents
(self, pipe, latents, mask)
DiffSynth-Studio/diffsynth/pipelines/qwen_image.py:493
↓ 1 callersFunctionapply_multimodal_rotary_pos_emb
(q, k, cos, sin, mrope_section, unsqueeze_dim=1)
DiffSynth-Studio/diffsynth/models/nexus_gen_projector.py:15
↓ 1 callersMethodapply_rope
(self, xq, xk, freqs_cis)
DiffSynth-Studio/diffsynth/models/flux_dit.py:65
↓ 1 callersMethodapply_rope
(self, xq, xk, freqs_cis)
DiffSynth-Studio/diffsynth/models/flux_dit.py:164
↓ 1 callersMethodapply_rope
(self, xq, xk, freqs_cis)
DiffSynth-Studio/diffsynth/models/flux_dit.py:220
↓ 1 callersFunctionapply_rotary_emb
( xq: torch.Tensor, xk: torch.Tensor, freqs_cis: torch.Tensor, )
Video-Depth-Anything/video_depth_anything/motion_module/attention.py:419
↓ 1 callersFunctionapply_rotary_enc
( xq: torch.Tensor, xk: torch.Tensor, freqs_cis: torch.Tensor, repeat_freqs_k: bool = False, )
VideoCus-Factory/sam2/modeling/position_encoding.py:194
↓ 1 callersFunctionapply_tensor_parallel_to_module
(module_or_pipe: Any)
DiffSynth-Studio/examples/wanvideo/model_training/validate_full/Wan2.1-VACE-14B_tensor_parallel_all.py:202
↓ 1 callersFunctionapply_tensor_parallel_to_module
(module_or_pipe: Any)
DiffSynth-Studio/examples/wanvideo/model_training/validate_full/Wan2.1-VACE-14B_tensor_parallel_all_reverse.py:227
↓ 1 callersFunctionapply_tensor_parallel_to_module
(module_or_pipe: Any)
DiffSynth-Studio/examples/wanvideo/model_training/validate_full/Wan2.1-VACE-1.3B_tensor_parallel.py:131
↓ 1 callersFunctionapply_tensor_parallel_to_module
(module_or_pipe: Any)
DiffSynth-Studio/examples/wanvideo/model_training/validate_full/Wan2.1-VACE-14B_tensor_parallel.py:130
↓ 1 callersFunctionapply_tensor_parallel_to_module
(module_or_pipe: Any)
DiffSynth-Studio/examples/wanvideo/model_training/validate_full/Wan2.1-VACE-1.3B_tensor_parallel_all.py:209
↓ 1 callersFunctionapply_tensor_parallel_to_pipe
(pipe: Any)
DiffSynth-Studio/examples/wanvideo/model_training/validate_full/Wan2.2-VACE-Fun-A14B_tensor_parallel_all.py:206
↓ 1 callersFunctionapply_tensor_parallel_to_pipe
(pipe: Any)
DiffSynth-Studio/examples/wanvideo/model_training/validate_full/Wan2.2-VACE-Fun-A14B_tensor_parallel.py:129
↓ 1 callersFunctionapply_tensor_parallel_to_pipe
对 pipeline 的主干做 tensor parallel。 注意:TP 只需要在每个 rank 初始化完模型后调用一次。
DiffSynth-Studio/examples/wanvideo/model_inference/Wan2.1-VACE-1.3B_tensor_parallel_v2.py:126
↓ 1 callersFunctionapply_tensor_parallel_to_pipe
对 WanVideoPipeline 做 TP: - pipe.dit 一定做 - pipe.dit2 如果存在也做(Wan 在某些模型会在迭代中 switch DiT) - (可选)pipe.vace/vace2 也可以尝试做,但通常先只做 dit 最稳
DiffSynth-Studio/examples/wanvideo/model_inference/Wan2.1-VACE-14B_tensor_parallel.py:129
↓ 1 callersFunctionapply_tensor_parallel_to_pipe
对 pipe 里的核心模块做 TP。 注意:TP 只需要在每个 rank 初始化完模型后调用一次。
DiffSynth-Studio/examples/wanvideo/model_inference/Wan2.2-VACE-Fun-A14B_tensor_parallel.py:128
↓ 1 callersFunctionarea_from_rle
(rle: Dict[str, Any])
VideoCus-Factory/sam2/utils/amg.py:154
↓ 1 callersMethodattention_mask
(self, length)
DiffSynth-Studio/diffsynth/models/flux_lora_encoder.py:148
↓ 1 callersMethodattention_mask
(self, length)
DiffSynth-Studio/diffsynth/models/sd_text_encoder.py:149
↓ 1 callersMethodattention_mask
(self, length)
DiffSynth-Studio/diffsynth/models/flux_text_encoder_clip.py:94
↓ 1 callersFunctionaugment_reference_in_folder
( ref_path: str, mask_name: str = "mask.png", orig_name: str = "caption_frame.png", scale_rang
VideoCus-Factory/data_augmentation.py:140
↓ 1 callersMethodauto_load_model
(self, path, vram_config=None, vram_limit=None, clear_parameters=False)
DiffSynth-Studio/diffsynth/models/model_loader.py:62
↓ 1 callersFunctionbbox_from_binary_mask
(bin_mask: np.ndarray)
VideoCus-Factory/data_augmentation.py:49
↓ 1 callersFunctionbivariate_Gaussian
(kernel_size, sig_x, sig_y, theta, grid=None, isotropic=True)
VideoCus-Factory/track_to_map_local.py:46
↓ 1 callersFunctionbivariate_Gaussian
Generate a bivariate isotropic or anisotropic Gaussian kernel. In the isotropic mode, only `sig_x` is used. `sig_y` and `theta` is ignored. Ar
VideoCus-Factory/track_to_map.py:71
↓ 1 callersMethodblend_with_mask
(self, base, addition, mask)
DiffSynth-Studio/diffsynth/diffusion/base_pipeline.py:205
↓ 1 callersMethodblockwise_forward
(self, image, conditionings: list[torch.Tensor], controlnet_inputs: list[ControlNetInput], progress_id, num_in
DiffSynth-Studio/diffsynth/pipelines/qwen_image.py:215
↓ 1 callersMethodbound_image
(self, image, max_pixels=262640)
DiffSynth-Studio/diffsynth/models/nexus_gen.py:81
↓ 1 callersFunctionbroadcat
(tensors, dim=-1)
DiffSynth-Studio/diffsynth/models/longcat_video_dit.py:29
↓ 1 callersMethodbuild_1d_mask
(self, length, left_bound, right_bound, border_width)
DiffSynth-Studio/diffsynth/pipelines/wan_video.py:1073
↓ 1 callersFunctionbuild_all_layer_point_grids
Generates point grids for all crop layers.
VideoCus-Factory/sam2/utils/amg.py:191
↓ 1 callersMethodbuild_chains
(self, units: list[PipelineUnit])
DiffSynth-Studio/diffsynth/diffusion/base_pipeline.py:333
↓ 1 callersFunctionbuild_copy_plan
Returns list of (src_file, dst_file). We copy files from each dpo_i/<subfolder>/** into base/<subfolder>/** (preserving relative path under s
VideoCus-Factory/copy_label.py:18
↓ 1 callersMethodbuild_edges
(self, units: list[PipelineUnit])
DiffSynth-Studio/diffsynth/diffusion/base_pipeline.py:320
↓ 1 callersMethodbuild_mask
(self, data, is_bound)
DiffSynth-Studio/diffsynth/pipelines/flux_image.py:955
↓ 1 callersMethodbuild_mask
(self, data, is_bound, border_width)
DiffSynth-Studio/diffsynth/pipelines/wan_video.py:1085
↓ 1 callersFunctionbuild_point_grid
Generates a 2D grid of points evenly spaced in [0,1]x[0,1].
VideoCus-Factory/sam2/utils/amg.py:181
↓ 1 callersFunctionbuild_sam2
( config_file, ckpt_path=None, device="cuda", mode="eval", hydra_overrides_extra=[], a
VideoCus-Factory/sam2/build_sam.py:15
↓ 1 callersFunctionbuild_sam2_video_predictor_hf
(model_id, **kwargs)
VideoCus-Factory/sam2/build_sam.py:99
↓ 1 callersFunctionbuild_tasks_from_test_dir
( test_dir: str, out_dir: str, negative_prompt: str, seed: int, num_frames: int, heigh
DiffSynth-Studio/examples/wanvideo/model_training/validate_full/Wan2.1-VACE-14B_tensor_parallel_all.py:99
↓ 1 callersFunctionbuild_tasks_from_test_dir
遍历 test_dir 下一级文件夹,每个子文件夹必须包含: - 唯一 txt: prompt(读取时去掉 "IMG1 ") - 唯一 mp4: reference video - 唯一 png/jpg/jpeg/webp: reference imag
DiffSynth-Studio/examples/wanvideo/model_training/validate_full/Wan2.2-VACE-Fun-A14B_tensor_parallel_all.py:99
↓ 1 callersFunctionbuild_tasks_from_test_dir
( test_dir: str, out_dir: str, negative_prompt: str, seed: int, num_frames: int, heigh
DiffSynth-Studio/examples/wanvideo/model_training/validate_full/Wan2.1-VACE-14B_tensor_parallel_all_reverse.py:99
↓ 1 callersFunctionbuild_tasks_from_test_dir
遍历 test_dir 下一级文件夹,每个子文件夹必须包含: - 唯一 txt: prompt(读取时去掉 "IMG1 ") - 唯一 mp4: reference video - 唯一 png/jpg/jpeg/webp: reference imag
DiffSynth-Studio/examples/wanvideo/model_training/validate_full/Wan2.1-VACE-1.3B_tensor_parallel_all.py:99
↓ 1 callersFunctionbuild_video_tensor
Convert a list of RGB frames to a CoTracker-compatible tensor. Args: frames_np_lst: list of (H, W, 3) uint8 Returns: vid
VideoCus-Factory/process_data_track.py:60
↓ 1 callersMethodcalculate_dimensions
(self, target_area, ratio)
DiffSynth-Studio/diffsynth/pipelines/qwen_image.py:337
↓ 1 callersMethodcalculate_dimensions
(self, target_area, ratio)
DiffSynth-Studio/diffsynth/pipelines/qwen_image.py:537
↓ 1 callersFunctioncanonicalize
(text, keep_punctuation_exact_string=None)
DiffSynth-Studio/diffsynth/models/wan_video_text_encoder.py:272
↓ 1 callersFunctioncap_image
(image_np, processor, model, device)
VideoCus-Factory/process_data_customization.py:127
↓ 1 callersMethodcast_to
(self, module, dtype, device)
DiffSynth-Studio/diffsynth/core/vram/layers.py:177
↓ 1 callersMethodcheck
(self, dit: FluxDiT, hidden_states, conditioning)
DiffSynth-Studio/diffsynth/pipelines/flux_image.py:917
↓ 1 callersMethodcheck
(self, dit: WanModel, x, t_mod)
DiffSynth-Studio/diffsynth/pipelines/wan_video.py:1037
↓ 1 callersMethodcheck_input
(self)
DiffSynth-Studio/diffsynth/core/loader/config.py:27
↓ 1 callersFunctioncheck_mask_size
(mask)
VideoCus-Factory/process_data_customization.py:46
↓ 1 callersMethodclear_parameters
(self, model: torch.nn.Module)
DiffSynth-Studio/diffsynth/models/model_loader.py:107
↓ 1 callersFunctionclip_xlm_roberta_vit_h_14
( pretrained=False, pretrained_name='open-clip-xlm-roberta-large-vit-huge-14', **kwarg
DiffSynth-Studio/diffsynth/models/wan_video_image_encoder.py:822
↓ 1 callersFunctioncoco_encode_rle
(uncompressed_rle: Dict[str, Any])
VideoCus-Factory/sam2/utils/amg.py:296
↓ 1 callersMethodcomputation
(self)
DiffSynth-Studio/diffsynth/core/vram/layers.py:180
↓ 1 callersMethodcomputation
(self)
DiffSynth-Studio/diffsynth/core/vram/layers.py:395
← previousnext →401–500 of 1,933, ranked by callers