MCPcopy Create free account

hub / github.com/AlayaLab/AlayaRenderer / functions

Functions1,613 in github.com/AlayaLab/AlayaRenderer

↓ 1 callersFunctionflash_attention_3
(q: torch.Tensor, k: torch.Tensor, v: torch.Tensor, q_pattern="b n s d", k_pattern="b n s d", v_pattern="b n s
game_editing/diffsynth/core/attention/attention.py:74
↓ 1 callersMethodformat_text_input
(self, prompts: List[str], system_message: str = None)
game_editing/diffsynth/pipelines/flux2_image.py:163
↓ 1 callersMethodforward
(self, sample, tiled=False, tile_size=64, tile_stride=32, **kwargs)
game_editing/diffsynth/models/flux_vae.py:344
↓ 1 callersMethodforward
(self, sample, tiled=False, tile_size=64, tile_stride=32, **kwargs)
game_editing/diffsynth/models/flux_vae.py:412
↓ 1 callersMethodforward
( self, x, vace_context, context, t_mod, freqs, use_gradient_checkpointing: bool = False,
game_editing/diffsynth/models/wan_video_vace.py:53
↓ 1 callersMethodforward
(self, image, torch_dtype=torch.bfloat16, device=get_device_type())
game_editing/diffsynth/models/siglip2_image_encoder.py:52
↓ 1 callersMethodforward_layers
( self, x, cap_feats, control_context, control_context_item_seqlens,
game_editing/diffsynth/models/z_image_controlnet.py:55
↓ 1 callersMethodforward_refiner
( self, dit, x, cap_feats, control_context, kwargs, t=
game_editing/diffsynth/models/z_image_controlnet.py:90
↓ 1 callersMethodforward_sampling
(self, video_fhw, txt_seq_lens, device)
game_editing/diffsynth/models/qwen_image_dit.py:168
↓ 1 callersMethodforward_with_2d
(self, x: torch.Tensor, skip_time_conv: bool = False)
game_editing/diffsynth/models/ltx2_video_vae.py:301
↓ 1 callersMethodforward_with_3d
(self, x: torch.Tensor, skip_time_conv: bool = False)
game_editing/diffsynth/models/ltx2_video_vae.py:271
↓ 1 callersMethodforward_with_kv_cache
game_editing/diffsynth/models/longcat_video_dit.py:223
↓ 1 callersMethodfp8_linear
( self, input: torch.Tensor, weight: torch.Tensor, bias: torch.Tensor = None,
game_editing/diffsynth/core/vram/layers.py:321
↓ 1 callersMethodfreeze_except
(self, model_names)
game_editing/diffsynth/diffusion/base_pipeline.py:195
↓ 1 callersMethodfrom_diffusers
(self, state_dict)
game_editing/diffsynth/models/flux_controlnet.py:269
↓ 1 callersMethodfrom_diffusers
(self, state_dict)
game_editing/diffsynth/models/flux_ipadapter.py:99
↓ 1 callersMethodfrom_duration
( batch: int, duration: float, channels: int = 8, mel_bins: int = 16,
game_editing/diffsynth/models/ltx2_common.py:122
↓ 1 callersMethodfrom_pixel_shape
( shape: VideoPixelShape, latent_channels: int = 128, scale_factors: SpatioTemporalSca
game_editing/diffsynth/models/ltx2_common.py:69
↓ 1 callersMethodfrom_torch_shape
(shape: torch.Size)
game_editing/diffsynth/models/ltx2_common.py:56
↓ 1 callersMethodfrom_video_pixel_shape
( shape: VideoPixelShape, channels: int = 8, mel_bins: int = 16, sample_rate:
game_editing/diffsynth/models/ltx2_common.py:141
↓ 1 callersMethodfuse_lora_to_base_model
(self, model: torch.nn.Module, state_dict_lora, alpha=1.0)
game_editing/diffsynth/utils/lora/flux.py:81
↓ 1 callersFunctiongenerate_camera_coordinates
( direction: Literal["Left", "Right", "Up", "Down", "LeftUp", "LeftDown", "RightUp", "RightDown", "In", "O
game_editing/diffsynth/models/wan_video_camera_controller.py:184
↓ 1 callersFunctiongenerate_freqs
( indices: torch.Tensor, indices_grid: torch.Tensor, max_pos: list[int], use_middle_indices_grid: bool )
game_editing/diffsynth/models/ltx2_dit.py:372
↓ 1 callersFunctionget_1d_rotary_pos_embed
Precompute the frequency tensor for complex exponentials (cis) with given dimensions. This function calculates a frequency tensor with compl
game_editing/diffsynth/models/flux2_dit.py:174
↓ 1 callersFunctionget_activation
Helper function to get activation function from string. Args: act_fn (str): Name of activation function. Returns: nn.Module:
game_editing/diffsynth/models/flux2_vae.py:31
↓ 1 callersMethodget_audio_embed_bucket_fps
(self, audio_embed, fps=16, batch_frames=81, m=0)
game_editing/diffsynth/models/wav2vec.py:147
↓ 1 callersMethodget_audio_feats_per_inference
(self, input_audio, sample_rate, processor, fps=16, batch_frames=80, m=0, dtype=torch.float32, device='cpu')
game_editing/diffsynth/models/wav2vec.py:186
↓ 1 callersMethodget_default_image_grid_thw
(self,)
game_editing/diffsynth/models/nexus_gen_ar_model.py:734
↓ 1 callersFunctionget_device_id
Get current device id based on device type.
game_editing/diffsynth/core/device/npu_compatible_device.py:42
↓ 1 callersMethodget_editing_msg
(self, instruction)
game_editing/diffsynth/models/nexus_gen.py:90
↓ 1 callersMethodget_editing_text_ids
(self, latents, target_embed_height, target_embed_width, ref_embed_height, ref_embed_width)
game_editing/diffsynth/pipelines/flux_image.py:648
↓ 1 callersFunctionget_fractional_positions
(indices_grid: torch.Tensor, max_pos: list[int])
game_editing/diffsynth/models/ltx2_dit.py:360
↓ 1 callersMethodget_generation_msg
(self, instruction)
game_editing/diffsynth/models/nexus_gen.py:96
↓ 1 callersMethodget_height_width
(self, image)
game_editing/diffsynth/core/data/operators.py:86
↓ 1 callersMethodget_mistral_3_small_prompt_embeds
( self, text_encoder, tokenizer, prompt: Union[str, List[str]], dtype:
game_editing/diffsynth/pipelines/flux2_image.py:180
↓ 1 callersMethodget_module
(self, model, name)
game_editing/diffsynth/diffusion/base_pipeline.py:185
↓ 1 callersMethodget_motion
(self, img)
game_editing/diffsynth/models/wan_video_animate_adapter.py:608
↓ 1 callersMethodget_name_dict
(self, lora_state_dict)
game_editing/diffsynth/utils/lora/general.py:10
↓ 1 callersMethodget_name_dict
(self, lora_state_dict)
game_editing/diffsynth/models/flux_lora_patcher.py:11
↓ 1 callersFunctionget_norm_layer
Get the normalization layer. Args: norm_layer (str): The type of normalization layer. Returns: norm_layer (nn.Module):
game_editing/diffsynth/models/wan_video_animate_adapter.py:175
↓ 1 callersMethodget_num_frames
(self, reader)
game_editing/diffsynth/core/data/operators.py:116
↓ 1 callersMethodget_num_frames
(self, path)
game_editing/diffsynth/core/data/operators.py:153
↓ 1 callersFunctionget_pixel_coords
Map latent-space `[start, end)` coordinates to their pixel-space equivalents by scaling each axis (frame/time, height, width) with the corres
game_editing/diffsynth/models/ltx2_common.py:342
↓ 1 callersMethodget_processor
r""" Get the attention processor in use. Args: return_deprecated_lora (`bool`, *optional*, defaults to `False`):
game_editing/diffsynth/models/flux2_vae.py:937
↓ 1 callersMethodget_prompt_emb
(self, pipe: QwenImagePipeline, prompt)
game_editing/diffsynth/pipelines/qwen_image.py:420
↓ 1 callersMethodget_qwen3_prompt_embeds
( self, text_encoder: ZImageTextEncoder, tokenizer: AutoTokenizer, prompt: Uni
game_editing/diffsynth/pipelines/flux2_image.py:311
↓ 1 callersFunctionget_relative_pose
Copied from https://github.com/hehao13/CameraCtrl/blob/main/inference.py
game_editing/diffsynth/models/wan_video_camera_controller.py:92
↓ 1 callersFunctionget_sample_indices
(original_fps, total_frames, target_fps, num_sample, fixed_start=None)
game_editing/diffsynth/models/wav2vec.py:7
↓ 1 callersMethodget_shape
(self)
game_editing/diffsynth/core/vram/disk_map.py:9
↓ 1 callersMethodget_slice
(self, name)
game_editing/diffsynth/core/vram/disk_map.py:24
↓ 1 callersFunctionget_timestep_embedding
This matches the implementation in Denoising Diffusion Probabilistic Models: Create sinusoidal timestep embeddings. Args timesteps (t
game_editing/diffsynth/models/ltx2_dit.py:13
↓ 1 callersFunctionget_timestep_embedding
This matches the implementation in Denoising Diffusion Probabilistic Models: Create sinusoidal timestep embeddings. Args timesteps (
game_editing/diffsynth/models/flux2_dit.py:12
↓ 1 callersFunctionget_timestep_embedding
( timesteps: torch.Tensor, embedding_dim: int, flip_sin_to_cos: bool = False, downscale_freq_s
game_editing/diffsynth/models/general_modules.py:4
↓ 1 callersFunctionhash_model_file
(path, with_shape=True)
game_editing/diffsynth/core/loader/file.py:126
↓ 1 callersFunctionhash_state_dict_keys
(state_dict, with_shape=True)
game_editing/diffsynth/models/flux_controlnet.py:7
↓ 1 callersMethodinit
(self)
game_editing/diffsynth/models/wan_video_motion_controller.py:24
↓ 1 callersMethodinit_weights
(self)
game_editing/diffsynth/models/wan_video_image_encoder.py:582
↓ 1 callersMethodinit_weights
(self)
game_editing/diffsynth/models/qwen_image_controlnet.py:23
↓ 1 callersFunctioninit_weights_on_device
(device = torch.device("meta"), include_buffers :bool = False)
game_editing/diffsynth/models/flux_controlnet.py:13
↓ 1 callersMethodinitialize
(self, device)
game_editing/diffsynth/diffusion/loss.py:48
↓ 1 callersFunctioninitialize_attention_priority
()
game_editing/diffsynth/core/attention/attention.py:30
↓ 1 callersFunctioninitialize_usp
(device_type)
game_editing/diffsynth/utils/xfuser/xdit_context_parallel.py:14
↓ 1 callersFunctioninject_gbuffer_unit
Insert WanVideoUnit_GBufferEncoder into the pipeline's unit list, after ImageEmbedderFused and before FunControl.
game_editing/examples/wanvideo/model_inference/gbuffer_utils.py:78
↓ 1 callersMethodinteract_with_ipadapter
(self, hidden_states, q, ip_k, ip_v, scale=1.0)
game_editing/diffsynth/models/flux_lora_encoder.py:29
↓ 1 callersMethodinteract_with_ipadapter
(self, hidden_states, q, ip_k, ip_v, scale=1.0)
game_editing/diffsynth/models/sd_text_encoder.py:30
↓ 1 callersFunctioninterleaved_freqs_cis
(freqs: torch.Tensor, pad_size: int)
game_editing/diffsynth/models/ltx2_dit.py:413
↓ 1 callersMethodio_scale
(self, model_output, tile_size)
game_editing/diffsynth/models/flux_vae.py:57
↓ 1 callersFunctionis_torch_npu_available
()
game_editing/diffsynth/core/device/npu_compatible_device.py:6
↓ 1 callersMethodlinear_forward
(self, x, weight, bias)
game_editing/diffsynth/core/vram/layers.py:410
↓ 1 callersFunctionlinear_interpolation
features: shape=[1, T, 512] input_fps: fps for audio, f_a output_fps: fps for video, f_m output_len: video length
game_editing/diffsynth/models/wav2vec.py:30
↓ 1 callersFunctionload_caption_from_csv
Look up the prompt for a given clip_dir from metadata_with_captions.csv.
game_editing/examples/wanvideo/model_inference/inference_gbuffer_caption.py:35
↓ 1 callersFunctionload_keys_dict
(file_path)
game_editing/diffsynth/core/loader/file.py:74
↓ 1 callersFunctionload_keys_dict_from_bin
(file_path)
game_editing/diffsynth/core/loader/file.py:104
↓ 1 callersFunctionload_keys_dict_from_safetensors
(file_path)
game_editing/diffsynth/core/loader/file.py:86
↓ 1 callersMethodload_metadata
(self, metadata_path)
game_editing/diffsynth/core/data/unified_dataset.py:68
↓ 1 callersFunctionload_model
(model_class, path, config=None, torch_dtype=torch.bfloat16, device="cpu", state_dict_converter=None, use_disk
game_editing/diffsynth/core/loader/model.py:8
↓ 1 callersMethodload_model_file
(self, config, path, vram_config, vram_limit=None, state_dict=None)
game_editing/diffsynth/models/model_loader.py:32
↓ 1 callersMethodload_processor
(self, path)
game_editing/diffsynth/models/nexus_gen.py:72
↓ 1 callersFunctionload_state_dict_from_safetensors
(file_path, torch_dtype=None, device="cpu")
game_editing/diffsynth/core/loader/file.py:26
↓ 1 callersMethodlora_embedding
(self, pipe, lora_encoder_inputs)
game_editing/diffsynth/pipelines/flux_image.py:873
↓ 1 callersMethodlora_forward
(self, x, out)
game_editing/diffsynth/core/vram/layers.py:417
↓ 1 callersFunctionlow_version_attention
(query, key, value, attn_bias=None)
game_editing/diffsynth/models/flux_lora_encoder.py:5
↓ 1 callersFunctionlow_version_attention
(query, key, value, attn_bias=None)
game_editing/diffsynth/models/sd_text_encoder.py:6
↓ 1 callersFunctionltx2_preprocess
(image: np.array, crf: float = 33)
game_editing/diffsynth/utils/data/media_io_ltx2.py:140
↓ 1 callersFunctionmake_kernel
(k)
game_editing/diffsynth/models/wan_video_animate_adapter.py:349
↓ 1 callersFunctionmake_linear_nd
( dims: int, in_channels: int, out_channels: int, bias: bool = True, )
game_editing/diffsynth/models/ltx2_video_vae.py:477
↓ 1 callersMethodmapping_lora_state_dict
(self, state_dict)
game_editing/diffsynth/diffusion/training_module.py:43
↓ 1 callersMethodmask
( self, perturbation_type: PerturbationType, block: int, device, dtype: torch.dtype )
game_editing/diffsynth/models/ltx2_dit.py:202
↓ 1 callersMethodmask
(self, height, width, border_width)
game_editing/diffsynth/models/flux_vae.py:10
↓ 1 callersFunctionmerge_lora_weight
(tensors_A, tensors_B)
game_editing/diffsynth/utils/lora/merge.py:5
↓ 1 callersFunctionmerge_video_audio
Merge the video and audio into a new video, with the duration set to the shorter of the two, and overwrite the original video file. Para
game_editing/diffsynth/utils/data/__init__.py:153
↓ 1 callersFunctionmodel_fn_flux_image
( dit: FluxDiT, controlnet=None, step1x_connector=None, latents=None, timestep=None, p
game_editing/diffsynth/pipelines/flux_image.py:1004
↓ 1 callersFunctionmodel_fn_longcat_video
( dit: LongCatVideoTransformer3DModel, latents: torch.Tensor = None, timestep: torch.Tensor = None
game_editing/diffsynth/pipelines/wan_video.py:1396
↓ 1 callersFunctionmodel_fn_wans2v
( dit, latents, timestep, context, audio_embeds, motion_latents, s2v_pose_latents,
game_editing/diffsynth/pipelines/wan_video.py:1426
↓ 1 callersFunctionmodel_fn_z_image_turbo
( dit: ZImageDiT, controlnet: ZImageControlNet = None, latents=None, timestep=None, prompt
game_editing/diffsynth/pipelines/z_image.py:563
↓ 1 callersMethodmodel_forward
( self, model: QwenImageTextEncoder, input_ids: Optional[torch.LongTensor] = None,
game_editing/diffsynth/models/step1x_text_encoder.py:27
↓ 1 callersMethodneed_to_enable_vram_management
(self, vram_config)
game_editing/diffsynth/models/model_loader.py:19
↓ 1 callersMethodnorm_encoder_hidden_states
r""" Normalize the encoder hidden states. Requires `self.norm_cross` to be specified when constructing the `Attention` class.
game_editing/diffsynth/models/flux2_vae.py:1139
↓ 1 callersMethodnormalize
(self, x: torch.Tensor)
game_editing/diffsynth/models/ltx2_video_vae.py:566
↓ 1 callersMethodoffload_to_disk
(self, model: torch.nn.Module)
game_editing/diffsynth/core/vram/layers.py:140
← previousnext →401–500 of 1,613, ranked by callers