MCPcopy Create free account

hub / github.com/ali-vilab/TeaCache / functions

Functions1,040 in github.com/ali-vilab/TeaCache

↓ 1 callersFunctionrescale_zero_terminal_snr
Rescales betas to have zero terminal SNR Based on https://arxiv.org/pdf/2305.08891.pdf (Algorithm 1) Args: betas (`torch.Tensor`):
videosys/schedulers/scheduling_dpm_cogvideox.py:88
↓ 1 callersFunctionrescale_zero_terminal_snr
Rescales betas to have zero terminal SNR Based on https://arxiv.org/pdf/2305.08891.pdf (Algorithm 1) Args: betas (`torch.Tensor`):
videosys/schedulers/scheduling_ddim_cogvideox.py:87
↓ 1 callersMethodreshape_for_broadcast
(self, freqs_cis: torch.Tensor, x: torch.Tensor)
videosys/models/modules/attentions.py:542
↓ 1 callersFunctionresize_gt_video
(gt_video, gen_video)
eval/teacache/common_metrics/batch_eval.py:41
↓ 1 callersFunctionresize_scale
(clip, target_size, interpolation_mode)
videosys/pipelines/open_sora/data_process.py:592
↓ 1 callersFunctionresize_video
(video, target_height, target_width)
eval/teacache/common_metrics/eval.py:45
↓ 1 callersFunctionresize_video
(video, target_height, target_width)
eval/teacache/common_metrics/batch_eval.py:33
↓ 1 callersFunctionretrieve_timesteps
Calls the scheduler's `set_timesteps` method and retrieves timesteps from the scheduler after the call. Handles custom timesteps. Any kwargs
videosys/pipelines/cogvideox/pipeline_cogvideox.py:781
↓ 1 callersFunctionretrieve_timesteps
Calls the scheduler's `set_timesteps` method and retrieves timesteps from the scheduler after the call. Handles custom timesteps. Any kwargs
videosys/pipelines/open_sora_plan/pipeline_open_sora_plan.py:1197
↓ 1 callersMethodreverse
(self, x, t, h, w)
videosys/models/transformers/open_sora_plan_v120_transformer_3d.py:779
↓ 1 callersMethodreverse
(self, output)
videosys/models/autoencoders/autoencoder_kl_open_sora_plan_v110.py:1231
↓ 1 callersMethodreverse
(self, output)
videosys/models/autoencoders/autoencoder_kl_open_sora_plan.py:1228
↓ 1 callersMethodrotate_half
(x)
videosys/models/transformers/open_sora_plan_v120_transformer_3d.py:85
↓ 1 callersMethodrotate_half
(x)
videosys/models/transformers/open_sora_plan_v110_transformer_3d.py:156
↓ 1 callersMethodrotate_half
(x)
videosys/models/transformers/open_sora_plan_v110_transformer_3d.py:219
↓ 1 callersMethodrotate_half
(x)
videosys/models/transformers/open_sora_plan_transformer_3d.py:169
↓ 1 callersMethodrotate_half
(x)
videosys/models/transformers/open_sora_plan_transformer_3d.py:232
↓ 1 callersMethodsave_skip_output
(self, timestep, block_idx, ff_output, is_temporal=False)
videosys/core/pab_mgr.py:141
↓ 1 callersMethodsave_video
(self, video, output_path)
videosys/core/engine.py:119
↓ 1 callersMethodset_attn_processor
r""" Sets the attention processor to use to compute attention. Parameters: processor (`dict` of `AttentionProcessor` or o
videosys/models/transformers/vchitect_transformer_3d.py:407
↓ 1 callersMethodset_chunk_feed_forward
(self, chunk_size: Optional[int], dim: int = 0)
videosys/models/transformers/vchitect_transformer_3d.py:109
↓ 1 callersMethodset_cross_last
(self, last_out: torch.Tensor)
videosys/models/transformers/latte_transformer_3d.py:351
↓ 1 callersMethodset_cross_last
(self, last_out: torch.Tensor)
videosys/models/transformers/open_sora_plan_v110_transformer_3d.py:1899
↓ 1 callersMethodset_cross_last
(self, last_out: torch.Tensor)
videosys/models/transformers/open_sora_plan_transformer_3d.py:1909
↓ 1 callersMethodset_last_out
(self, last_out: torch.Tensor)
videosys/models/transformers/open_sora_plan_v110_transformer_3d.py:1529
↓ 1 callersMethodset_last_out
(self, last_out: torch.Tensor)
videosys/models/transformers/open_sora_plan_transformer_3d.py:1539
↓ 1 callersMethodset_processor
r""" Set the attention processor to use. Args: processor (`AttnProcessor`): The attention processor to us
videosys/models/modules/attentions.py:432
↓ 1 callersMethodset_result
(self, result: Result[T])
videosys/core/mp_utils.py:67
↓ 1 callersMethodset_spatial_last
(self, last_out: torch.Tensor)
videosys/models/transformers/latte_transformer_3d.py:354
↓ 1 callersMethodset_spatial_last
(self, last_out: torch.Tensor)
videosys/models/transformers/open_sora_plan_v110_transformer_3d.py:1902
↓ 1 callersMethodset_spatial_last
(self, last_out: torch.Tensor)
videosys/models/transformers/open_sora_plan_transformer_3d.py:1912
↓ 1 callersMethodshutdown
(self)
videosys/core/engine.py:122
↓ 1 callersMethodspatial_attn
( self, attn, hidden_states, encoder_hidden_states_query_proj, encoder
videosys/models/modules/attentions.py:563
↓ 1 callersFunctionsplit_from_second_dim
(x, batch_size, parallel_group)
videosys/core/comm.py:409
↓ 1 callersFunctionsplit_prompt
(prompt_text)
videosys/pipelines/open_sora/pipeline_open_sora.py:769
↓ 1 callersMethodt_mask_select
(self, x_mask, x, masked_x, T, S)
videosys/models/transformers/open_sora_transformer_3d.py:64
↓ 1 callersFunctionteacache_forward
Args: x: (B, C, T, H, W) tensor of spatial-temp inputs timesteps: (B, ) tensor of timesteps crossattn_emb: (B, N, D) tens
TeaCache4Cosmos/teacache_sample_video_i2v.py:31
↓ 1 callersMethodtemporal_attention
( self, attn, hidden_states, residual, batch_size, batchsize,
videosys/models/modules/attentions.py:601
↓ 1 callersFunctiontensor_to_video
(x)
videosys/models/autoencoders/autoencoder_kl_open_sora_plan_v110.py:32
↓ 1 callersFunctiontensor_to_video
(x)
videosys/models/autoencoders/autoencoder_kl_open_sora_plan.py:32
↓ 1 callersMethodterminate_worker
(self)
videosys/core/mp_utils.py:261
↓ 1 callersMethodtext_preprocessing
(self, text, use_text_preprocessing: bool = True)
videosys/pipelines/open_sora/pipeline_open_sora.py:417
↓ 1 callersMethodtiled_decode
(self, x)
videosys/models/autoencoders/autoencoder_kl_open_sora_plan_v110.py:672
↓ 1 callersMethodtiled_decode
(self, x)
videosys/models/autoencoders/autoencoder_kl_open_sora_plan_v120.py:942
↓ 1 callersMethodtiled_decode
r""" Decode a batch of images using a tiled decoder. Args: z (`torch.Tensor`): Input batch of latent vectors.
videosys/models/autoencoders/autoencoder_kl_cogvideox.py:1162
↓ 1 callersMethodtiled_decode
(self, x)
videosys/models/autoencoders/autoencoder_kl_open_sora_plan.py:672
↓ 1 callersMethodtiled_encode
(self, x)
videosys/models/autoencoders/autoencoder_kl_open_sora_plan_v110.py:648
↓ 1 callersMethodtiled_encode
(self, x)
videosys/models/autoencoders/autoencoder_kl_open_sora_plan_v120.py:918
↓ 1 callersMethodtiled_encode
(self, x)
videosys/models/autoencoders/autoencoder_kl_open_sora_plan.py:648
↓ 1 callersFunctionto_2tuple
(x)
videosys/models/transformers/open_sora_plan_v120_transformer_3d.py:1458
↓ 1 callersFunctionto_tensor
Convert tensor data type from uint8 to float, divide value by 255.0 and permute the dimensions of clip tensor Args: clip (torch.t
videosys/pipelines/open_sora/data_process.py:646
↓ 1 callersMethodtoken_drop
Drops labels to enable classifier-free guidance.
videosys/models/modules/embeddings.py:210
↓ 1 callersMethodtorch_impl
(self, q, k, v, mask, B, N, C)
videosys/models/modules/attentions.py:155
↓ 1 callersMethodvae_to_diff_mask
(self, attention_mask, use_image_num)
videosys/models/transformers/open_sora_plan_v110_transformer_3d.py:2396
FunctionLatteT2V_D64_XL_122
(**kwargs)
videosys/models/transformers/open_sora_plan_v110_transformer_3d.py:2809
FunctionLatteT2V_D64_XL_122
(**kwargs)
videosys/models/transformers/open_sora_plan_transformer_3d.py:2804
FunctionLatteT2V_XL_122
(**kwargs)
videosys/models/transformers/open_sora_plan_v110_transformer_3d.py:2795
FunctionLatteT2V_XL_122
(**kwargs)
videosys/models/transformers/open_sora_plan_transformer_3d.py:2790
FunctionOpenSoraT2V_B_122
(**kwargs)
videosys/models/transformers/open_sora_plan_v120_transformer_3d.py:2129
FunctionOpenSoraT2V_L_122
(**kwargs)
videosys/models/transformers/open_sora_plan_v120_transformer_3d.py:2143
FunctionOpenSoraT2V_ROPE_L_122
(**kwargs)
videosys/models/transformers/open_sora_plan_v120_transformer_3d.py:2157
FunctionOpenSoraT2V_S_122
(**kwargs)
videosys/models/transformers/open_sora_plan_v120_transformer_3d.py:2115
Method__call__
In diffusers, it is a convention to call the pipeline object. But in VideoSys, we will use the generate method for better prompt.
videosys/core/pipeline.py:25
Method__call__
Args: clip (torch.tensor): Video clip to be cropped. Size is (T, C, H, W) Returns: torch.tensor: scale resize
videosys/pipelines/open_sora/data_process.py:620
Method__call__
Args: clip (torch.tensor, dtype=torch.uint8): Size is (T, C, H, W) Return: clip (torch.tensor, dtype=torch.fl
videosys/pipelines/open_sora/data_process.py:671
Method__call__
(self, clip)
videosys/pipelines/open_sora/data_process.py:691
Method__call__
( self, attn: Attention, hidden_states: torch.FloatTensor, encoder_hidden_stat
videosys/models/modules/attentions.py:698
Method__call__
(self, b, t, h, w, device)
videosys/models/transformers/open_sora_plan_v120_transformer_3d.py:47
Method__call__
( self, attn: Attention, hidden_states: torch.FloatTensor, encoder_hidden_stat
videosys/models/transformers/open_sora_plan_v120_transformer_3d.py:855
Method__call__
( self, attn: Attention, hidden_states: torch.Tensor, encoder_hidden_states: t
videosys/models/transformers/cogvideox_transformer_3d.py:88
Method__call__
(self, b, h, w, device)
videosys/models/transformers/open_sora_plan_v110_transformer_3d.py:262
Method__call__
(self, b, l, device)
videosys/models/transformers/open_sora_plan_v110_transformer_3d.py:277
Method__call__
( self, attn: Attention, hidden_states: torch.FloatTensor, encoder_hidden_stat
videosys/models/transformers/open_sora_plan_v110_transformer_3d.py:1156
Method__call__
(self, b, h, w, device)
videosys/models/transformers/open_sora_plan_transformer_3d.py:275
Method__call__
(self, b, l, device)
videosys/models/transformers/open_sora_plan_transformer_3d.py:290
Method__call__
( self, attn: Attention, hidden_states: torch.FloatTensor, encoder_hidden_stat
videosys/models/transformers/open_sora_plan_transformer_3d.py:1169
Method__del__
(self)
videosys/core/engine.py:127
Method__init__
(self)
videosys/core/mp_utils.py:94
Method__init__
(self, workers: List["ProcessWorkerWrapper"], result_handler: ResultHandler)
videosys/core/mp_utils.py:114
Method__init__
(self, result_handler: ResultHandler, worker_factory: Callable[[], Any])
videosys/core/mp_utils.py:225
Method__init__
(self)
videosys/core/pipeline.py:11
Method__init__
(self, dp_size, cp_size, sp_size)
videosys/core/parallel_mgr.py:10
Method__init__
( self, cross_broadcast: bool = False, cross_threshold: list = None, cross_ran
videosys/core/pab_mgr.py:7
Method__init__
(self, config: PABConfig)
videosys/core/pab_mgr.py:44
Method__init__
(self, config)
videosys/core/engine.py:18
Method__init__
Construct a layernorm module in the T5 style. No bias and no subtraction of mean.
videosys/core/shardformer/t5/modeling.py:6
Method__init__
( self, spatial_broadcast: bool = True, spatial_threshold: list = [100, 800],
videosys/pipelines/latte/pipeline_latte.py:36
Method__init__
( self, config: LatteConfig, tokenizer: Optional[T5Tokenizer] = None, text_enc
videosys/pipelines/latte/pipeline_latte.py:192
Method__init__
( self, spatial_broadcast: bool = True, spatial_threshold: list = [100, 850],
videosys/pipelines/cogvideox/pipeline_cogvideox.py:35
Method__init__
( self, config: CogVideoXConfig, tokenizer: Optional[T5Tokenizer] = None, text
videosys/pipelines/cogvideox/pipeline_cogvideox.py:125
Method__init__
( self, size, interpolation_mode="bilinear", )
videosys/pipelines/open_sora/data_process.py:606
Method__init__
(self)
videosys/pipelines/open_sora/data_process.py:668
Method__init__
(self, size)
videosys/pipelines/open_sora/data_process.py:685
Method__init__
( self, spatial_broadcast: bool = True, spatial_threshold: list = [450, 930],
videosys/pipelines/open_sora/pipeline_open_sora.py:33
Method__init__
( self, config: OpenSoraConfig, text_encoder: Optional[T5EncoderModel] = None,
videosys/pipelines/open_sora/pipeline_open_sora.py:194
Method__init__
( self, spatial_broadcast: bool = True, spatial_threshold: list = [100, 850],
videosys/pipelines/open_sora_plan/pipeline_open_sora_plan.py:42
Method__init__
( self, spatial_broadcast: bool = True, spatial_threshold: list = [100, 850],
videosys/pipelines/open_sora_plan/pipeline_open_sora_plan.py:104
Method__init__
( self, config: OpenSoraPlanConfig, tokenizer: Optional[T5Tokenizer] = None, t
videosys/pipelines/open_sora_plan/pipeline_open_sora_plan.py:257
Method__init__
( self, spatial_broadcast: bool = True, spatial_threshold: list = [100, 800],
videosys/pipelines/vchitect/pipeline_vchitect.py:33
Method__init__
( self, config: VchitectConfig, text_encoder: Optional[CLIPTextModelWithProjection] =
videosys/pipelines/vchitect/pipeline_vchitect.py:174
← previousnext →401–500 of 1,040, ranked by callers