Method__init__(
self, dim, num_heads=8, qkv_bias=False, qk_scale=None, attn_drop=0.0, proj_drop=0.0, ln_in_attn=Fals
inference/model/vae/vae_module.py:262
Method__init__(self, video_size=224, video_length=16, patch_size=16, patch_length=1, in_chans=3, embed_dim=768)
inference/model/vae/vae_module.py:356
Method__init__(
self,
video_size=256,
video_length=16,
patch_size=8,
patch_length=4,
inference/model/vae/vae_module.py:413
Method__init__(
self,
video_size=256,
video_length=16,
patch_size=8,
patch_length=4,
inference/model/vae/vae_module.py:573
Method__init__(self, in_features: int, out_features: int, bias=False, dtype=torch.bfloat16, device=None)
inference/model/dit/dit_module.py:433
Method__init__(self, in_features: int, out_features: int, bias=False, dtype=torch.bfloat16, device=None)
inference/model/dit/dit_module.py:464
Methodforward Forward pass of the PatchEmbed module. Args: x (torch.Tensor): Input tensor of shape (B, C, T, H, W), where
inference/model/vae/vae_module.py:378
Methodforward_dispatcher(self, x, timestep, y, mask, kv_range, inference_params, **kwargs)
inference/model/dit/dit_model.py:501
Methodfull_attention(self, bs: int, meta_args: ModelMetaArgs, q: torch.Tensor, k: torch.Tensor, v: torch.Tensor, i: int)
inference/model/dit/dit_module.py:1068
Methodget_attn_and_xattn_with_comm_overlap Get Q, K, V with communication overlap. Input: get_q: Callable, function to get q, shape [b, sq, hn, hd] get_
inference/infra/parallelism/context_parallel.py:457