Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/aim-uofa/Framer
/ types & classes
Types & classes
53 in github.com/aim-uofa/Framer
⨍
Functions
206
◇
Types & classes
53
↓ 8 callers
Class
TransformerTemporalModel
A Transformer model for video-like data. Parameters: num_attention_heads (`int`, *optional*, defaults to 16): The number of heads to
models_diffusers/transformer_temporal.py:44
↓ 7 callers
Class
AttnProcessor
r""" Default processor for performing attention-related computations.
models_diffusers/attention_processor.py:694
↓ 6 callers
Class
Attention
r""" A cross attention layer. Parameters: query_dim (`int`): The number of channels in the query. cross_attention
models_diffusers/attention_processor.py:38
↓ 4 callers
Class
AttnProcessor2_0
r""" Processor for implementing scaled dot-product attention (enabled by default if you're using PyTorch 2.0).
models_diffusers/attention_processor.py:1178
↓ 4 callers
Class
FeedForward
r""" A feed-forward layer. Parameters: dim (`int`): The number of channels in the input. dim_out (`int`, *optional*): The num
models_diffusers/attention.py:494
↓ 3 callers
Class
AttnAddedKVProcessor
r""" Processor for performing attention-related computations with extra learnable key and value matrices for the text encoder.
models_diffusers/attention_processor.py:873
↓ 3 callers
Class
TransformerSpatioTemporalModel
A Transformer model for video-like data. Parameters: num_attention_heads (`int`, *optional*, defaults to 16): The number of heads to
models_diffusers/transformer_temporal.py:205
↓ 2 callers
Class
BasicTransformerBlock
r""" A basic Transformer block. Parameters: dim (`int`): The number of channels in the input and output. num_attention_heads
models_diffusers/attention.py:97
↓ 2 callers
Class
TransformerTemporalModelOutput
The output of [`TransformerTemporalModel`]. Args: sample (`torch.FloatTensor` of shape `(batch_size x num_frames, num_channels, heig
models_diffusers/transformer_temporal.py:32
↓ 2 callers
Class
UNetMidBlockSpatioTemporal
models_diffusers/unet_3d_blocks.py:1872
↓ 2 callers
Class
XFormersAttnProcessor
r""" Processor for implementing memory efficient attention using xFormers. Args: attention_op (`Callable`, *optional*, defaults to `N
models_diffusers/attention_processor.py:1081
↓ 1 callers
Class
ControlNetConditioningEmbeddingSVD
Quoting from https://arxiv.org/abs/2302.05543: "Stable Diffusion uses a pre-processing method similar to VQ-GAN [11] to convert the entire da
models_diffusers/controlnet_svd.py:63
↓ 1 callers
Class
ControlNetOutput
The output of [`ControlNetModel`]. Args: down_block_res_samples (`tuple[torch.Tensor]`): A tuple of downsample activatio
models_diffusers/controlnet_svd.py:44
↓ 1 callers
Class
CrossAttnDownBlock3D
models_diffusers/unet_3d_blocks.py:442
↓ 1 callers
Class
CrossAttnDownBlockMotion
models_diffusers/unet_3d_blocks.py:1059
↓ 1 callers
Class
CrossAttnDownBlockSpatioTemporal
models_diffusers/unet_3d_blocks.py:2072
↓ 1 callers
Class
CrossAttnUpBlock3D
models_diffusers/unet_3d_blocks.py:673
↓ 1 callers
Class
CrossAttnUpBlockMotion
models_diffusers/unet_3d_blocks.py:1247
↓ 1 callers
Class
CrossAttnUpBlockSpatioTemporal
models_diffusers/unet_3d_blocks.py:2290
↓ 1 callers
Class
CustomDiffusionXFormersAttnProcessor
r""" Processor for implementing memory efficient attention using xFormers for the Custom Diffusion method. Args: train_kv (`bool`, defaul
models_diffusers/attention_processor.py:1266
↓ 1 callers
Class
DownBlock3D
models_diffusers/unet_3d_blocks.py:584
↓ 1 callers
Class
DownBlockMotion
models_diffusers/unet_3d_blocks.py:933
↓ 1 callers
Class
DownBlockSpatioTemporal
models_diffusers/unet_3d_blocks.py:1982
↓ 1 callers
Class
Drag
app.py:353
↓ 1 callers
Class
GatedSelfAttentionDense
r""" A gated self-attention dense layer that combines visual features and object features. Parameters: query_dim (`int`): The number
models_diffusers/attention.py:55
↓ 1 callers
Class
LoRAXFormersAttnProcessor
r""" Processor for implementing the LoRA attention mechanism with memory efficient attention using xFormers. Args: hidden_size (`int`
models_diffusers/attention_processor.py:1852
↓ 1 callers
Class
SlicedAttnAddedKVProcessor
r""" Processor for implementing sliced attention with extra learnable key and value matrices for the text encoder. Args: slice_size (
models_diffusers/attention_processor.py:1583
↓ 1 callers
Class
SlicedAttnProcessor
r""" Processor for implementing sliced attention. Args: slice_size (`int`, *optional*): The number of steps to compute at
models_diffusers/attention_processor.py:1496
↓ 1 callers
Class
SpatialNorm
Spatially conditioned normalization as defined in https://arxiv.org/abs/2209.09002. Args: f_channels (`int`): The number
models_diffusers/attention_processor.py:1675
↓ 1 callers
Class
StableVideoDiffusionInterpControlPipelineOutput
r""" Output class for zero-shot text-to-video pipeline. Args: frames (`[List[PIL.Image.Image]`, `np.ndarray`]): List of d
pipelines/pipeline_stable_video_diffusion_interp_control.py:69
↓ 1 callers
Class
TemporalBasicTransformerBlock
r""" A basic Transformer block for video like data. Parameters: dim (`int`): The number of channels in the input and output.
models_diffusers/attention.py:364
↓ 1 callers
Class
UNetSpatioTemporalConditionOutput
The output of [`UNetSpatioTemporalConditionModel`]. Args: sample (`torch.FloatTensor` of shape `(batch_size, num_frames, num_channel
models_diffusers/unet_spatio_temporal_condition.py:61
↓ 1 callers
Class
UniqueLogger
gradio_demo/utils_drag.py:84
↓ 1 callers
Class
UpBlock3D
models_diffusers/unet_3d_blocks.py:830
↓ 1 callers
Class
UpBlockMotion
models_diffusers/unet_3d_blocks.py:1443
↓ 1 callers
Class
UpBlockSpatioTemporal
models_diffusers/unet_3d_blocks.py:2201
↓ 1 callers
Class
XFormersAttnAddedKVProcessor
r""" Processor for implementing memory efficient attention using xFormers. Args: attention_op (`Callable`, *optional*, defaults to `N
models_diffusers/attention_processor.py:1010
Class
AttnAddedKVProcessor2_0
r""" Processor for performing scaled dot-product attention (enabled by default if you're using PyTorch 2.0), with extra learnable key and valu
models_diffusers/attention_processor.py:937
Class
ControlNetSVDModel
r""" A conditional Spatio-Temporal UNet model that takes a noisy video frames, conditional state, and a timestep and returns a sample shaped o
models_diffusers/controlnet_svd.py:120
Class
CustomDiffusionAttnProcessor
r""" Processor for implementing attention for the Custom Diffusion method. Args: train_kv (`bool`, defaults to `True`): W
models_diffusers/attention_processor.py:769
Class
CustomDiffusionAttnProcessor2_0
r""" Processor for implementing attention for the Custom Diffusion method using PyTorch 2.0’s memory-efficient scaled dot-product attention.
models_diffusers/attention_processor.py:1382
Class
IPAdapterAttnProcessor
r""" Attention processor for IP-Adapater. Args: hidden_size (`int`): The hidden size of the attention layer. cros
models_diffusers/attention_processor.py:1990
Class
IPAdapterAttnProcessor2_0
r""" Attention processor for IP-Adapater for PyTorch 2.0. Args: hidden_size (`int`): The hidden size of the attention lay
models_diffusers/attention_processor.py:2100
Class
Kandi3AttnProcessor
r""" Default kandinsky3 proccesor for performing attention-related computations.
models_diffusers/attention_processor.py:2236
Class
LoRAAttnAddedKVProcessor
r""" Processor for implementing the LoRA attention mechanism with extra learnable key and value matrices for the text encoder. Args:
models_diffusers/attention_processor.py:1931
Class
LoRAAttnProcessor
r""" Processor for implementing the LoRA attention mechanism. Args: hidden_size (`int`, *optional*): The hidden size of t
models_diffusers/attention_processor.py:1705
Class
LoRAAttnProcessor2_0
r""" Processor for implementing the LoRA attention mechanism using PyTorch 2.0's memory-efficient scaled dot-product attention. Args:
models_diffusers/attention_processor.py:1777
Class
MidBlockTemporalDecoder
models_diffusers/unet_3d_blocks.py:1759
Class
StableVideoDiffusionInterpControlPipeline
r""" Pipeline to generate video from an input image using Stable Video Diffusion. This model inherits from [`DiffusionPipeline`]. Check the s
pipelines/pipeline_stable_video_diffusion_interp_control.py:82
Class
UNetMidBlock3DCrossAttn
models_diffusers/unet_3d_blocks.py:308
Class
UNetMidBlockCrossAttnMotion
models_diffusers/unet_3d_blocks.py:1586
Class
UNetSpatioTemporalConditionModel
r""" A conditional Spatio-Temporal UNet model that takes a noisy video frames, conditional state, and a timestep and returns a sample shaped o
models_diffusers/unet_spatio_temporal_condition.py:74
Class
UpBlockTemporalDecoder
models_diffusers/unet_3d_blocks.py:1822