MCPcopy Create free account

hub / github.com/UVA-Computer-Vision-Lab/FrameINO / functions

Functions1,469 in github.com/UVA-Computer-Vision-Lab/FrameINO

↓ 416 callersMethodto
(self, device: Union[str, torch.device])
preprocess/SpaTrackV2_code/models/predictor.py:29
↓ 81 callersMethodget
(self)
preprocess/oneformer_code/demo/predictor.py:161
↓ 55 callersMethodhead_to_batch_dim
r""" Reshape the tensor from `[batch_size, seq_len, dim]` to `[batch_size, seq_len, heads, dim // heads]` `heads` is the number of hea
architecture/attention_processor.py:619
↓ 37 callersMethod__init__
(self, num_channels: int, flip_sin_to_cos: bool, downscale_freq_shift: float, scale: int = 1)
architecture/embeddings.py:1366
↓ 35 callersMethodtime
(self)
preprocess/SpaTrackV2_code/models/tracker3D/spatrack_modules/tools.py:184
↓ 33 callersFunctionapply_rotary_emb
Apply rotary embeddings to input tensors using the given frequency tensor. This function applies rotary embeddings to the given query or key
architecture/embeddings.py:1219
↓ 27 callersMethodprepare_attention_mask
r""" Prepare the attention mask for the attention computation. Args: attention_mask (`torch.Tensor`): The
architecture/attention_processor.py:693
↓ 23 callersMethodnorm_encoder_hidden_states
r""" Normalize the encoder hidden states. Requires `self.norm_cross` to be specified when constructing the `Attention` class.
architecture/attention_processor.py:740
↓ 23 callersMethodto
(self, device)
preprocess/oneformer_code/oneformer/utils/misc.py:116
↓ 23 callersMethodupdate
(self, val, n=1)
preprocess/SpaTrackV2_code/models/utils.py:49
↓ 19 callersMethodsample
(self, coords)
preprocess/SpaTrackV2_code/models/blocks.py:342
↓ 17 callersMethodrun
(self)
preprocess/oneformer_code/demo/predictor.py:119
↓ 17 callersMethodwrite
(self)
preprocess/oneformer_code/oneformer/utils/events.py:70
↓ 16 callersMethodencode
(self, text)
preprocess/oneformer_code/oneformer/data/tokenizer.py:189
↓ 15 callersMethodbatch_to_head_dim
r""" Reshape the tensor from `[batch_size, seq_len, dim]` to `[batch_size // heads, seq_len, dim * heads]`. `heads` is the number of h
architecture/attention_processor.py:602
↓ 15 callersMethodencode
r""" Encode a batch of images into latents. Args: x (`torch.Tensor`): Input batch of images. return_dict (`bo
architecture/autoencoder_kl_wan.py:1172
↓ 13 callersMethod__init__
( self, query_dim: int, cross_attention_dim: Optional[int] = None, heads: int
architecture/attention_processor.py:105
↓ 13 callersMethod__init__
( self, in_channels: int, out_channels: int, factor_t, factor_s=1,
architecture/autoencoder_kl_wan.py:91
↓ 12 callersMethoddevice
(self)
preprocess/oneformer_code/oneformer/oneformer_model.py:221
↓ 12 callersFunctionget_1d_rotary_pos_embed
Precompute the frequency tensor for complex exponentials (cis) with given dimensions. This function calculates a frequency tensor with compl
architecture/embeddings.py:1153
↓ 10 callersMethodnorm_xyz
xyz can be (B T N 3) or (B T 3 H W) or (B N 3)
preprocess/SpaTrackV2_code/models/tracker3D/TrackRefiner.py:296
↓ 9 callersMethod__init__
( self, in_features, hidden_features=None, out_features=None, act_laye
preprocess/SpaTrackV2_code/models/tracker3D/co_tracker/utils.py:298
↓ 9 callersMethod__init__
( self, in_features, hidden_features=None, out_features=None, act_laye
preprocess/SpaTrackV2_code/models/tracker3D/delta_utils/blocks.py:45
↓ 9 callersMethod__init__
(self, in_features, out_features, bias=True, act="ReLU", is_folded=True)
preprocess/auxiliary/AutoShot.py:13
↓ 9 callersMethoddecode
(self, tokens)
preprocess/oneformer_code/oneformer/data/tokenizer.py:197
↓ 8 callersMethod__init__
( self, in_features, hidden_features=None, out_features=None, act_laye
preprocess/SpaTrackV2_code/models/blocks.py:57
↓ 8 callersMethodclear_cache
(self)
architecture/autoencoder_kl_wan.py:1135
↓ 8 callersMethoddenorm_xyz
xyz can be (B T N 3) or (B T 3 H W) or (B N 3)
preprocess/SpaTrackV2_code/models/tracker3D/TrackRefiner.py:318
↓ 8 callersMethodget_attention_scores
r""" Compute the attention scores. Args: query (`torch.Tensor`): The query tensor. key (`torch.Tensor`): The
architecture/attention_processor.py:646
↓ 8 callersMethodsave
Args: filepath (str): a string that contains the absolute path, including the file name, where the visualized ima
preprocess/oneformer_code/demo/visualizer.py:314
↓ 7 callersMethod__init__
( self, in_features, hidden_features=None, out_features=None, act_layer=nn.GELU, drop=0.0 )
preprocess/oneformer_code/oneformer/modeling/backbone/swin.py:25
↓ 7 callersFunctionbilinear_sampler
Wrapper for grid_sample, uses pixel coordinates
preprocess/SpaTrackV2_code/models/blocks.py:297
↓ 7 callersFunctionfn
(uv: np.ndarray, xy: np.ndarray, z: np.ndarray, shift: np.ndarray)
preprocess/SpaTrackV2_code/models/tracker3D/spatrack_modules/geometry_numpy.py:84
↓ 7 callersFunctionsample_features5d
r"""Sample spatio-temporal features `sample_features5d(input, coords)` works in the same way as :func:`sample_features4d` but for spatio-temp
preprocess/SpaTrackV2_code/utils/model_utils.py:390
↓ 7 callersMethodset_processor
r""" Set the attention processor to use. Args: processor (`AttnProcessor`): The attention processor to us
architecture/attention_processor.py:522
↓ 7 callersFunctionweighted_mean
(x: torch.Tensor, w: torch.Tensor = None, dim: Union[int, torch.Size] = None, keepdim: bool = False, eps: floa
preprocess/SpaTrackV2_code/models/tracker3D/spatrack_modules/geometry_torch.py:16
↓ 6 callersMethod__init__
(self, in_features, hidden_features=None, out_features=None, act_layer=nn.GELU, drop=0.)
preprocess/oneformer_code/oneformer/modeling/backbone/dinat.py:49
↓ 6 callersMethod_change_color_brightness
Depending on the brightness_factor, gives a lighter or darker color i.e. a color with less or more saturation than the original color
preprocess/oneformer_code/demo/visualizer.py:1270
↓ 6 callersFunctionbalanced_binary_cross_entropy
logits: Tensor of arbitrary shape targets: same shape as logits balance_weight: scaling the loss reduction: 'mean', 'sum', or 'none'
preprocess/SpaTrackV2_code/models/tracker3D/co_tracker/utils.py:653
↓ 6 callersFunctionbivariate_Gaussian
Generate a bivariate isotropic or anisotropic Gaussian kernel. In the isotropic mode, only `sig_x` is used. `sig_y` and `theta` is ignored. Ar
utils/optical_flow_utils.py:197
↓ 6 callersFunctiondepth_to_points_colmap
Unproject a depth map to a point cloud in COLMAP convention. Args: metric_depth: (B, H, W) depth map, meters. intrinsics:
preprocess/SpaTrackV2_code/models/tracker3D/spatrack_modules/utils.py:673
↓ 6 callersFunctionget_3d_rotary_pos_embed
RoPE for video tokens with 3D structure. Args: embed_dim: (`int`): The embedding dimension size, corresponding to hidden_size_he
architecture/embeddings.py:864
↓ 6 callersFunctionposenc
Cat x with a positional encoding of x with scales 2^[min_deg, max_deg-1]. Instead of computing [sin(x), cos(x)], we use the trig identity cos
preprocess/SpaTrackV2_code/models/tracker3D/delta_utils/blocks.py:804
↓ 6 callersMethodtrack_from_cam
This function will generate tracks by camera transform Args: queries: B T N 4 c2w_traj: B T 4 4
preprocess/SpaTrackV2_code/models/tracker3D/TrackRefiner.py:85
↓ 6 callersFunctiontrunc_normal_
r"""Fills the input Tensor with values drawn from a truncated normal distribution. The values are effectively drawn from the normal distributi
preprocess/oneformer_code/oneformer/utils/misc.py:59
↓ 6 callersMethodwith_pos_embed
(self, tensor, pos: Optional[Tensor])
preprocess/oneformer_code/oneformer/modeling/transformer_decoder/transformer.py:265
↓ 5 callersMethod__init__
(self, dim, num_heads=8, qkv_bias=False, qk_scale=None, attn_drop=0., proj_drop=0.)
preprocess/oneformer_code/oneformer/modeling/transformer_decoder/text_transformer.py:33
↓ 5 callersMethod__init__
(self, F=16, L=3, S=2, D=1024, use_many_hot_targets=True, u
preprocess/auxiliary/TransNetV2.py:11
↓ 5 callersFunctionalign
If trunc is None, solve `min sum_i w_i * |a * x_i - y_i|`, otherwise solve `min sum_i min(trunc, w_i * |a * x_i - y_i|)`. w_i must be >=
preprocess/SpaTrackV2_code/models/tracker3D/spatrack_modules/alignment.py:60
↓ 5 callersMethodcam_from_track
This function will generate tracks by camera transform Args: queries: B T N 3 scale_est: 1 1 shi
preprocess/SpaTrackV2_code/models/tracker3D/TrackRefiner.py:132
↓ 5 callersFunctionget_1d_sincos_pos_embed_from_grid
embed_dim: output dimension for each position pos: a list of positions to be encoded: size (M,) out: (M, D)
preprocess/SpaTrackV2_code/utils/embeddings.py:86
↓ 5 callersMethodget_correlation_feat
(self, fmaps, queried_coords, radius=None, padding_mode="border")
preprocess/SpaTrackV2_code/models/tracker3D/co_tracker/cotracker_base.py:156
↓ 4 callersMethod__init__
(self, in_features: int, out_features: int, pos_embed_seq_len=None)
architecture/transformer_wan.py:123
↓ 4 callersMethod__init__
(self, in_channels: int, middle_channels: int, out_channels: int = None, stride: int = 4)
preprocess/SpaTrackV2_code/models/tracker3D/delta_utils/upsample_transformer.py:152
↓ 4 callersMethod__init__
( self, d_model=512, nhead=8, num_encoder_layers=6, num_decoder_layers
preprocess/oneformer_code/oneformer/modeling/transformer_decoder/transformer.py:23
↓ 4 callersMethod__init__
(self, input_dim, hidden_dim, output_dim, num_layers)
preprocess/oneformer_code/oneformer/modeling/transformer_decoder/oneformer_transformer_decoder.py:214
↓ 4 callersMethod__init__
(self, spatial_dim)
preprocess/auxiliary/ICNet.py:9
↓ 4 callersFunction_create_text_labels
Args: classes (list[int] or None): scores (list[float] or None): class_names (list[str] or None): is_crowd (list[
preprocess/oneformer_code/demo/visualizer.py:244
↓ 4 callersFunction_make_fusion_block
(features: int, size: int = None, has_residual: bool = True, groups: int = 1)
preprocess/SpaTrackV2_code/models/vggt4track/heads/dpt_head.py:312
↓ 4 callersMethod_make_layer
(self, dim, stride=1)
preprocess/SpaTrackV2_code/models/tracker3D/co_tracker/utils.py:235
↓ 4 callersMethod_make_layer
(self, dim, stride=1)
preprocess/SpaTrackV2_code/models/tracker3D/delta_utils/blocks.py:202
↓ 4 callersMethodbackward
(ctx, grad_output)
preprocess/oneformer_code/oneformer/modeling/pixel_decoder/ops/functions/ms_deform_attn_func.py:48
↓ 4 callersMethoddraw_line
Args: x_data (list[int]): a list containing x values of all the points being drawn. Length of list should match t
preprocess/oneformer_code/demo/visualizer.py:1099
↓ 4 callersMethoddraw_text
Args: text (str): class label position (tuple): a tuple of the x and y coordinates to place text on image.
preprocess/oneformer_code/demo/visualizer.py:950
↓ 4 callersMethodenable_slicing
r""" Enable sliced VAE decoding. When this option is enabled, the VAE will split the input tensor in slices to compute decoding in sev
architecture/autoencoder_kl_wan.py:1121
↓ 4 callersMethodenable_tiling
r""" Enable tiled VAE decoding. When this option is enabled, the VAE will split the input tensor into tiles to compute decoding and en
architecture/autoencoder_kl_wan.py:1084
↓ 4 callersFunctionget_1d_sincos_pos_embed_from_grid
This function generates 1D positional embeddings from a grid. Args: embed_dim (`int`): The embedding dimension `D` pos (`tor
architecture/embeddings.py:320
↓ 4 callersFunctionget_alibi_slope
(num_heads, device="cpu")
preprocess/SpaTrackV2_code/models/tracker3D/delta_utils/blocks.py:518
↓ 4 callersFunctionget_relative_positions
(seq_len, reverse=False, device="cpu")
preprocess/SpaTrackV2_code/models/tracker3D/delta_utils/blocks.py:512
↓ 4 callersMethodget_track_feat
(self, fmaps, queried_frames, queried_coords, support_radius=0)
preprocess/SpaTrackV2_code/models/tracker3D/co_tracker/cotracker_base.py:139
↓ 4 callersFunctionget_track_points
This function is used to get the points on the grid args: H: the height of the grid. W: the width of the grid. T: the
preprocess/SpaTrackV2_code/models/utils.py:1174
↓ 4 callersFunctioninstance_color
Args: rgb (bool): whether to return RGB colors or BGR colors. maximum (int): either 255 or 1 Returns: ndarray: a vect
preprocess/oneformer_code/demo/visualizer.py:36
↓ 4 callersFunctionmasks_to_boxes
Compute the bounding boxes around the provided masks The masks should be in format [N, H, W] where N is the number of masks, (H, W) are the spatia
preprocess/oneformer_code/oneformer/utils/box_ops.py:106
↓ 4 callersFunctionpose_encoding_to_camera
Args: pose_encoding: A tensor of shape `BxNxC`, containing a batch of `BxN` `C`-dimensional pose encodings.
preprocess/SpaTrackV2_code/models/utils.py:253
↓ 4 callersMethodprepare_tokens_with_masks
(self, x, masks=None)
preprocess/SpaTrackV2_code/models/vggt4track/layers/vision_transformer.py:217
↓ 4 callersFunctionretrieve_latents
( encoder_output: torch.Tensor, generator: Optional[torch.Generator] = None, sample_mode: str = "sample" )
train_code/train_wan_motion_FrameINO.py:492
↓ 4 callersFunctionretrieve_latents
( encoder_output: torch.Tensor, generator: Optional[torch.Generator] = None, sample_mode: str = "sample" )
pipelines/pipeline_wan_i2v_motion_FrameINO.py:121
↓ 4 callersFunctionscatter_min
Scatter the minimum value along the given dimension of `input` into `src` at the indices specified in `index`.
preprocess/SpaTrackV2_code/models/tracker3D/spatrack_modules/alignment.py:21
↓ 4 callersMethodtrain
(self, mode: bool = True)
preprocess/SpaTrackV2_code/models/blocks.py:173
↓ 4 callersMethodwith_pos_embed
(self, tensor, pos: Optional[Tensor])
preprocess/oneformer_code/oneformer/modeling/transformer_decoder/oneformer_transformer_decoder.py:114
↓ 3 callersMethod__init__
( self, in_features, hidden_features=None, out_features=None, act_laye
preprocess/SpaTrackV2_code/models/vggt4track/heads/track_modules/modules.py:114
↓ 3 callersMethod__init__
(self, dim, heads = 8, dim_head = 64)
preprocess/SpaTrackV2_code/models/tracker3D/spatrack_modules/simple_vit_1d.py:36
↓ 3 callersMethod__init__
NOTE: this interface is experimental. Args: input_shape: shapes (channels and stride) of the input features t
preprocess/oneformer_code/oneformer/modeling/pixel_decoder/msdeformattn.py:167
↓ 3 callersMethod_forward_impl
Implementation of the forward pass through the DPT head. This method processes a specific chunk of frames from the sequence.
preprocess/SpaTrackV2_code/models/vggt4track/heads/dpt_head.py:185
↓ 3 callersFunction_get_activation_fn
Return an activation function given a string
preprocess/oneformer_code/oneformer/modeling/transformer_decoder/transformer.py:368
↓ 3 callersFunction_get_activation_fn
Return an activation function given a string
preprocess/oneformer_code/oneformer/modeling/transformer_decoder/oneformer_transformer_decoder.py:200
↓ 3 callersFunction_get_clones
(module, N)
preprocess/oneformer_code/oneformer/modeling/transformer_decoder/transformer.py:364
↓ 3 callersMethod_linear_projection
(self, x, head_size, proj_layer)
preprocess/SpaTrackV2_code/models/tracker3D/delta_utils/blocks.py:611
↓ 3 callersMethod_linear_projection
(self, x, head_size, proj_layer)
preprocess/SpaTrackV2_code/models/tracker3D/delta_utils/upsample_transformer.py:120
↓ 3 callersFunction_pad_cumsum
(cumsum: torch.Tensor)
preprocess/SpaTrackV2_code/models/tracker3D/spatrack_modules/alignment.py:52
↓ 3 callersFunction_pad_inf
(x_: torch.Tensor)
preprocess/SpaTrackV2_code/models/tracker3D/spatrack_modules/alignment.py:48
↓ 3 callersFunctionapply_1d_rope
(tokens, pos, cos, sin)
architecture/embeddings.py:1270
↓ 3 callersFunctionbase_pose_act
Apply basic activation function to pose parameters. Args: pose_enc: Tensor containing encoded pose parameters act_type: Acti
preprocess/SpaTrackV2_code/models/vggt4track/heads/head_act.py:38
↓ 3 callersFunctionbilinear_sampler
r"""Sample a tensor using bilinear interpolation `bilinear_sampler(input, coords)` samples a tensor :attr:`input` at coordinates :attr:`coord
preprocess/SpaTrackV2_code/utils/model_utils.py:292
↓ 3 callersMethodforward_features
(self, x, masks=None)
preprocess/SpaTrackV2_code/models/vggt4track/layers/vision_transformer.py:262
↓ 3 callersFunctionfunc
()
preprocess/scoring_scene_cut_autoshot.py:39
↓ 3 callersFunctionget_1d_sincos_pos_embed_from_grid_np
This function generates 1D positional embeddings from a grid. Args: embed_dim (`int`): The embedding dimension `D` pos (`num
architecture/embeddings.py:416
↓ 3 callersFunctionget_2d_sincos_pos_embed
Creates 2D sinusoidal positional embeddings. Args: embed_dim (`int`): The embedding dimension. grid_size (`int`)
architecture/embeddings.py:219
↓ 3 callersFunctionget_2d_sincos_pos_embed_from_grid
r""" This function generates 2D sinusoidal positional embeddings from a grid. Args: embed_dim (`int`): The embedding dimension.
architecture/embeddings.py:287
↓ 3 callersMethodinterpolate_time_embed
(self, x, t)
preprocess/SpaTrackV2_code/models/tracker3D/co_tracker/cotracker_base.py:174
next →1–100 of 1,469, ranked by callers