MCPcopy Create free account

hub / github.com/UVA-Computer-Vision-Lab/FrameINO / functions

Functions1,469 in github.com/UVA-Computer-Vision-Lab/FrameINO

Functionadd_convnext_config
Add config for ConvNeXt Backbone.
preprocess/oneformer_code/oneformer/config.py:199
Functionadd_traj_point
( visual_canvas, traj_lists, traj_instance_idx,
app.py:424
Functionadjust_camera_to_bbox_crop_
(fl, pp, image_size_wh: torch.Tensor, clamp_bbox_xywh: torch.Tensor)
preprocess/SpaTrackV2_code/models/camera_transform.py:23
Functionadjust_camera_to_image_scale_
(fl, pp, original_size_wh: torch.Tensor, new_size_wh: torch.LongTensor)
preprocess/SpaTrackV2_code/models/camera_transform.py:35
Functionalign_affine_lstsq
Solve `min sum_i w_i * (a * x_i + b - y_i ) ^ 2`, where `a` and `b` are scalars, with respect to `a` and `b` using least squares. ### Parame
preprocess/SpaTrackV2_code/models/tracker3D/spatrack_modules/alignment.py:407
Functionalign_depth_affine
Align `depth_src` to `depth_tgt` with given constant weights. ### Parameters: - `depth_src: torch.Tensor` of shape (..., N) - `depth
preprocess/SpaTrackV2_code/models/tracker3D/spatrack_modules/alignment.py:171
Functionalign_depth_affine_irls
Align `depth_src` to `depth_tgt` with given constant weights using IRLS.
preprocess/SpaTrackV2_code/models/tracker3D/spatrack_modules/alignment.py:224
Functionalign_depth_scale
Align `depth_src` to `depth_tgt` with given constant weights. ### Parameters: - `depth_src: torch.Tensor` of shape (..., N) - `dept
preprocess/SpaTrackV2_code/models/tracker3D/spatrack_modules/alignment.py:157
Functionalign_points_scale
### Parameters: - `points_src: torch.Tensor` of shape (..., N, 3) - `points_tgt: torch.Tensor` of shape (..., N, 3) - `weight: torch.
preprocess/SpaTrackV2_code/models/tracker3D/spatrack_modules/alignment.py:241
Functionalign_points_xyz_shift
Align `points_src` to `points_tgt` with respect to a Z-axis shift. ### Parameters: - `points_src: torch.Tensor` of shape (..., N, 3)
preprocess/SpaTrackV2_code/models/tracker3D/spatrack_modules/alignment.py:387
Functionalign_points_z_shift
Align `points_src` to `points_tgt` with respect to a Z-axis shift. ### Parameters: - `points_src: torch.Tensor` of shape (..., N, 3)
preprocess/SpaTrackV2_code/models/tracker3D/spatrack_modules/alignment.py:366
Functionangle_diff_vec3
(v1: torch.Tensor, v2: torch.Tensor, eps: float = 1e-12)
preprocess/SpaTrackV2_code/models/tracker3D/spatrack_modules/geometry_torch.py:72
Methodapply_partial_rotary_emb
( self, x: torch.Tensor, freqs_cis: Tuple[torch.Tensor], )
architecture/attention_processor.py:3632
Methodapply_rotary_emb
(x, freqs_cos, freqs_sin)
architecture/attention_processor.py:1024
Methodapply_rotary_emb
( hidden_states: torch.Tensor, freqs_cos: torch.Tensor, freqs_
architecture/transformer_wan.py:75
Methodattention_kwargs
(self)
pipelines/pipeline_wan_i2v_motion_FrameINO.py:576
Methodattention_kwargs
(self)
pipelines/pipeline_wan_i2v_motion.py:532
Methodattention_kwargs
(self)
pipelines/pipeline_cogvideox_i2v_motion.py:611
Methodattention_kwargs
(self)
pipelines/pipeline_cogvideox_i2v_motion_FrameINO.py:595
Methodattn_processors
r""" Returns: `dict` of attention processors: A dictionary containing all attention processors used in the model with
architecture/cogvideox_transformer_3d.py:348
Methodattn_residual_func
(x: Tensor, pos=None)
preprocess/SpaTrackV2_code/models/vggt4track/layers/block.py:82
Methodattn_residual_func
(x: Tensor, attn_bias=None)
preprocess/SpaTrackV2_code/models/vggt4track/layers/block.py:219
Methodaverage_time
(self)
preprocess/SpaTrackV2_code/models/tracker3D/spatrack_modules/tools.py:190
Functionbatch_sigmoid_ce_loss
Args: inputs: A float tensor of arbitrary shape. The predictions for each example. targets: A float tensor with t
preprocess/oneformer_code/oneformer/modeling/matcher.py:61
Functionbbox_xyxy_to_xywh
(xyxy)
preprocess/SpaTrackV2_code/models/camera_transform.py:17
Functionbilinear_sample2d
(im, x, y, return_inbounds=False)
preprocess/SpaTrackV2_code/utils/model_utils.py:175
Functionbox_cxcywh_to_xyxy
(x)
preprocess/oneformer_code/oneformer/utils/box_ops.py:9
Functionbox_xyxy_to_cxcywh
(x)
preprocess/oneformer_code/oneformer/utils/box_ops.py:16
Functionbuild_detection_test_loader
Similar to `build_detection_train_loader`, with default batch size = 1, and sampler = :class:`InferenceSampler`. This sampler coordinates all
preprocess/oneformer_code/oneformer/data/build.py:56
Functioncam2pix
Args: coords: [B, T, N, 3] intr: [B, T, 3, 3]
preprocess/SpaTrackV2_code/models/tracker3D/delta_utils/blocks.py:676
Functioncatch_exception
(fn)
preprocess/SpaTrackV2_code/models/tracker3D/spatrack_modules/tools.py:14
Functionclear_traj_points
(initial_visual_canvas)
app.py:449
Functioncollate_fn
(examples)
train_code/train_wan_motion_FrameINO.py:940
Functioncollate_fn
(examples)
train_code/train_cogvideox_motion_FrameINO.py:819
Functioncollate_fn
(examples)
train_code/train_cogvideox_motion.py:789
Functioncollate_fn
(examples)
train_code/train_wan_motion.py:885
Functioncolormap
Args: rgb (bool): whether to return RGB colors or BGR colors. maximum (int): either 255 or 1 Returns: ndarray: a floa
preprocess/oneformer_code/demo/colormap.py:111
Functioncompute_affine_scale_and_shift
Compute global affine transform (scale * pointmap + shift = points) using least-squares fitting with optional weights and mask. Args:
preprocess/SpaTrackV2_code/models/tracker3D/spatrack_modules/pointmap_updator.py:6
Methodcorr
(self, targets)
preprocess/SpaTrackV2_code/models/blocks.py:368
Methodcorr
(self, targets)
preprocess/SpaTrackV2_code/models/tracker3D/delta_utils/blocks.py:313
Methodcorr
(self, targets)
preprocess/SpaTrackV2_code/models/tracker3D/delta_utils/blocks.py:402
Methodcorr_sample
(self, targets, coords, coords_dp=None)
preprocess/SpaTrackV2_code/models/blocks.py:384
Methodcreate_bar
(tag, bucket_limits, bucket_counts, **kwargs)
preprocess/oneformer_code/oneformer/utils/events.py:104
Methodcreate_custom_forward
(module)
architecture/cogvideox_transformer_3d.py:506
Methodcurrent_timestep
(self)
pipelines/pipeline_wan_i2v_motion_FrameINO.py:568
Methodcurrent_timestep
(self)
pipelines/pipeline_wan_i2v_motion.py:524
Methodcustom_forward
(*inputs)
architecture/cogvideox_transformer_3d.py:507
Functiondecorator
(fn: Callable)
preprocess/SpaTrackV2_code/models/tracker3D/spatrack_modules/tools.py:234
Functiondefault
(val, d)
preprocess/SpaTrackV2_code/models/vggt4track/heads/track_modules/modules.py:32
Methoddefault_buffer_size
(self)
preprocess/oneformer_code/demo/predictor.py:189
Functiondepth_occlusion_edge
(depth: torch.FloatTensor, mask: torch.BoolTensor, kernel_size: int = 3, tol: float = 0.1)
preprocess/SpaTrackV2_code/models/tracker3D/spatrack_modules/geometry_torch.py:264
Functiondepth_occlusion_edge_numpy
(depth: np.ndarray, mask: np.ndarray, kernel_size: int = 3, tol: float = 0.1)
preprocess/SpaTrackV2_code/models/tracker3D/spatrack_modules/geometry_numpy.py:291
Functiondepth_of_field
Apply depth of field effect to an image. Args: img (numpy.ndarray): (H, W, 3) input image. depth (numpy.ndarray): (H, W) dep
preprocess/SpaTrackV2_code/models/tracker3D/spatrack_modules/geometry_numpy.py:351
Functiondice_loss
Compute the DICE loss, similar to generalized IOU for masks Args: inputs: A float tensor of arbitrary shape. The pred
preprocess/oneformer_code/oneformer/modeling/criterion.py:39
Functiondilate_with_mask
(input: torch.Tensor, mask: torch.BoolTensor, filter: Literal['min', 'max', 'mean', 'median'] = 'mean', iterat
preprocess/SpaTrackV2_code/models/tracker3D/spatrack_modules/geometry_torch.py:309
Methoddisable_slicing
r""" Disable sliced VAE decoding. If `enable_slicing` was previously enabled, this method will go back to computing decoding in one st
architecture/autoencoder_kl_wan.py:1128
Methoddisable_tiling
r""" Disable tiled VAE decoding. If `enable_tiling` was previously enabled, this method will go back to computing decoding in one step
architecture/autoencoder_kl_wan.py:1114
Methoddo_classifier_free_guidance
(self)
pipelines/pipeline_wan_i2v_motion_FrameINO.py:560
Methoddo_classifier_free_guidance
(self)
pipelines/pipeline_wan_i2v_motion.py:516
Functiondraw_circle
(rgb, coord, radius, color=(255, 0, 0), visible=True, color_alpha=None)
preprocess/track_FrameINO.py:176
Methoddraw_dataset_dict
Draw annotations/segmentaions in Detectron2 Dataset format. Args: dic (dict): annotation/segmentation data of one image,
preprocess/oneformer_code/demo/visualizer.py:640
Functiondraw_points
(frame, cluster_points, height, width, resize_dot_radius, color_code)
preprocess/filter_panoptic_multi.py:269
Methoddraw_soft_mask
Args: soft_mask (ndarray): float array of shape (H, W), each value in [0, 1]. color: color of the mask. Refer to `mat
preprocess/oneformer_code/demo/visualizer.py:1180
Methodevaluate
Returns: dict: has a key "segm", whose value is a dict of "AP" and "AP50".
preprocess/oneformer_code/oneformer/evaluation/cityscapes_evaluation.py:95
Methodevaluate
(self)
preprocess/oneformer_code/oneformer/evaluation/cityscapes_evaluation.py:162
Methodf
(*args, **kwargs)
preprocess/SpaTrackV2_code/models/vggt4track/layers/vision_transformer.py:133
Methodffn_residual_func
(x: Tensor)
preprocess/SpaTrackV2_code/models/vggt4track/layers/block.py:85
Methodffn_residual_func
(x: Tensor, attn_bias=None)
preprocess/SpaTrackV2_code/models/vggt4track/layers/block.py:222
Functionfilter_uv
Args: flow (numpy): A 2-dim array that stores x and y change in optical flow threshold_factor (float): Prob of di
utils/optical_flow_utils.py:122
Functionfirst_pose_enc_denorm
make sure the poses in on window are de-normalized by the first frame, where the first frame transformation is the Identity Matrix. args
preprocess/SpaTrackV2_code/models/utils.py:436
Methodflops
(self)
preprocess/SpaTrackV2_code/models/vggt4track/layers/patch_embed.py:83
Functionflow_to_image
Expects a two dimensional flow image of shape. Args: flow_uv (np.ndarray): Flow UV image of shape [H,W,2] clip_flow (float,
utils/optical_flow_utils.py:93
Methodfn_recursive_add_processors
(name: str, module: torch.nn.Module, processors: Dict[str, AttentionProcessor])
architecture/cogvideox_transformer_3d.py:357
Methodfn_recursive_attn_processor
(name: str, module: torch.nn.Module, processor)
architecture/cogvideox_transformer_3d.py:393
Functionfocal_to_fov
(focal: torch.Tensor)
preprocess/SpaTrackV2_code/models/tracker3D/spatrack_modules/geometry_torch.py:64
Methodforward
r""" The forward method of the `Attention` class. Args: hidden_states (`torch.Tensor`): The hidden states
architecture/attention_processor.py:556
Methodforward
(self, hidden_states: torch.Tensor)
architecture/attention_processor.py:843
Methodforward
(self, hidden_states: torch.Tensor)
architecture/attention_processor.py:911
Methodforward
( self, hidden_states: torch.Tensor, encoder_hidden_states: Optional[torch.Tensor] = N
architecture/attention_processor.py:965
Methodforward
(self, f: torch.Tensor, zq: torch.Tensor)
architecture/attention_processor.py:4831
Methodforward
( self, hidden_states: torch.Tensor, encoder_hidden_states: torch.Tensor, temb
architecture/cogvideox_transformer_3d.py:122
Methodforward
( self, hidden_states: torch.Tensor, encoder_hidden_states: torch.Tensor, time
architecture/cogvideox_transformer_3d.py:446
Methodforward
(self, encoder_hidden_states_image: torch.Tensor)
architecture/transformer_wan.py:134
Methodforward
( self, timestep: torch.Tensor, encoder_hidden_states: torch.Tensor, encoder_h
architecture/transformer_wan.py:168
Methodforward
(self, hidden_states: torch.Tensor)
architecture/transformer_wan.py:228
Methodforward
( self, hidden_states: torch.Tensor, encoder_hidden_states: torch.Tensor, temb
architecture/transformer_wan.py:308
Methodforward
( self, hidden_states: torch.Tensor, timestep: torch.LongTensor, encoder_hidde
architecture/transformer_wan.py:454
Methodforward
(self, latent)
architecture/embeddings.py:540
Methodforward
Patchifies and embeds the input tensor(s). Args: x (List[torch.Tensor] | torch.Tensor): The input tensor(s) to be patchi
architecture/embeddings.py:592
Methodforward
r""" Args: text_embeds (`torch.Tensor`): Input text embeddings. Expected shape: (batch_size, seq_length, embedding
architecture/embeddings.py:718
Methodforward
(self, hidden_states: torch.Tensor, encoder_hidden_states: torch.Tensor)
architecture/embeddings.py:835
Methodforward
(self, ids: torch.Tensor)
architecture/embeddings.py:1293
Methodforward
(self, sample, condition=None)
architecture/embeddings.py:1350
Methodforward
(self, timesteps)
architecture/embeddings.py:1373
Methodforward
(self, x)
architecture/embeddings.py:1402
Methodforward
(self, x)
architecture/embeddings.py:1436
Methodforward
(self, index)
architecture/embeddings.py:1484
Methodforward
(self, labels: torch.LongTensor, force_drop_ids=None)
architecture/embeddings.py:1535
Methodforward
(self, text_embeds: torch.Tensor, image_embeds: torch.Tensor)
architecture/embeddings.py:1557
Methodforward
(self, image_embeds: torch.Tensor)
architecture/embeddings.py:1583
← previousnext →1,001–1,100 of 1,469, ranked by callers