MCPcopy Create free account

hub / github.com/UVA-Computer-Vision-Lab/FrameINO / functions

Functions1,469 in github.com/UVA-Computer-Vision-Lab/FrameINO

↓ 3 callersFunctioninverse_log_transform
Apply inverse log transform: sign(y) * (exp(|y|) - 1) Args: y: Input tensor Returns: Transformed tensor
preprocess/SpaTrackV2_code/models/vggt4track/heads/head_act.py:115
↓ 3 callersFunctionmatrix_to_quaternion
Convert rotations given as rotation matrices to quaternions. Args: matrix: Rotation matrices as tensor of shape (..., 3, 3). Re
preprocess/SpaTrackV2_code/models/utils.py:1019
↓ 3 callersFunctionms_deform_attn_core_pytorch
(value, value_spatial_shapes, sampling_locations, attention_weights)
preprocess/oneformer_code/oneformer/modeling/pixel_decoder/ops/functions/ms_deform_attn_func.py:57
↓ 3 callersFunctionnormalized_view_plane_uv
UV with left-top corner as (-width / diagonal, -height / diagonal) and right-bottom corner as (width / diagonal, height / diagonal)
preprocess/SpaTrackV2_code/models/tracker3D/spatrack_modules/geometry_torch.py:40
↓ 3 callersMethodoverlay_instances
Args: boxes (Boxes, RotatedBoxes or ndarray): either a :class:`Boxes`, or an Nx4 numpy array of XYXY_ABS format f
preprocess/oneformer_code/demo/visualizer.py:707
↓ 3 callersMethodput
(self, image)
preprocess/oneformer_code/demo/predictor.py:157
↓ 3 callersFunctionquaternion_to_matrix
Convert rotations given as quaternions to rotation matrices. Args: quaternions: quaternions with real part first, as ten
preprocess/SpaTrackV2_code/models/utils.py:222
↓ 3 callersFunctionreduce_masked_mean
r"""Masked mean `reduce_masked_mean(x, mask)` computes the mean of a tensor :attr:`input` over a mask :attr:`mask`, returning .. math::
preprocess/SpaTrackV2_code/models/tracker3D/co_tracker/utils.py:78
↓ 3 callersMethodreset_image
Args: img: same as in __init__
preprocess/oneformer_code/demo/visualizer.py:306
↓ 3 callersFunctionretrieve_latents
( encoder_output: torch.Tensor, generator: Optional[torch.Generator] = None, sample_mode: str = "sample" )
train_code/train_wan_motion.py:470
↓ 3 callersFunctionretrieve_latents
( encoder_output: torch.Tensor, generator: Optional[torch.Generator] = None, sample_mode: str = "sample" )
pipelines/pipeline_wan_i2v_motion.py:121
↓ 3 callersFunctionslice_expand_and_flatten
Processes specialized tokens with shape (1, 2, X, C) for multi-frame processing: 1) Uses the first position (index=0) for the first frame onl
preprocess/SpaTrackV2_code/models/vggt4track/models/aggregator_front.py:319
↓ 3 callersFunctionvis_depth
args: x: H W
preprocess/SpaTrackV2_code/models/utils.py:798
↓ 3 callersFunctionweighted_mean_numpy
(x: np.ndarray, w: np.ndarray = None, axis: Union[int, Tuple[int,...]] = None, keepdims: bool = False, eps: fl
preprocess/SpaTrackV2_code/models/tracker3D/spatrack_modules/geometry_numpy.py:14
↓ 3 callersFunctionweighted_procrustes_torch
Weighted Procrustes Analysis in PyTorch (batched). Args: X: (B, 1, N, 3), source point cloud. Y: (B, T, N, 3), target po
preprocess/SpaTrackV2_code/models/tracker3D/spatrack_modules/utils.py:69
↓ 2 callersMethod__init__
(self, name, fmt=":f", summary_type=Summary.AVERAGE)
preprocess/SpaTrackV2_code/models/utils.py:37
↓ 2 callersMethod__init__
( self, dim_in: int, patch_size: int = 14, output_dim: int = 4, activa
preprocess/SpaTrackV2_code/models/vggt4track/heads/dpt_head.py:43
↓ 2 callersMethod__init__
(self,width1=320,conv2_kernel_size=31,K=12, conv_kernel_size=3,inputdim=2,
preprocess/SpaTrackV2_code/models/tracker3D/spatrack_modules/utils.py:779
↓ 2 callersMethod__init__
NOTE: this interface is experimental. Args: input_shape: shapes (channels and stride) of the input features c
preprocess/oneformer_code/oneformer/modeling/pixel_decoder/fpn.py:40
↓ 2 callersMethod_apply_1d_rope
Applies 1D rotary position embeddings along one dimension. Args: tokens: Input token features. positions: Position in
preprocess/SpaTrackV2_code/models/vggt4track/layers/rope.py:133
↓ 2 callersMethod_apply_pos_embed
Apply positional embedding to tensor x.
preprocess/SpaTrackV2_code/models/vggt4track/heads/dpt_head.py:262
↓ 2 callersMethod_convert_boxes
Convert different format of boxes to an NxB array, where B = 4 or 5 is the box dimension.
preprocess/oneformer_code/demo/visualizer.py:1293
↓ 2 callersFunction_convert_ndc_to_pixels
(focal_length: torch.Tensor, principal_point: torch.Tensor, image_size_wh: torch.Tensor)
preprocess/SpaTrackV2_code/models/camera_transform.py:50
↓ 2 callersFunction_convert_pixels_to_ndc
( focal_length_px: torch.Tensor, principal_point_px: torch.Tensor, image_size_wh: torch.Tensor )
preprocess/SpaTrackV2_code/models/camera_transform.py:58
↓ 2 callersMethod_create_grayscale_image
Create a grayscale version of the original image. The colors in masked area, if given, will be kept.
preprocess/oneformer_code/demo/visualizer.py:1259
↓ 2 callersMethod_decode
(self, z: torch.Tensor, return_dict: bool = True)
architecture/autoencoder_kl_wan.py:1198
↓ 2 callersMethod_derive_coco_results
Derive the desired score numbers from summarized COCOeval. Args: coco_eval (None or COCOEval): None represents no predic
preprocess/oneformer_code/oneformer/evaluation/coco_evaluator.py:283
↓ 2 callersMethod_encode
(self, x: torch.Tensor)
architecture/autoencoder_kl_wan.py:1145
↓ 2 callersFunction_evaluate_predictions_on_coco
Evaluate the coco results using COCOEval API.
preprocess/oneformer_code/oneformer/evaluation/coco_evaluator.py:408
↓ 2 callersMethod_freeze_stages
(self)
preprocess/oneformer_code/oneformer/modeling/backbone/swin.py:619
↓ 2 callersMethod_get_src_permutation_idx
(self, indices)
preprocess/oneformer_code/oneformer/modeling/criterion.py:249
↓ 2 callersMethod_get_t5_prompt_embeds
( self, prompt: Union[str, List[str]] = None, num_videos_per_prompt: int = 1,
pipelines/pipeline_wan_i2v_motion_FrameINO.py:206
↓ 2 callersMethod_get_t5_prompt_embeds
( self, prompt: Union[str, List[str]] = None, num_videos_per_prompt: int = 1,
pipelines/pipeline_wan_i2v_motion.py:206
↓ 2 callersMethod_get_t5_prompt_embeds
( self, prompt: Union[str, List[str]] = None, num_videos_per_prompt: int = 1,
pipelines/pipeline_cogvideox_i2v_motion.py:233
↓ 2 callersMethod_get_t5_prompt_embeds
( self, prompt: Union[str, List[str]] = None, num_videos_per_prompt: int = 1,
pipelines/pipeline_cogvideox_i2v_motion_FrameINO.py:226
↓ 2 callersMethod_jitter
Randomly modifies given color to produce a slightly different color than the color given. Args: color (tuple[double]): a
preprocess/oneformer_code/demo/visualizer.py:1242
↓ 2 callersMethod_make_layer
(self, dim, stride=1)
preprocess/SpaTrackV2_code/models/tracker3D/co_tracker/utils.py:164
↓ 2 callersMethod_tasks_from_predictions
Get COCO API "tasks" (i.e. iou_type) from COCO-format predictions.
preprocess/oneformer_code/oneformer/evaluation/coco_evaluator.py:210
↓ 2 callersFunctionactivate_pose
Activate pose parameters with specified activation functions. Args: pred_pose_enc: Tensor containing encoded pose parameters [transl
preprocess/SpaTrackV2_code/models/vggt4track/heads/head_act.py:12
↓ 2 callersFunctionaffine_invariant_global_loss
( pred_points: torch.Tensor, gt_points: torch.Tensor, mask: torch.Tensor, align_resolution:
preprocess/SpaTrackV2_code/models/tracker3D/spatrack_modules/alignment.py:432
↓ 2 callersFunctionapply_rotary_emb_allegro
(x: torch.Tensor, freqs_cis, positions)
architecture/embeddings.py:1268
↓ 2 callersMethodarea
(self)
preprocess/oneformer_code/demo/visualizer.py:156
↓ 2 callersFunctionbilinear_sampler
r"""Sample a tensor using bilinear interpolation `bilinear_sampler(input, coords)` samples a tensor :attr:`input` at coordinates :attr:`coord
preprocess/SpaTrackV2_code/models/vggt4track/heads/track_modules/utils.py:127
↓ 2 callersMethodblend_h
(self, a: torch.Tensor, b: torch.Tensor, blend_extent: int)
architecture/autoencoder_kl_wan.py:1262
↓ 2 callersMethodblend_v
(self, a: torch.Tensor, b: torch.Tensor, blend_extent: int)
architecture/autoencoder_kl_wan.py:1254
↓ 2 callersFunctionbox_iou
(boxes1, boxes2)
preprocess/oneformer_code/oneformer/utils/box_ops.py:24
↓ 2 callersFunctionbytes_to_unicode
Returns list of utf-8 byte and a corresponding list of unicode strings. The reversible bpe codes work on unicode strings. This means you need a l
preprocess/oneformer_code/oneformer/data/tokenizer.py:42
↓ 2 callersFunctioncamera_to_pose_encoding
Inverse to pose_encoding_to_camera
preprocess/SpaTrackV2_code/models/utils.py:328
↓ 2 callersFunctioncombine_time_height_width
(freqs_t, freqs_h, freqs_w)
architecture/embeddings.py:932
↓ 2 callersFunctioncompute_loss
Compute the loss for the FrontTracker model.
preprocess/SpaTrackV2_code/models/vggt4track/utils/loss.py:20
↓ 2 callersFunctioncustom_interpolate
Custom interpolate to avoid INT_MAX issues in nn.functional.interpolate.
preprocess/SpaTrackV2_code/models/vggt4track/heads/dpt_head.py:472
↓ 2 callersFunctiondefault
(val, d)
preprocess/SpaTrackV2_code/models/blocks.py:34
↓ 2 callersFunctiondefault
(val, d)
preprocess/SpaTrackV2_code/models/tracker3D/co_tracker/utils.py:288
↓ 2 callersFunctiondefault
(val, d)
preprocess/SpaTrackV2_code/models/tracker3D/delta_utils/blocks.py:35
↓ 2 callersFunctiondist_collect
collect all tensor from all GPUs args: x: shape (mini_batch, ...) returns: shape (mini_batch * num_gpu, ...)
preprocess/oneformer_code/oneformer/modeling/criterion.py:27
↓ 2 callersMethoddraw_binary_mask
Args: binary_mask (ndarray): numpy array of shape (H, W), where H is the image height and W is the image width. E
preprocess/oneformer_code/demo/visualizer.py:1129
↓ 2 callersMethoddraw_box
Args: box_coord (tuple): a tuple containing x0, y0, x1, y1 coordinates, where x0 and y0 are the coordinates of th
preprocess/oneformer_code/demo/visualizer.py:996
↓ 2 callersMethoddraw_polygon
Args: segment: numpy array of shape Nx2, containing all the points in the polygon. color: color of the polygon. Refer
preprocess/oneformer_code/demo/visualizer.py:1207
↓ 2 callersMethoddraw_sem_seg
Draw semantic segmentation predictions/labels. Args: sem_seg (Tensor or ndarray): the segmentation of shape (H, W).
preprocess/oneformer_code/demo/visualizer.py:537
↓ 2 callersFunctiondrop_add_residual_stochastic_depth
( x: Tensor, residual_func: Callable[[Tensor], Tensor], sample_drop_ratio: float = 0.0, pos=No
preprocess/SpaTrackV2_code/models/vggt4track/layers/block.py:110
↓ 2 callersFunctiondrop_add_residual_stochastic_depth_list
( x_list: List[Tensor], residual_func: Callable[[Tensor, Any], Tensor], sample_drop_ratio: float =
preprocess/SpaTrackV2_code/models/vggt4track/layers/block.py:187
↓ 2 callersMethodencode_image
( self, image: PipelineImageInput, device: Optional[torch.device] = None, )
pipelines/pipeline_wan_i2v_motion_FrameINO.py:247
↓ 2 callersMethodencode_image
( self, image: PipelineImageInput, device: Optional[torch.device] = None, )
pipelines/pipeline_wan_i2v_motion.py:247
↓ 2 callersFunctionencode_prompt
( tokenizer: AutoTokenizer, text_encoder: UMT5EncoderModel, prompt: Union[str, List[str]], num
train_code/train_wan_motion_FrameINO.py:344
↓ 2 callersFunctionencode_prompt
( tokenizer: T5Tokenizer, text_encoder: T5EncoderModel, prompt: Union[str, List[str]], num_vid
train_code/train_cogvideox_motion_FrameINO.py:270
↓ 2 callersFunctionencode_prompt
( tokenizer: T5Tokenizer, text_encoder: T5EncoderModel, prompt: Union[str, List[str]], num_vid
train_code/train_cogvideox_motion.py:262
↓ 2 callersFunctionencode_prompt
( tokenizer: AutoTokenizer, text_encoder: UMT5EncoderModel, prompt: Union[str, List[str]], num
train_code/train_wan_motion.py:322
↓ 2 callersMethodextract_img_feat
(self, video, fmaps_chunk_size=200)
preprocess/SpaTrackV2_code/models/tracker3D/TrackRefiner.py:266
↓ 2 callersFunctionextract_static_from_3DTracks
world_tracks: B T N 3 this is the coarse 3d tracks in world coordinate (coarse 3d tracks) dyn_prob: B T N this is the dynamic probabilit
preprocess/SpaTrackV2_code/models/tracker3D/spatrack_modules/ba.py:12
↓ 2 callersFunctionfn_vis_realtime_traj
(visual_canvas, traj_list, traj_instance_idx)
app.py:401
↓ 2 callersFunctionfocal_to_fov_numpy
(focal: np.ndarray)
preprocess/SpaTrackV2_code/models/tracker3D/spatrack_modules/geometry_numpy.py:45
↓ 2 callersMethodforward
(self, x: torch.Tensor, first_chunk=False)
architecture/autoencoder_kl_wan.py:109
↓ 2 callersMethodforward_features
(self, features)
preprocess/oneformer_code/oneformer/modeling/pixel_decoder/fpn.py:136
↓ 2 callersMethodforward_prediction_heads
(self, output, mask_features, attn_mask_target_size, i)
preprocess/oneformer_code/oneformer/modeling/transformer_decoder/oneformer_transformer_decoder.py:495
↓ 2 callersMethodfuse_projections
(self, fuse=True)
architecture/attention_processor.py:770
↓ 2 callersFunctiongather_nd
The same as tf.gather_nd but batched gather is not supported yet. indices is an k-dimensional integer tensor, best thought of as a (k-1)-dimensio
preprocess/auxiliary/AutoShot.py:218
↓ 2 callersFunctionget_1d_sincos_pos_embed_from_grid
This function generates a 1D positional embedding from a given grid using sine and cosine functions. Args: - embed_dim: The embedding di
preprocess/SpaTrackV2_code/models/vggt4track/heads/track_modules/utils.py:67
↓ 2 callersFunctionget_1d_sincos_pos_embed_from_grid
embed_dim: output dimension for each position pos: a list of positions to be encoded: size (M,) out: (M, D)
preprocess/oneformer_code/oneformer/utils/pos_embed.py:46
↓ 2 callersFunctionget_2d_rotary_pos_embed_from_grid
Get 2D RoPE from grid. Args: embed_dim: (`int`): The embedding dimension size, corresponding to hidden_size_head. grid (`np.
architecture/embeddings.py:1086
↓ 2 callersFunctionget_2d_sincos_pos_embed_from_grid_np
r""" This function generates 2D sinusoidal positional embeddings from a grid. Args: embed_dim (`int`): The embedding dimension.
architecture/embeddings.py:394
↓ 2 callersFunctionget_attn_bias_and_cat
this will perform the index select, cat the tensors, and provide the attn_bias from cache
preprocess/SpaTrackV2_code/models/vggt4track/layers/block.py:163
↓ 2 callersMethodget_image
Returns: ndarray: the visualized image of shape (H, W, 3) (RGB) in uint8 type. The shape is scale
preprocess/oneformer_code/demo/visualizer.py:322
↓ 2 callersMethodget_loss
(self, loss, outputs, targets, indices, num_masks)
preprocess/oneformer_code/oneformer/modeling/criterion.py:261
↓ 2 callersFunctionget_nth_visible_time_index
vis_gt: [B, T, N] 0/1 binary tensor n: [B, N] int tensor, the n-th visible time index to get (1-based) Returns: [B, N] tensor of time in
preprocess/SpaTrackV2_code/models/tracker3D/spatrack_modules/utils.py:920
↓ 2 callersFunctionget_pairs
Return set of symbol pairs in a word. Word is represented as tuple of symbols (symbols being variable-length strings).
preprocess/oneformer_code/oneformer/data/tokenizer.py:62
↓ 2 callersFunctionget_resize_crop_region_for_grid
(src, tgt_width, tgt_height)
pipelines/pipeline_cogvideox_i2v_motion.py:79
↓ 2 callersFunctionget_resize_crop_region_for_grid
(src, tgt_width, tgt_height)
pipelines/pipeline_cogvideox_i2v_motion_FrameINO.py:72
↓ 2 callersMethodget_support_points
(self, coords, r, reshape_back=True)
preprocess/SpaTrackV2_code/models/tracker3D/co_tracker/cotracker_base.py:120
↓ 2 callersFunctionhuber_loss
Calculate element-wise Huber loss between x and y
preprocess/SpaTrackV2_code/models/tracker3D/co_tracker/utils.py:772
↓ 2 callersFunctionimg_tensor_to_vae_latent
(img_tensor, vae, device, add_augment_noise = True)
train_code/train_cogvideox_motion_FrameINO.py:515
↓ 2 callersFunctionkey_fr_wprocrustes
cam_pts: (B, T, N, 3) graph_matrix: (B, 1, N) dyn_weight: (B, T, N) K: number of keyframes to select (including start and end) R
preprocess/SpaTrackV2_code/models/tracker3D/spatrack_modules/utils.py:135
↓ 2 callersMethodloss
Compute the loss of 3D tracking problem
preprocess/SpaTrackV2_code/models/tracker3D/TrackRefiner.py:1206
↓ 2 callersFunctionmake_2tuple
(x)
preprocess/SpaTrackV2_code/models/vggt4track/layers/patch_embed.py:16
↓ 2 callersFunctionmake_sincos_pos_embed
This function generates a 1D positional embedding from a given grid using sine and cosine functions. Args: - embed_dim: The embedding di
preprocess/SpaTrackV2_code/models/vggt4track/heads/utils.py:36
↓ 2 callersMethodmask_to_polygons
(self, mask)
preprocess/oneformer_code/demo/visualizer.py:132
↓ 2 callersFunctionnorm_cdf
(x)
preprocess/oneformer_code/oneformer/utils/misc.py:27
↓ 2 callersFunctionnormalize_prediction_robust
(target, mask, Bs)
preprocess/SpaTrackV2_code/models/utils.py:512
↓ 2 callersFunctionnormalize_video_robust
(target, mask, Bs)
preprocess/SpaTrackV2_code/models/utils.py:536
↓ 2 callersFunctionnormalized_view_plane_uv_numpy
UV with left-top corner as (-width / diagonal, -height / diagonal) and right-bottom corner as (width / diagonal, height / diagonal)
preprocess/SpaTrackV2_code/models/tracker3D/spatrack_modules/geometry_numpy.py:30
↓ 2 callersFunctionpose_enc2mat
This function convert the pose encoding into `intrinsic` and `extrinsic` Args: poses_pred: B T 8 Return: Intrinsic B T
preprocess/SpaTrackV2_code/models/utils.py:966
← previousnext →101–200 of 1,469, ranked by callers