MCPcopy Create free account

hub / github.com/InternRobotics/G2VLM / functions

Functions2,118 in github.com/InternRobotics/G2VLM

↓ 2 callersFunctiondrop_add_residual_stochastic_depth_list
( x_list: List[Tensor], residual_func: Callable[[Tensor, Any], Tensor], sample_drop_ratio: float =
eval_code/recons/models/pi3/models/dinov2/layers/block.py:187
↓ 2 callersMethodencode_decode
Encode images with backbone and decode into a semantic segmentation map of the same size as input.
modeling/pi3/models/segformer/model.py:59
↓ 2 callersFunctioneval_metrics
(pred_traj, gt_traj=None, seq="", filename="", sample_stride=1, verbose=False)
eval_code/recons/relpose/evo_utils.py:229
↓ 2 callersFunctionfocal_to_fov
(focal: torch.Tensor)
eval_code/recons/models/moge/utils3d/torch/transforms.py:286
↓ 2 callersFunctionfocal_to_fov
(focal: np.ndarray)
eval_code/recons/models/moge/utils3d/numpy/transforms.py:201
↓ 2 callersFunctionfocal_to_fov_numpy
(focal: np.ndarray)
eval_code/recons/models/moge/utils/geometry_numpy.py:45
↓ 2 callersMethodforward
Placeholder of forward function.
modeling/pi3/models/segformer/head.py:597
↓ 2 callersFunctionfsdp_ema_setup
(ema_model, fsdp_config, ignored_modules=[])
train/fsdp_utils.py:550
↓ 2 callersFunctionfsdp_ema_update
(ema_model, model, decay=0.9999)
train/fsdp_utils.py:559
↓ 2 callersMethodfsdp_save_ckpt
( ckpt_dir, train_steps, model, ema_model, optimizer, sca
train/fsdp_utils.py:329
↓ 2 callersFunctiongather_csv_and_write
Gather all CSV files in the input directory, concatenate them, and write to the output file. If the input directory contains multiple rows in
eval_code/recons/utils/messages.py:27
↓ 2 callersFunctionget_1d_sincos_pos_embed_from_grid
embed_dim: output dimension for each position pos: a list of positions to be encoded: size (M,) out: (M, D)
modeling/g2vlm/modeling_utils.py:48
↓ 2 callersFunctionget_1d_sincos_pos_embed_from_grid
embed_dim: output dimension for each position pos: a list of positions to be encoded: size (M,) out: (M, D)
modeling/pi3/models/layers/pos_embed.py:51
↓ 2 callersFunctionget_1d_sincos_pos_embed_from_grid
This function generates a 1D positional embedding from a given grid using sine and cosine functions. Args: - embed_dim: The embedding di
eval_code/recons/models/vggt/heads/track_modules/utils.py:67
↓ 2 callersFunctionget_1d_sincos_pos_embed_from_grid
embed_dim: output dimension for each position pos: a list of positions to be encoded: size (M,) out: (M, D)
eval_code/recons/models/pi3/models/layers/pos_embed.py:51
↓ 2 callersFunctionget_2d_sincos_pos_embed
(embed_dim, grid_size, cls_token=False, extra_tokens=0)
modeling/g2vlm/modeling_utils.py:24
↓ 2 callersFunctionget_attn_bias_and_cat
this will perform the index select, cat the tensors, and provide the attn_bias from cache
modeling/pi3/models/layers/block.py:161
↓ 2 callersFunctionget_attn_bias_and_cat
this will perform the index select, cat the tensors, and provide the attn_bias from cache
modeling/pi3/models/dinov2/layers/block.py:163
↓ 2 callersFunctionget_attn_bias_and_cat
this will perform the index select, cat the tensors, and provide the attn_bias from cache
eval_code/recons/models/moge/model/dinov2/layers/block.py:163
↓ 2 callersFunctionget_attn_bias_and_cat
this will perform the index select, cat the tensors, and provide the attn_bias from cache
eval_code/recons/models/vggt/layers/block.py:163
↓ 2 callersFunctionget_attn_bias_and_cat
this will perform the index select, cat the tensors, and provide the attn_bias from cache
eval_code/recons/models/pi3/models/layers/block.py:161
↓ 2 callersFunctionget_attn_bias_and_cat
this will perform the index select, cat the tensors, and provide the attn_bias from cache
eval_code/recons/models/pi3/models/dinov2/layers/block.py:163
↓ 2 callersMethodget_dtype
(self)
modeling/qwen2vl/modeling_qwen2_vl.py:1013
↓ 2 callersFunctionget_frame_indices
(num_frames, vlen, sample='rand', fix_start=None, input_fps=1, max_num_frames=-1)
data/video_utils.py:23
↓ 2 callersFunctionget_image_augmentation
Create a composition of image augmentations. Args: color_jitter: Dictionary containing color jitter parameters: - brightness:
data/augmentation_vggt.py:11
↓ 2 callersMethodget_intermediate_layers
( self, x: torch.Tensor, n: Union[int, Sequence] = 1, # Layers or n last layers to ta
eval_code/recons/models/moge/model/dinov2/models/vision_transformer.py:298
↓ 2 callersFunctionget_latest_ckpt
(checkpoint_dir)
train/train_utils.py:26
↓ 2 callersFunctionget_mipnerf_cones
Args: rays_o: (..., n_rays, 3) ray origins rays_d: (..., n_rays, 3) ray directions. z_vals: (..., n_rays, n_samples) z va
eval_code/recons/models/moge/utils3d/torch/nerf.py:69
↓ 2 callersFunctionget_pairs
Return set of symbol pairs in a word. Word is represented as tuple of symbols (symbols being variable-length strings).
modeling/qwen2/tokenization_qwen2.py:58
↓ 2 callersMethodget_seq_framenum
(self, index: Optional[int] = None, sequence_name: Optional[str] = None)
eval_code/recons/datasets/dtu.py:124
↓ 2 callersFunctionget_tum_poses
poses: list of 4x4 arrays
eval_code/recons/relpose/evo_utils.py:67
↓ 2 callersFunctionimage_uv
Get image space UV grid, ranging in [0, 1]. >>> image_uv(10, 10): [[[0.05, 0.05], [0.15, 0.05], ..., [0.95, 0.05]], [[0.05, 0.15],
eval_code/recons/models/moge/utils3d/numpy/utils.py:344
↓ 2 callersFunctioninfer_cameras_c2w
(filelist: str, model: Pi3, hydra_cfg: DictConfig)
eval_code/recons/interfaces/pi3.py:138
↓ 2 callersFunctioninfer_cameras_w2c
(filelist: str, model: Pi3, hydra_cfg: DictConfig)
eval_code/recons/interfaces/pi3.py:119
↓ 2 callersFunctioninfer_monodepth
(file: str, model: Pi3, hydra_cfg: DictConfig)
eval_code/recons/interfaces/pi3.py:88
↓ 2 callersFunctioninfer_mv_pointclouds
(filelist: str, model: Pi3, hydra_cfg: DictConfig, data_size: Tuple[int, int])
eval_code/recons/interfaces/pi3.py:152
↓ 2 callersFunctioninfer_videodepth
(filelist: str, model: Pi3, hydra_cfg: DictConfig)
eval_code/recons/interfaces/pi3.py:102
↓ 2 callersMethodinit_moe
(self)
modeling/g2vlm/qwen2vl.py:1352
↓ 2 callersFunctionintrinsics_from_focal_center
Get OpenCV intrinsics matrix Args: focal_x (float | torch.Tensor): focal length in x axis focal_y (float | torch.Tensor): fo
eval_code/recons/models/moge/utils3d/torch/transforms.py:195
↓ 2 callersFunctionlen2weight
(x, loss_reduction='square')
data/data_utils.py:316
↓ 2 callersFunctionlerp
Linear interpolation between two vectors. Args: x1 (np.ndarray): [..., d] vector 1 x2 (np.ndarray): [..., d] vector 2
eval_code/recons/models/moge/utils3d/numpy/transforms.py:995
↓ 2 callersFunctionload_images
Loads images from a directory or video, resizes them to a uniform size, then converts and stacks them into a single [N, 3, H, W] PyTorch tens
data/transforms_vggt.py:411
↓ 2 callersFunctionload_model_and_tokenizer
(args)
g2vlm_utils.py:72
↓ 2 callersFunctionload_timestamps
(time_file, traj_format="replica")
eval_code/recons/relpose/evo_utils.py:207
↓ 2 callersFunctionload_traj
Read trajectory format. Return in TUM-RGBD format. Returns: traj_tum (N, 7): camera to world poses in (x,y,z,qx,qy,qz,qw) timestam
eval_code/recons/relpose/evo_utils.py:168
↓ 2 callersFunctionmake_2tuple
(x)
modeling/pi3/models/dinov2/layers/patch_embed.py:16
↓ 2 callersFunctionmake_2tuple
(x)
eval_code/recons/models/moge/model/dinov2/layers/patch_embed.py:16
↓ 2 callersFunctionmake_2tuple
(x)
eval_code/recons/models/vggt/layers/patch_embed.py:16
↓ 2 callersFunctionmake_2tuple
(x)
eval_code/recons/models/pi3/models/dinov2/layers/patch_embed.py:16
↓ 2 callersFunctionmake_csvsdir_and_remove_history_csvs
Make the input directory for CSV files and remove any existing history CSV files.
eval_code/recons/utils/messages.py:16
↓ 2 callersFunctionmake_sincos_pos_embed
This function generates a 1D positional embedding from a given grid using sine and cosine functions. Args: - embed_dim: The embedding di
eval_code/recons/models/vggt/heads/utils.py:36
↓ 2 callersFunctionmatrix_to_axis_angle
Convert a batch of 3x3 rotation matrices to axis-angle representation (rotation vector) Args: rot_mat (torch.Tensor): shape (..., 3, 3),
eval_code/recons/models/moge/utils3d/torch/transforms.py:932
↓ 2 callersFunctionmatrix_to_quaternion
Convert 3x3 rotation matrix to quaternion (w, x, y, z) Args: rot_mat (np.ndarray): shape (..., 3, 3), the rotation matrices to convert
eval_code/recons/models/moge/utils3d/numpy/transforms.py:704
↓ 2 callersFunctionmipnerf_render_rays
MipNeRF rendering. Args: mipnerf: mipnerf model, which takes (points_mu, points_sigma) as input and returns (color, density) as outp
eval_code/recons/models/moge/utils3d/torch/nerf.py:337
↓ 2 callersFunctionnerf_render_rays
NeRF rendering of rays. Note that it supports arbitrary batch dimensions (denoted as `...`) Args: nerf: nerf model, which takes (poi
eval_code/recons/models/moge/utils3d/torch/nerf.py:234
↓ 2 callersFunctionneus_volume_rendering
Given color, sdf values and z_vals (linear depth of the sampling points), do volume rendering. (NeuS) Args: color: (..., n_samples o
eval_code/recons/models/moge/utils3d/torch/nerf.py:144
↓ 2 callersFunctionnormalized_view_plane_uv_numpy
UV with left-top corner as (-width / diagonal, -height / diagonal) and right-bottom corner as (width / diagonal, height / diagonal)
eval_code/recons/models/moge/utils/geometry_numpy.py:30
↓ 2 callersMethodpack_sequence
(self, sample, sequence_status)
data/dataset_base.py:390
↓ 2 callersFunctionpad
(l: list, n: Any)
eval_code/recons/models/moge/utils3d/io/obj.py:53
↓ 2 callersFunctionperspective
Get OpenGL perspective matrix Args: fov_y (float | torch.Tensor): field of view in y axis aspect (float | torch.Tensor): asp
eval_code/recons/models/moge/utils3d/torch/transforms.py:119
↓ 2 callersFunctionperspective
Get OpenGL perspective matrix Args: fov_y (float | np.ndarray): field of view in y axis aspect (float | np.ndarray): aspect
eval_code/recons/models/moge/utils3d/numpy/transforms.py:57
↓ 2 callersFunctionprepare_attention_mask_per_sample
nested_split_lens: A list of N lists of ints. Each int indicates the length of a split within a sample, where each sample contains multi
data/data_utils.py:205
↓ 2 callersMethodprepare_dino_images_pi3
(self, curr_kvlens, curr_rope, images, transforms, new_token_ids)
modeling/g2vlm/g2vlm.py:864
↓ 2 callersMethodprepare_prompts_addbos
(self, curr_kvlens, curr_rope, prompts, tokenizer, new_token_ids)
modeling/g2vlm/g2vlm.py:557
↓ 2 callersMethodprepare_prompts_pure_text
(self, curr_kvlens, curr_rope, prompts, tokenizer, new_token_ids)
modeling/g2vlm/g2vlm.py:628
↓ 2 callersFunctionprocess_frames
(split_file)
eval_code/recons/datasets/preprocess/prepare_7scenes.py:67
↓ 2 callersMethodprogram_vertex_attribute
(self, n: int)
eval_code/recons/models/moge/utils3d/numpy/rasterization.py:57
↓ 2 callersMethodput
(self, data: Any, key: str = None, block: bool = True)
eval_code/recons/models/moge/utils/pipeline.py:97
↓ 2 callersFunctionquaternion_to_matrix
Convert rotations given as quaternions to rotation matrices. Args: quaternions: quaternions with real part first, as ten
modeling/g2vlm/rotation_utils.py:44
↓ 2 callersFunctionrasterize_triangle_faces
Rasterize a mesh with vertex attributes. Args: ctx (GLContext): rasterizer context vertices (np.ndarray): (B, N, 2 or 3 or 4
eval_code/recons/models/moge/utils3d/torch/rasterization.py:38
↓ 2 callersFunctionrasterize_triangle_faces
Rasterize vertex attribute. Args: vertices (np.ndarray): [N, 3] faces (np.ndarray): [T, 3] attr (np.ndarray): [N, C]
eval_code/recons/models/moge/utils3d/numpy/rasterization.py:94
↓ 2 callersFunctionread_file_list
Reads a trajectory from a text file. File format: The file format is "stamp d1 d2 d3 ...", where stamp denotes the time stamp (to b
eval_code/recons/datasets/preprocess/prepare_tum.py:8
↓ 2 callersMethodreconstruct
( self, past_key_values: NaiveCache, packed_key_value_indexes: torch.LongTensor,
modeling/g2vlm/g2vlm.py:1237
↓ 2 callersFunctionrotate_half
Rotates half the hidden dims of the input.
modeling/qwen2/modeling_qwen2.py:156
↓ 2 callersFunctionrotate_half
Rotates half the hidden dims of the input.
modeling/qwen2vl/modeling_qwen2_vl_vit.py:63
↓ 2 callersFunctionrotate_half
Rotates half the hidden dims of the input.
modeling/dinov3/dinov3_model.py:179
↓ 2 callersFunctionrotate_half
Rotates half the hidden dims of the input.
modeling/dinov3/modeling_dinov3_vit.py:183
↓ 2 callersFunctionrotate_target_dim_to_last_axis
(x, target_dim=3)
modeling/pi3/utils/basic.py:373
↓ 2 callersFunctionrotate_target_dim_to_last_axis
(x, target_dim=3)
eval_code/recons/models/pi3/utils/basic.py:133
↓ 2 callersFunctionsample_features4d
r"""Sample spatial features `sample_features4d(input, coords)` samples the spatial features :attr:`input` represented by a 4D tensor :math:`(
eval_code/recons/models/vggt/heads/track_modules/utils.py:196
↓ 2 callersFunctionsave_depth_maps
(depth_maps: torch.Tensor, path: str, conf_self: Optional[torch.Tensor] = None)
eval_code/recons/videodepth/utils.py:15
↓ 2 callersFunctionsave_image_grid_auto
images: np.ndarray of shape (N, H, W, 3) in [0, 255] or torch.Tensor of shape (N, 3, H, W) in range [0, 1]
eval_code/recons/utils/vis_utils.py:25
↓ 2 callersFunctionsave_latest_checkpoints
Keeps only the latest 'keep_latest' checkpoints in ckpt_dir. Assumes checkpoint folders are named with step numbers like 0001000/.
train/fsdp_utils.py:45
↓ 2 callersFunctionsave_ply_visualization_cpu_batch
Saves a PLY visualization of the world points and images. Args:
data/dataset_utils_vggt.py:554
↓ 2 callersFunctionsave_tum_poses
(traj, path, verbose=False)
eval_code/recons/relpose/evo_utils.py:78
↓ 2 callersFunctionse3_to_relative_pose_error
(pred_se3, gt_se3, num_frames)
eval_code/recons/relpose/metric.py:128
↓ 2 callersMethodseek
(self, offset: int, whence: int = 0)
eval_code/recons/models/moge/utils/webfile.py:38
↓ 2 callersMethodset_random_aspect_ratio
(self, num)
data/recon_dataset.py:175
↓ 2 callersMethodset_random_image_num
(self, num)
data/recon_dataset.py:171
↓ 2 callersMethodset_step_rng
(self, rng)
data/recon_dataset.py:178
↓ 2 callersFunctionslice_expand_and_flatten
Processes specialized tokens with shape (1, 2, X, C) for multi-frame processing: 1) Uses the first position (index=0) for the first frame onl
eval_code/recons/models/vggt/models/aggregator.py:308
↓ 2 callersFunctionsliding_window_1d
Return x view of the input array with x sliding window of the given kernel size and stride. The sliding window is performed over the given ax
eval_code/recons/models/moge/utils3d/numpy/utils.py:43
↓ 2 callersFunctionsliding_window_2d
(x: np.ndarray, window_size: Union[int, Tuple[int, int]], stride: Union[int, Tuple[int, int]], axis: Tuple[int
eval_code/recons/models/moge/utils3d/numpy/utils.py:72
↓ 2 callersFunctionsmart_resize
Rescales the image so that the following conditions are met: 1. Both dimensions (height and width) are divisible by 'factor'. 2. The total n
modeling/qwen2vl/image_processing_qwen2_vl.py:56
↓ 2 callersFunctionsolve_optimal_focal_shift
Solve `min |focal * xy / (z + shift) - uv|` with respect to shift and focal
eval_code/recons/models/moge/utils/geometry_numpy.py:79
↓ 2 callersFunctionsolve_optimal_shift
Solve `min |focal * xy / (z + shift) - uv|` with respect to shift
eval_code/recons/models/moge/utils/geometry_numpy.py:99
↓ 2 callersFunctionsplit_batch_fwd
(fn: Callable, chunk_size: int, *args, **kwargs)
modeling/pi3/utils/alignment.py:23
↓ 2 callersFunctionsplit_batch_fwd
(fn: Callable, chunk_size: int, *args, **kwargs)
eval_code/recons/models/moge/utils/alignment.py:23
↓ 2 callersFunctionstandardize_quaternion
Convert a unit quaternion to a standard form: one in which the real part is non negative. Args: quaternions: Quaternions with re
modeling/g2vlm/rotation_utils.py:383
↓ 2 callersMethodto_tensor
(self, sequence_status)
data/dataset_base.py:236
← previousnext →201–300 of 2,118, ranked by callers