MCPcopy Create free account

hub / github.com/EGalahad/vla-scratch / functions

Functions336 in github.com/EGalahad/vla-scratch

↓ 12 callersFunctionapply_checkpoint_when_training
( module: torch.nn.Module, func, *args, preserve_rng_state: bool = False, disable: bool =
vla_scratch/policies/utils/training.py:49
↓ 9 callersMethodencode
( self, observation: "Observation", *, extra_embs: Optional[torch.Tensor] = No
vla_scratch/policies/modules/vlm_bridge/base.py:36
↓ 9 callersFunctionto_mb
(num_bytes: int)
vla_scratch/helpers/training.py:519
↓ 8 callersFunctioncreate_dataset
Create a dataset pipeline applying configured transforms.
vla_scratch/helpers/data.py:94
↓ 8 callersMethodinstantiate
(self, *args, **kwargs)
vla_scratch/datasets/config.py:24
↓ 8 callersFunctionquat_from_angle_axis
Convert rotations given as angle-axis to quaternions. Args: angle: The angle turned anti-clockwise in radians around the vector's directi
vla_scratch/utils/math.py:516
↓ 7 callersFunctionfind_latest_checkpoint
Resolve a checkpoint path to a concrete checkpoint location. Supports checkpoint directories (checkpoint_*/model.pt) and hf: paths. Returns:
vla_scratch/utils/checkpoint.py:55
↓ 7 callersFunctionfully_shard_layers
( layers: Iterable["torch.nn.Module"], mesh, mp_policy, num_to_prefetch: int = 2, )
vla_scratch/policies/utils/training.py:34
↓ 6 callersMethod__init__
( self, hidden_size: int, intermediate_size: int, activation: str )
vla_scratch/policies/modules/action_expert/cross_attention_dit.py:84
↓ 6 callersFunctionapply_rotary_pos_emb
( q: torch.Tensor, k: torch.Tensor, cos: torch.Tensor, sin: torch.Tensor, *, unsqueeze
vla_scratch/policies/utils/transformers.py:14
↓ 6 callersFunctionquat_mul
Multiply two quaternions together. Args: q1: The first quaternion in (w, x, y, z). Shape is (..., 4). q2: The second quaternion i
vla_scratch/utils/math.py:535
↓ 5 callersFunction_add_dtype_bytes
( dtype_bytes: dict[torch.dtype, int], dtype: torch.dtype, num_bytes: int )
vla_scratch/helpers/training.py:421
↓ 5 callersMethodclose
(self)
vla_scratch/utils/serving/zmq_policy_server.py:86
↓ 5 callersMethodforward
(self, x: torch.Tensor)
vla_scratch/policies/modules/action_expert/cross_attention_dit.py:95
↓ 5 callersFunctionmake_att_2d_masks
( pad_masks: at.Bool[torch.Tensor, " b n"], # noqa: F722 att_masks: at.Bool[torch.Tensor, " b n"], #
vla_scratch/policies/utils/transformers.py:55
↓ 5 callersFunctionmake_transforms
Instantiate transform specs into concrete transform objects.
vla_scratch/helpers/data.py:49
↓ 4 callersFunction_format_dtype_bytes
(dtype_bytes: dict[torch.dtype, int])
vla_scratch/helpers/training.py:482
↓ 4 callersFunctionload_model_from_checkpoint
Load a checkpoint into `model`. `path` is a checkpoint directory containing `model.pt`, or a direct path to `model.pt`. Returns (missing_keys
vla_scratch/utils/checkpoint.py:133
↓ 4 callersFunctionquat_conjugate
Computes the conjugate of a quaternion. Args: q: The quaternion orientation in (w, x, y, z). Shape is (..., 4). Returns: The
vla_scratch/utils/math.py:220
↓ 4 callersMethodreset
(self)
scripts/serve_policy.py:166
↓ 3 callersFunction_accumulate_tensor_stats
Return total bytes and float-dtype bytes for a list of tensors.
vla_scratch/helpers/training.py:427
↓ 3 callersFunction_assign_path
(d: Dict[str, Any], path: List[str], value: Any)
vla_scratch/utils/serving/zmq_policy_server.py:223
↓ 3 callersFunction_assign_path
(d: Dict[str, Any], path: List[str], value: Any)
vla_scratch/utils/serving/zmq_policy_client.py:93
↓ 3 callersFunctionaxis_angle_from_quat
Convert rotations given as quaternions to axis/angle. Args: quat: The quaternion orientation in (w, x, y, z). Shape is (..., 4).
vla_scratch/utils/math.py:480
↓ 3 callersMethodcompute
(self, sample: Dict[str, Any])
vla_scratch/transforms/common.py:39
↓ 3 callersMethodcompute_loss
Compute training loss between predicted and target actions.
vla_scratch/policies/base.py:46
↓ 3 callersFunctiondecode
Manual autoregressive decoding loop with explicit KV cache updates.
scripts/generation/test_qwen3vl_generation.py:67
↓ 3 callersFunctiondecode_tokens
Helper to decode a single token tensor.
scripts/generation/test_smolvlm_generation_compare.py:42
↓ 3 callersMethodinfer
(self, obs: Dict[str, Any])
scripts/serve_policy.py:140
↓ 3 callersFunctionload_norm_stats
( data_cfg: "DataConfig", policy_cfg: "PolicyConfig" )
vla_scratch/transforms/normalization.py:97
↓ 3 callersFunctionlocate_class
Import and return a class/function given a fully-qualified path string.
vla_scratch/utils/config.py:7
↓ 3 callersFunctionmatrix_from_quat
Convert rotations given as quaternions to rotation matrices. Args: quaternions: The quaternion orientation in (w, x, y, z). Shape is (...
vla_scratch/utils/math.py:101
↓ 3 callersFunctionnormalize
Normalizes a given input tensor to unit length. Args: x: Input tensor of shape (N, dims). eps: A small value to avoid division by
vla_scratch/utils/math.py:53
↓ 3 callersFunctionprint_with_rank
(string: str)
vla_scratch/helpers/training.py:89
↓ 3 callersFunctionrestore_qwen3vl_forward
()
vla_scratch/policies/modules/vlm_bridge/qwen/utils.py:387
↓ 3 callersFunctionrotation_matrix_to_6d
Project a rotation matrix to the 6D representation (first two rows). Args: rotation: tensor of shape (..., 3, 3) Returns: ten
vla_scratch/utils/math.py:134
↓ 2 callersFunction_cast_float_tensors_to_bfloat16
(obj: Any)
vla_scratch/utils/checkpoint.py:251
↓ 2 callersMethod_cleanup_prev_iter
(self, final=False)
vla_scratch/helpers/training.py:607
↓ 2 callersMethod_cleanup_prev_iter
(self, final=False)
vla_scratch/helpers/training.py:650
↓ 2 callersFunction_compute_norm_stats_for_tensor
(tensor: torch.Tensor)
scripts/compute_norm_stats.py:121
↓ 2 callersFunction_create_dataloader
( *, dataset: torch.utils.data.Dataset, batch_size: int, shuffle: bool, train_cfg: "TrainC
vla_scratch/helpers/training.py:93
↓ 2 callersFunction_decode_raw_message
(frames: List[bytes])
vla_scratch/utils/serving/zmq_policy_client.py:146
↓ 2 callersFunction_encode_raw_message
(msg: Dict[str, Any])
vla_scratch/utils/serving/zmq_policy_client.py:102
↓ 2 callersMethod_find_subsequence
( sequence: list[int], subsequence: list[int] )
vla_scratch/policies/modules/vlm_bridge/smolvlm/processor.py:138
↓ 2 callersFunction_frame_from_obs
(obs: Dict[str, Any])
examples/bbox_cotrain/simulation.py:154
↓ 2 callersFunction_history_components
( sample: Dict, )
vla_scratch/datasets/libero_global/transforms.py:36
↓ 2 callersFunction_image_to_chw
Convert env RGB image (H, W, 3) to CHW float32 in [0, 1].
examples/libero/simulation.py:70
↓ 2 callersFunction_norm_stats_filename
( data_cfg: "DataConfig", policy_cfg: "PolicyConfig" )
vla_scratch/transforms/normalization.py:79
↓ 2 callersMethod_send_to_client
Send a response to a specific client via ROUTER socket.
vla_scratch/utils/serving/zmq_policy_server.py:157
↓ 2 callersFunction_state_from_obs
( obs: Dict[str, Any], )
examples/libero/simulation.py:79
↓ 2 callersMethod_submit_prefetch
(self, epoch_idx: int)
vla_scratch/helpers/training.py:592
↓ 2 callersFunction_token_to_episodes
(token: str)
vla_scratch/datasets/dont_blind/lerobot_dataset.py:57
↓ 2 callersFunction_token_to_episodes
(token: str)
vla_scratch/datasets/bbox_cotrain/dataset.py:57
↓ 2 callersFunctionautoregressive_decode
Manual decoding loop mirroring test_qwen3vl_generation.decode.
scripts/generation/test_smolvlm_generation_compare.py:49
↓ 2 callersFunctionbuild_input_transforms
( data_cfg: "DataConfig", policy_cfg: "PolicyConfig", *, add_noise: bool = False, )
vla_scratch/helpers/data.py:54
↓ 2 callersMethodclose
(self)
vla_scratch/utils/serving/zmq_policy_client.py:28
↓ 2 callersMethodconstruct_suffix_input
Construct SuffixInput from VLMOutputs for caching purposes.
vla_scratch/policies/pi/policy.py:246
↓ 2 callersMethodencode
( self, observation: "Observation", *, extra_embs: Optional[torch.Tensor] = No
vla_scratch/policies/modules/vlm_bridge/smolvlm/bridge.py:85
↓ 2 callersMethodencode
( self, observation: "Observation", *, extra_embs: Optional[torch.Tensor] = No
vla_scratch/policies/modules/vlm_bridge/qwen/bridge.py:87
↓ 2 callersMethodencode_prefix
Do a full inference forward and compute the action (batch_size x num_steps x num_motors)
vla_scratch/policies/pi/policy.py:217
↓ 2 callersFunctioneval_sample_mse
( model: "BasePolicy", dataloader: DataLoader, device: torch.device, local_rank: int, *,
vla_scratch/helpers/training.py:336
↓ 2 callersFunctionget_or_create_dataset
( data_cfg: Any, *, add_noise: bool, )
vla_scratch/helpers/training.py:217
↓ 2 callersMethodget_rope_index
( self, input_ids: Optional[torch.LongTensor] = None, image_grid_thw: Optional[torch.L
vla_scratch/policies/modules/vlm_bridge/qwen/processor.py:232
↓ 2 callersFunctionis_qwen3vl_forward_replaced
()
vla_scratch/policies/modules/vlm_bridge/qwen/utils.py:397
↓ 2 callersFunctionmerge_policy_cfg_from_checkpoint
Merge saved cfg.yaml from a checkpoint run directory into `cfg`. Only `policy` and `data` groups are merged to keep runtime overrides intact.
vla_scratch/utils/checkpoint.py:112
↓ 2 callersFunctionmodulate
( x: torch.Tensor, shift: torch.Tensor, scale: torch.Tensor )
vla_scratch/policies/modules/action_expert/cross_attention_dit.py:53
↓ 2 callersMethodpredict_suffix
Apply one denoising step of `noisy_actions` at a given timestep.
vla_scratch/policies/pi/policy.py:269
↓ 2 callersFunctionprefill
Prefill pass that returns cache, cache_position, attention_mask, and next token.
scripts/generation/test_qwen3vl_generation.py:17
↓ 2 callersFunctionquat_apply_inverse
Apply an inverse quaternion rotation to a vector. Args: quat: The quaternion in (w, x, y, z). Shape is (..., 4). vec: The vector
vla_scratch/utils/math.py:665
↓ 2 callersFunctionrepeat_batch
Repeat a tensor along a new leading dimension then flatten.
vla_scratch/policies/utils/diffusion.py:7
↓ 2 callersFunctionreplace_qwen3vl_forward
()
vla_scratch/policies/modules/vlm_bridge/qwen/utils.py:375
↓ 2 callersFunctionresolve_config_placeholders
Resolve placeholders like '{data.attr}' or '{policy.attr}' in a string/Path. Unknown placeholders are left untouched; only 'data.*' and 'policy.*
vla_scratch/utils/config.py:21
↓ 2 callersFunctionrotate_half
(x: torch.Tensor)
vla_scratch/policies/utils/transformers.py:7
↓ 2 callersMethodsample_actions
Sample actions in evaluation/serving mode.
vla_scratch/policies/base.py:38
↓ 2 callersFunctionsample_noise
(shape, device, dtype)
vla_scratch/policies/utils/diffusion.py:31
↓ 2 callersMethodsend_response
Send a response back to the client. The response is queued and will be sent by the background thread. The client_id is extracted from
vla_scratch/utils/serving/zmq_policy_server.py:72
↓ 2 callersFunctionunscale_transform
De-normalizes a given input tensor from range of [-1, 1] to (lower, upper). .. note:: It uses pytorch broadcasting functionality to deal
vla_scratch/utils/math.py:30
↓ 1 callersMethod__init__
( self, norm_stats: NormStats, *, use_quantiles: bool = True, strict:
vla_scratch/transforms/normalization.py:174
↓ 1 callersMethod__repr__
(self)
vla_scratch/transforms/base.py:9
↓ 1 callersFunction_accumulate_state_stats
Recursively return total bytes and float-dtype bytes for optimizer state.
vla_scratch/helpers/training.py:449
↓ 1 callersMethod_apply_noise
(self, key: str, tensor: torch.Tensor)
vla_scratch/transforms/normalization.py:269
↓ 1 callersFunction_axis_angle_rotation
Return the rotation matrices for one of the rotations about an axis of which Euler angles describe, for each value of the angle given. Args:
vla_scratch/utils/math.py:362
↓ 1 callersFunction_build_bbox_index
Build a (episode_index, frame_index) -> byte offset index for jsonl bboxes. Only stores offsets (and keys) to avoid loading bbox payloads int
vla_scratch/datasets/bbox_cotrain/dataset.py:106
↓ 1 callersFunction_build_env
(args: BboxCotrainEvalConfig)
examples/bbox_cotrain/simulation.py:98
↓ 1 callersMethod_build_obs_register_att_mask
(self, encoded: dict)
vla_scratch/policies/modules/vlm_bridge/smolvlm/processor.py:118
↓ 1 callersMethod_build_obs_register_att_mask
( self, input_ids: torch.LongTensor, attention_mask: torch.Tensor )
vla_scratch/policies/modules/vlm_bridge/paligemma/processor.py:103
↓ 1 callersMethod_build_obs_register_att_mask
(self, encoded: dict)
vla_scratch/policies/modules/vlm_bridge/qwen/processor.py:132
↓ 1 callersFunction_build_policy_sample
( obs: Dict[str, Any], task_description: str, state_buffers: Tuple[ Deque[np.ndarray], Deq
examples/libero/simulation.py:104
↓ 1 callersFunction_ctx
()
vla_scratch/policies/modules/vlm_bridge/smolvlm/utils.py:228
↓ 1 callersFunction_ctx
()
vla_scratch/policies/modules/vlm_bridge/qwen/utils.py:405
↓ 1 callersFunction_dataset_cache_key
(data_cfg: Any, *, add_noise: bool)
vla_scratch/helpers/training.py:191
↓ 1 callersFunction_decode_request
Decode raw multipart request frames into a dict.
vla_scratch/utils/serving/zmq_policy_server.py:164
↓ 1 callersMethod_embed_suffix
Embed state, noisy_actions, timestep to prepare for Expert Gemma processing.
vla_scratch/policies/pi/policy.py:418
↓ 1 callersFunction_encode_reply
Encode a response payload into multipart frames.
vla_scratch/utils/serving/zmq_policy_server.py:232
↓ 1 callersMethod_endpoint
(self)
vla_scratch/utils/serving/zmq_policy_server.py:50
↓ 1 callersFunction_epoch_num_from_name
(name: str)
vla_scratch/utils/checkpoint.py:87
↓ 1 callersFunction_expand_split
Split values can be either lists of episode ids or range strings like \"0:1376\".
vla_scratch/datasets/dont_blind/lerobot_dataset.py:26
↓ 1 callersFunction_expand_split
Split values can be either lists of episode ids or range strings like \"0:1376\".
vla_scratch/datasets/bbox_cotrain/dataset.py:26
↓ 1 callersMethod_find_subsequence
( sequence: list[int], subsequence: list[int] )
vla_scratch/policies/modules/vlm_bridge/paligemma/processor.py:126
↓ 1 callersMethod_find_subsequence
( sequence: list[int], subsequence: list[int] )
vla_scratch/policies/modules/vlm_bridge/qwen/processor.py:152
next →1–100 of 336, ranked by callers