MCPcopy Create free account

hub / github.com/allenai/molmoact2 / functions

Functions8,779 in github.com/allenai/molmoact2

↓ 21 callersMethodapply
( self, state: ConstraintStateType, class_log_probabilities: torch.Tensor, )
experiments/olmo/nn/beam_search.py:673
↓ 21 callersFunctioncreate_dummy_state
()
experiments/lerobot/tests/utils/test_replay_buffer.py:100
↓ 21 callersMethodencode
Encodes an observation into its latent representation.
experiments/lerobot/src/lerobot/policies/tdmpc/modeling_tdmpc.py:605
↓ 21 callersMethodselect_action
Select action for inference/evaluation
experiments/lerobot/src/lerobot/policies/sac/modeling_sac.py:84
↓ 20 callersMethod__init__
(self, config)
experiments/lerobot/src/lerobot/policies/wall_x/qwen_model/qwen2_5_vl_moe.py:692
↓ 20 callersMethodbuild
(self, cache, device=None)
experiments/olmo/nn/llm.py:651
↓ 20 callersMethodfrom_pretrained
(cls, pretrained_model_name_or_path: str, **kwargs)
experiments/lerobot/src/lerobot/policies/groot/groot_n1.py:344
↓ 20 callersMethodget_all_steps
Get all recorded debug steps. Returns: List of all DebugStep objects (may be empty if disabled).
experiments/lerobot/src/lerobot/policies/rtc/debug_tracker.py:218
↓ 20 callersMethodreset_parameters
(self)
experiments/olmo/nn/llm.py:751
↓ 20 callersFunctionsplit_into_groups
partition `lst` into that the mininal number of groups that as evenly sized as possible and are at most `max_group_size` in size
experiments/olmo/util.py:246
↓ 20 callersMethodto
Moves the processor's normalization stats to the specified device. Args: device: The target PyTorch device. Ret
experiments/lerobot/src/lerobot/processor/normalize_processor.py:135
↓ 20 callersMethodtype
(self)
experiments/lerobot/src/lerobot/envs/configs.py:52
↓ 20 callersMethodwrite_calibration
Write calibration parameters to the motors.
experiments/lerobot/src/lerobot/motors/motors_bus.py:117
↓ 19 callersFunctioncreate_dummy_action
()
experiments/lerobot/tests/utils/test_replay_buffer.py:152
↓ 19 callersFunctionfind_stage_and_tau
Find stage and within-stage progress (tau) for a frame. Args: current_frame: Frame index relative to episode start episode_length
experiments/lerobot/src/lerobot/policies/sarm/sarm_utils.py:24
↓ 19 callersMethodread_latest
Return the most recent frame captured immediately (Peeking). This method is non-blocking and returns whatever is currently in the mem
experiments/lerobot/src/lerobot/cameras/camera.py:153
↓ 19 callersMethodsave
Save model, optim, and other training state to a local or remote directory.
experiments/olmo/train/checkpointer.py:257
↓ 19 callersMethodsync_read
Read a value from multiple motors.
experiments/lerobot/src/lerobot/motors/motors_bus.py:92
↓ 19 callersMethodwrite
Builds a "Write" instruction. The parameters for Write are: param[0] = start_address L param[1] = start_
experiments/lerobot/tests/mocks/mock_feetech.py:112
↓ 18 callersMethod_get_repo_id
(self)
experiments/olmo/data/lerobot_wrapper.py:1849
↓ 18 callersFunction_tensor_max_abs
(tensor: Optional[torch.Tensor])
experiments/olmo/nn/action_expert.py:43
↓ 18 callersMethodreset
(self)
experiments/lerobot/tests/processor/test_pipeline.py:83
↓ 18 callersFunctionselect_checkpoint
returns the latest is checkpoint directory in `checkpoint`, returns `checkpoint` if it is already a checkpoint dir
experiments/olmo/util.py:717
↓ 17 callersMethod_is_comm_success
(self, comm: int)
experiments/lerobot/src/lerobot/motors/motors_bus.py:446
↓ 17 callersFunction_to_serializable
(value: Any)
experiments/olmo/data/robot_processing.py:30
↓ 17 callersMethoddisable_torque
Disable torque on selected motors.
experiments/lerobot/src/lerobot/motors/motors_bus.py:107
↓ 17 callersMethodforward
Compute the loss for the given model Args: batch: Dictionary containing: - action: Action tensor
experiments/lerobot/src/lerobot/policies/sac/modeling_sac.py:139
↓ 17 callersMethodget_lr
(self, initial_lr: float, step: int, max_steps: int, group_name: str=None)
experiments/olmo/train/optim.py:326
↓ 17 callersFunctionimg_array_factory
()
experiments/lerobot/tests/fixtures/dataset_factories.py:70
↓ 17 callersFunctionprecise_sleep
Wait for `seconds` with better precision than time.sleep alone at the expense of more CPU usage. Parameters: - seconds: duration to wa
experiments/lerobot/src/lerobot/utils/robot_utils.py:19
↓ 17 callersMethodread
Capture and return a single frame from the camera synchronously. This is a blocking call that will wait for the hardware and its SDK.
experiments/lerobot/src/lerobot/cameras/camera.py:111
↓ 17 callersMethodwrite
Write a value to a single motor. Positions are always in degrees. Can write 'Goal_Position', 'Kp', or 'Kd'.
experiments/lerobot/src/lerobot/motors/damiao/damiao.py:618
↓ 16 callersFunction_to_array
(x)
experiments/olmo/data/robot_processing.py:11
↓ 16 callersMethod_write
( self, addr: int, length: int, motor_id: int, value: int, *,
experiments/lerobot/src/lerobot/motors/motors_bus.py:1083
↓ 16 callersFunctionaggregate_pipeline_dataset_features
Aggregates and filters pipeline features to create a dataset-ready features dictionary. This function transforms initial features using the
experiments/lerobot/src/lerobot/datasets/pipeline_features.py:67
↓ 16 callersMethodget_action
(self)
experiments/lerobot/tests/mocks/mock_teleop.py:89
↓ 16 callersFunctionget_feature_stats
Compute comprehensive statistics for array features along specified axes. This function calculates min, max, mean, std, and quantiles (1%, 10%, 5
experiments/lerobot/src/lerobot/datasets/compute_stats.py:425
↓ 16 callersFunctionhw_to_dataset_features
Convert hardware-specific features to a LeRobot dataset feature dictionary. This function takes a dictionary describing hardware outputs (like jo
experiments/lerobot/src/lerobot/datasets/utils.py:615
↓ 16 callersFunctionlist_directory
List the contents of a local or remote directory. If ``recurse=False``, only the immediate children of the directory are returned, otherwise
experiments/olmo/io.py:410
↓ 16 callersFunctionload_episodes
(local_dir: Path)
experiments/lerobot/src/lerobot/datasets/utils.py:376
↓ 16 callersFunctionpreprocessor
Fixture to provide the PI0Fast preprocessor for tests.
experiments/lerobot/tests/policies/pi0_fast/test_pi0_fast_original_vs_lerobot.py:184
↓ 16 callersMethodread
(self)
experiments/lerobot/tests/cameras/test_opencv.py:49
↓ 15 callersMethod__init__
( self, split: Literal["train", "val"] = "train", subset: Literal[ "all",
experiments/olmo/data/vixmo_datasets.py:1424
↓ 15 callersMethodclose
Close environment and disconnect robot.
experiments/lerobot/src/lerobot/rl/gym_manipulator.py:293
↓ 15 callersMethodget_timestamp
(self)
experiments/lerobot/src/lerobot/async_inference/helpers.py:213
↓ 15 callersMethodstart
Start the timer.
experiments/olmo/train/timer.py:203
↓ 14 callersFunction_init_linear
(linear: nn.Linear, *, zero: bool = False, scale: float = 1.0)
experiments/olmo/hf_model/modeling_molmoact2.py:102
↓ 14 callersFunction_init_linear
(linear: nn.Linear, *, zero: bool = False, scale: float = 1.0)
experiments/olmo/nn/action_expert.py:25
↓ 14 callersMethod_read
( self, address: int, length: int, motor_id: int, *, num_retry
experiments/lerobot/src/lerobot/motors/motors_bus.py:1015
↓ 14 callersMethod_shape
(self, tensor: torch.Tensor, seq_len: int, bsz: int)
experiments/lerobot/src/lerobot/policies/xvla/modeling_florence2.py:772
↓ 14 callersFunctionapply_keyword_prompt
(prompts, example, rng, keywords=None, dbg=False)
experiments/olmo/models/molmo/data_formatter.py:696
↓ 14 callersMethodbuild_write_stub
( self, address: int, length: int, scs_id: int, value: int, re
experiments/lerobot/tests/mocks/mock_feetech.py:353
↓ 14 callersMethodclose
(self, exit_code: int = 0)
experiments/olmo/train/trainer.py:2682
↓ 14 callersFunctionestimate_num_samples
Heuristic to estimate the number of samples based on dataset size. The power controls the sample growth relative to dataset size. Lower the po
experiments/lerobot/src/lerobot/datasets/compute_stats.py:194
↓ 14 callersFunctionget_fs_local_rank
Get the local rank per filesystem, meaning that, regardless of the number of nodes, if all ranks share the same filesystem then `get_fs_local_rank
experiments/olmo/torch_util.py:125
↓ 14 callersFunctionmake_new_buffer
( write_dir: str | None = None, delta_timestamps: dict[str, list[float]] | None = None )
experiments/lerobot/tests/datasets/test_online_buffer.py:32
↓ 14 callersFunctionrecord_loop
( robot: Robot, events: dict, fps: int, teleop_action_processor: RobotProcessorPipeline[
experiments/lerobot/src/lerobot/scripts/lerobot_record.py:280
↓ 14 callersMethodreset
Reset environment to initial state. Args: seed: Random seed for reproducibility. options: Additional reset options.
experiments/lerobot/src/lerobot/rl/gym_manipulator.py:223
↓ 14 callersMethodreset_parameters
(self)
experiments/olmo/nn/image_vit.py:291
↓ 14 callersMethodrun
(self)
experiments/lerobot/src/lerobot/cameras/zmq/image_server.py:125
↓ 14 callersMethodupdate_chunk_settings
Update chunk and file size settings after dataset creation. This allows users to customize storage organization without modifying the constru
experiments/lerobot/src/lerobot/datasets/lerobot_dataset.py:441
↓ 13 callersMethod__init__
(self, split, multi_question=False, sample=None)
experiments/olmo/data/academic_datasets.py:107
↓ 13 callersFunction_checkpoint_debug_log
(stage: str, **fields)
experiments/olmo/train/checkpoint_loading.py:55
↓ 13 callersMethod_get_motor_name
Get motor name from name or ID.
experiments/lerobot/src/lerobot/motors/robstride/robstride.py:970
↓ 13 callersFunction_to_text
(value: Any)
experiments/lerobot/src/lerobot/policies/molmoact2/modeling_molmoact2.py:77
↓ 13 callersMethodadd_data
Add new data to the buffer, which could potentially mean shifting old data out. The new data should contain all the frames (in order) of any
experiments/lerobot/src/lerobot/datasets/online_buffer.py:167
↓ 13 callersFunctionadd_features
Add multiple features to a LeRobotDataset in a single pass. This is more efficient than calling add_feature() multiple times, as it only copi
experiments/lerobot/src/lerobot/datasets/dataset_tools.py:379
↓ 13 callersMethodconfigure_motors
Write implementation-specific recommended settings to every motor. Typical changes include shortening the return delay, increasing ac
experiments/lerobot/src/lerobot/motors/motors_bus.py:625
↓ 13 callersMethodfeed_frame
Feed a frame to the encoder for a specific camera. A copy of the image is made before enqueueing to prevent race conditions with came
experiments/lerobot/src/lerobot/datasets/video_utils.py:786
↓ 13 callersMethodfrom_dict
Create a RobotClientConfig from a dictionary.
experiments/lerobot/src/lerobot/async_inference/configs.py:190
↓ 13 callersMethodget
(self, idx, rng)
experiments/olmo/data/video_object_tracking_datasets.py:780
↓ 13 callersMethodget
(self, item, rng)
experiments/olmo/data/academic_datasets_manual.py:136
↓ 13 callersMethodgetTxRxResult
(self, result)
experiments/lerobot/src/lerobot/motors/motors_bus.py:214
↓ 13 callersMethodget_vlm_model
(self)
experiments/lerobot/src/lerobot/policies/smolvla/smolvlm_with_expert.py:135
↓ 13 callersFunctionget_world_size
Get the world size of the default distributed process group. .. warning:: This will always return 1 if a distributed group has not b
experiments/olmo/dist_util.py:396
↓ 13 callersFunctionmake_policy_config
Instantiates a policy configuration object based on the policy type. This factory function simplifies the creation of policy configuration o
experiments/lerobot/src/lerobot/policies/factory.py:145
↓ 13 callersFunctionmake_spoof_data_frames
(n_episodes: int, n_frames_per_episode: int)
experiments/lerobot/tests/datasets/test_online_buffer.py:47
↓ 13 callersMethodmodel
(self, batch)
experiments/lerobot/tests/async_inference/test_e2e.py:80
↓ 13 callersFunctionreceive_bytes_in_chunks
(iterator, queue: Queue | None, shutdown_event: MpEvent, log_prefix: str = "")
experiments/lerobot/src/lerobot/transport/utils.py:73
↓ 13 callersMethodsample_noise
(self, shape, device)
experiments/lerobot/src/lerobot/policies/pi0/modeling_pi0.py:628
↓ 13 callersMethodsave_image
( self, image: torch.Tensor | np.ndarray | PIL.Image.Image, fpath: Path, compress_level: int = 1 )
experiments/lerobot/src/lerobot/datasets/image_writer.py:172
↓ 13 callersMethodupdate
Update controller state - call this once per frame.
experiments/lerobot/src/lerobot/teleoperators/gamepad/gamepad_utils.py:55
↓ 13 callersFunctionupdate_chunk_file_indices
(chunk_idx: int, file_idx: int, chunks_size: int)
experiments/lerobot/src/lerobot/datasets/utils.py:97
↓ 12 callersMethod__init__
( self, in_features: int, hidden_features: int | None = None, out_features: in
experiments/scripts/generate_depth_annotation.py:106
↓ 12 callersMethod__init__
(self, split: str = "train", sample: int = None, keep_in_memory: bool = False)
experiments/olmo/data/spatial_datasets.py:212
↓ 12 callersMethod__init__
(self, config: LlmConfig, cache, device)
experiments/olmo/nn/llm.py:723
↓ 12 callersMethod_bus
(self)
experiments/lerobot/src/lerobot/motors/robstride/robstride.py:168
↓ 12 callersFunction_obj_for
Find the first object logged under a given key.
experiments/lerobot/tests/utils/test_visualization_utils.py:75
↓ 12 callersMethodasdict
(self, exclude: Optional[Iterable[str]] = None)
experiments/olmo/config.py:67
↓ 12 callersFunctionassert_contract_is_typed
(features: dict[PipelineFeatureType, dict[str, PolicyFeature]])
experiments/lerobot/tests/conftest.py:85
↓ 12 callersMethodbuild
(cls, scs_id: int, params: list[int], length: int, *args, **kwargs)
experiments/lerobot/tests/mocks/mock_feetech.py:31
↓ 12 callersFunctiondelete_episodes
Delete episodes from a LeRobotDataset and create a new dataset. Args: dataset: The source LeRobotDataset. episode_indices: List o
experiments/lerobot/src/lerobot/datasets/dataset_tools.py:81
↓ 12 callersMethodformat_video_tracks
Format video tracks start_end_only: Only track the first and last point of each object first_object: Only track the first ob
experiments/olmo/preprocessing/point_formatter.py:24
↓ 12 callersMethodget
(self, item, rng)
experiments/olmo/data/pixmo_datasets.py:957
↓ 12 callersFunctionget_address
(model_ctrl_table: dict[str, dict], model: str, data_name: str)
experiments/lerobot/src/lerobot/motors/motors_bus.py:129
↓ 12 callersMethodget_chunk_settings
Get current chunk and file size settings. Returns: Dict containing chunks_size, data_files_size_in_mb, and video_files_size_in_mb
experiments/lerobot/src/lerobot/datasets/lerobot_dataset.py:476
↓ 12 callersFunctionget_last_item_from_queue
(queue: Queue, block=True, timeout: float = 0.1)
experiments/lerobot/src/lerobot/rl/queue.py:25
↓ 12 callersFunctioninit_weights
Initialize weights of a linear or embedding module. :param config: The model config. :param module: The linear or embedding submodule to
experiments/olmo/nn/llm.py:216
↓ 12 callersMethodload
Load model, optim, and other training state from a local or remote checkpoint directory created via :meth:`save()` or :meth:`save_asy
experiments/olmo/train/checkpointer.py:285
↓ 12 callersFunctionmake_act_pre_post_processors
Creates the pre- and post-processing pipelines for the ACT policy. The pre-processing pipeline handles normalization, batching, and device placem
experiments/lerobot/src/lerobot/policies/act/processor_act.py:34
← previousnext →101–200 of 8,779, ranked by callers