MCPcopy Create free account

hub / github.com/allenai/molmoact2 / functions

Functions8,779 in github.com/allenai/molmoact2

↓ 12 callersFunctionmake_policy
Instantiate a policy model. This factory function handles the logic of creating a policy, which requires determining the input and outpu
experiments/lerobot/src/lerobot/policies/factory.py:420
↓ 12 callersFunctionmake_robot_from_config
(config: RobotConfig)
experiments/lerobot/src/lerobot/robots/utils.py:25
↓ 12 callersFunctionmake_sac_pre_post_processors
Constructs pre-processor and post-processor pipelines for the SAC policy. The pre-processing pipeline prepares input data for the model by:
experiments/lerobot/src/lerobot/policies/sac/processor_sac.py:36
↓ 12 callersFunctionmake_tdmpc_pre_post_processors
Constructs pre-processor and post-processor pipelines for the TDMPC policy. The pre-processing pipeline prepares input data for the model by
experiments/lerobot/src/lerobot/policies/tdmpc/processor_tdmpc.py:35
↓ 12 callersFunctionmake_vqbet_pre_post_processors
Constructs pre-processor and post-processor pipelines for the VQ-BeT policy. The pre-processing pipeline prepares input data for the model b
experiments/lerobot/src/lerobot/policies/vqbet/processor_vqbet.py:36
↓ 12 callersMethodpercentile
Return the p-th percentile of recorded times.
experiments/lerobot/src/lerobot/utils/utils.py:397
↓ 12 callersMethodpredict_action
( self, *, processor: Any, images: Any, task: str, state: Any,
experiments/olmo/hf_model/modeling_molmoact2.py:4460
↓ 12 callersFunctionsplit_dataset
Split a LeRobotDataset into multiple smaller datasets. Args: dataset: The source LeRobotDataset to split. splits: Either a dict m
experiments/lerobot/src/lerobot/datasets/dataset_tools.py:144
↓ 12 callersMethodstop
(self)
experiments/lerobot/src/lerobot/utils/utils.py:353
↓ 12 callersFunctionstyle_uses_depth_output
(style: Optional[str])
experiments/olmo/extra_tokens.py:356
↓ 11 callersMethod__init__
( self, input_dim: int, hidden_dims: list[int], activations: Callable[[torch.T
experiments/lerobot/src/lerobot/policies/sac/modeling_sac.py:643
↓ 11 callersFunction_clone_static_tensor
(tensor: Optional[torch.Tensor])
experiments/olmo/hf_model/inference.py:645
↓ 11 callersFunction_flatten_batch_dim
(x: torch.Tensor)
experiments/olmo/nn/flash_attention_api.py:19
↓ 11 callersFunction_get_env_bool
(name: str, default: bool = False)
experiments/olmo/data/lerobot_wrapper.py:706
↓ 11 callersFunction_get_s3_client
(scheme: str)
experiments/olmo/io.py:774
↓ 11 callersFunction_normalize_state_keys
( value: Optional[Iterable[Any]], *, default: Sequence[str] = ("observation.state",), )
experiments/olmo/data/robot_processing.py:42
↓ 11 callersFunction_require_positive_int
(value: object, *, label: str)
experiments/olmo/data/lerobot_wrapper.py:578
↓ 11 callersFunction_test_tokenization
(messages, n_at_start=None, preprocessor=None)
experiments/tests/data/test_preprocessor.py:17
↓ 11 callersFunction_tiny_config
( enable_depth_reasoning: bool = False, add_action_expert: bool = True, )
experiments/tests/test_hf_model_molmoact2.py:31
↓ 11 callersFunction_to_array
(value: Any)
experiments/olmo/hf_model/modeling_molmoact2.py:874
↓ 11 callersMethodaction
(self, action: RobotAction)
experiments/lerobot/src/lerobot/processor/policy_robot_bridge.py:34
↓ 11 callersMethodbuild_read_stub
( self, address: int, length: int, scs_id: int, value: int, re
experiments/lerobot/tests/mocks/mock_feetech.py:332
↓ 11 callersFunctioncompute_tau
Compute τ_t = (t - s_k) / (e_k - s_k) ∈ [0, 1]. Returns 1.0 for zero-duration subtasks.
experiments/lerobot/src/lerobot/policies/sarm/sarm_utils.py:195
↓ 11 callersFunctioncreate_default_config
Create a default ACT configuration for testing.
experiments/lerobot/tests/processor/test_act_processor.py:39
↓ 11 callersFunctioncreate_default_config
Create a default VQBeT configuration for testing.
experiments/lerobot/tests/processor/test_vqbet_processor.py:39
↓ 11 callersFunctioncreate_default_config
Create a default SAC configuration for testing.
experiments/lerobot/tests/processor/test_sac_processor.py:39
↓ 11 callersFunctioncreate_default_config
Create a default TDMPC configuration for testing.
experiments/lerobot/tests/processor/test_tdmpc_processor.py:39
↓ 11 callersMethoddecode
(self, x: List[int], truncate_at_eos=True)
experiments/olmo/tokenizer.py:138
↓ 11 callersMethoddownload
(cls, n_procs=1)
experiments/olmo/data/dataset.py:25
↓ 11 callersMethoddtype
(self)
experiments/olmo/hf_model/modeling_molmoact2.py:1859
↓ 11 callersMethodget_seq_length
(self, layer_idx: int = 0)
experiments/olmo/hf_model/inference.py:157
↓ 11 callersMethodget_subtask
Extracts the subtask from the transition's complementary data. Args: transition: The environment transition. Re
experiments/lerobot/src/lerobot/processor/tokenizer_processor.py:144
↓ 11 callersFunctioninit_rerun
Initializes the Rerun SDK for visualizing the control loop. Args: session_name: Name of the Rerun session. ip: Optional IP f
experiments/lerobot/src/lerobot/utils/visualization_utils.py:26
↓ 11 callersFunctionmake_classifier_processor
Constructs pre-processor and post-processor pipelines for the reward classifier. The pre-processing pipeline prepares input data for the cla
experiments/lerobot/src/lerobot/policies/sac/reward_model/processor_classifier.py:32
↓ 11 callersFunctionmake_diffusion_pre_post_processors
Constructs pre-processor and post-processor pipelines for a diffusion policy. The pre-processing pipeline prepares the input data for the mo
experiments/lerobot/src/lerobot/policies/diffusion/processor_diffusion.py:35
↓ 11 callersFunctionmodify_tasks
Modify tasks in a LeRobotDataset. This function allows you to either: 1. Set a single task for the entire dataset (using `new_task`) 2. S
experiments/lerobot/src/lerobot/datasets/dataset_tools.py:1404
↓ 11 callersFunctionparse_timestamp
(time_value: Union[str, float])
experiments/olmo/util.py:794
↓ 11 callersMethodplot_waypoints
Plot trajectories across multiple dimensions. This function plots a tensor's values across time for multiple dimensions, with each di
experiments/lerobot/src/lerobot/policies/rtc/debug_visualizer.py:30
↓ 11 callersMethodsetup_motor
Assign the correct ID and baud-rate to a single motor. This helper temporarily switches to the motor's current settings, disables torque, set
experiments/lerobot/src/lerobot/motors/motors_bus.py:576
↓ 11 callersFunctionstyle_uses_action_output
(style: Optional[str])
experiments/olmo/extra_tokens.py:360
↓ 11 callersFunctionuse_threads
(cfg: TrainRLServerPipelineConfig)
experiments/lerobot/src/lerobot/rl/actor.py:733
↓ 11 callersMethodwait_until_done
(self)
experiments/lerobot/src/lerobot/datasets/image_writer.py:180
↓ 10 callersFunction_get_codec_options
Build codec-specific options dict for video encoding.
experiments/lerobot/src/lerobot/datasets/video_utils.py:54
↓ 10 callersMethod_get_motor_recv_id
Return the expected ID found in feedback payload byte0 for this motor. Robstride MIT feedback frames encode an ID in data[0]. Some setups exp
experiments/lerobot/src/lerobot/motors/robstride/robstride.py:980
↓ 10 callersMethod_get_motors_list
Convert motor specification to list of motor names.
experiments/lerobot/src/lerobot/motors/damiao/damiao.py:816
↓ 10 callersFunction_make_obs
Create a TimedObservation with a given state vector.
experiments/lerobot/tests/async_inference/test_policy_server.py:96
↓ 10 callersMethodbuild_sync_read_stub
( self, address: int, length: int, ids_values: dict[int, int], reply:
experiments/lerobot/tests/mocks/mock_feetech.py:373
↓ 10 callersMethodclear_episode_buffer
(self, delete_images: bool = True)
experiments/lerobot/src/lerobot/datasets/lerobot_dataset.py:1585
↓ 10 callersFunctioncombine_feature_dicts
Merge LeRobot grouped feature dicts. - For 1D numeric specs (dtype not image/video/string) with "names": we merge the names and recompute the sha
experiments/lerobot/src/lerobot/datasets/utils.py:742
↓ 10 callersFunctioncreate_default_config
Create a default Diffusion configuration for testing.
experiments/lerobot/tests/processor/test_diffusion_processor.py:39
↓ 10 callersFunctioncreate_default_config
Create a default Reward Classifier configuration for testing.
experiments/lerobot/tests/processor/test_classifier_processor.py:37
↓ 10 callersFunctioncreate_default_stats
Create default dataset statistics for testing.
experiments/lerobot/tests/processor/test_act_processor.py:56
↓ 10 callersFunctioncreate_default_stats
Create default dataset statistics for testing.
experiments/lerobot/tests/processor/test_vqbet_processor.py:58
↓ 10 callersFunctioncreate_default_stats
Create default dataset statistics for testing.
experiments/lerobot/tests/processor/test_sac_processor.py:56
↓ 10 callersFunctioncreate_default_stats
Create default dataset statistics for testing.
experiments/lerobot/tests/processor/test_tdmpc_processor.py:58
↓ 10 callersFunctioncreate_initial_features
Creates the initial features dict for the dataset from action and observation specs. Args: action: A dictionary of action feature na
experiments/lerobot/src/lerobot/datasets/pipeline_features.py:25
↓ 10 callersMethoddenoise_step
RTC guidance wrapper around an existing denoiser. This method wraps an original denoising callable that only takes ``x_t`` and return
experiments/lerobot/src/lerobot/policies/rtc/modeling_rtc.py:116
↓ 10 callersMethodextract_multi_image_points
(self, text, image_w, image_h)
experiments/olmo/preprocessing/point_formatter.py:56
↓ 10 callersMethodfinish_episode
Finish encoding the current episode. Sends sentinel values, waits for encoder threads to complete, and collects results. Ret
experiments/lerobot/src/lerobot/datasets/video_utils.py:827
↓ 10 callersFunctionflatten_dict
(xs, sep=None)
experiments/scripts/prepare_pretrained_model.py:23
↓ 10 callersMethodforward
(self, x: torch.Tensor)
experiments/lerobot/src/lerobot/policies/sac/modeling_sac.py:675
↓ 10 callersMethodforward
(self, x: torch.Tensor)
experiments/lerobot/tests/processor/test_pipeline.py:632
↓ 10 callersMethodget_all_debug_steps
Get all debug steps from tracker. Returns empty list if tracker is disabled or None.
experiments/lerobot/src/lerobot/policies/rtc/modeling_rtc.py:90
↓ 10 callersFunctionget_local_rank
()
experiments/olmo/torch_util.py:94
↓ 10 callersMethodget_video_file_path
(self, ep_index: int, vid_key: str)
experiments/lerobot/src/lerobot/datasets/lerobot_dataset.py:207
↓ 10 callersFunctionhotswap_stats
Replaces normalization statistics in an existing `PolicyProcessorPipeline` instance. This function creates a deep copy of the provided pipel
experiments/lerobot/src/lerobot/processor/normalize_processor.py:535
↓ 10 callersFunctionimage_array_to_pil_image
(image_array: np.ndarray, range_check: bool = True)
experiments/lerobot/src/lerobot/datasets/image_writer.py:41
↓ 10 callersFunctionis_package_available
Check if the package spec exists and grab its version to avoid importing a local directory. Args: pkg_name: The name of the package
experiments/lerobot/src/lerobot/utils/import_utils.py:24
↓ 10 callersMethodmake
(self, builder_id: str, **override_kwargs)
experiments/olmo/registry.py:34
↓ 10 callersFunctionmake_annotation
Helper to create SubtaskAnnotation from list of (name, start_sec, end_sec).
experiments/lerobot/tests/policies/test_sarm_subtask_annotations.py:29
↓ 10 callersFunctionmake_cameras_from_configs
(camera_configs: dict[str, CameraConfig])
experiments/lerobot/src/lerobot/cameras/utils.py:25
↓ 10 callersFunctionmake_env
Makes a gym vector environment according to the config or Hub reference. Args: cfg (EnvConfig | str): Either an `EnvConfig` object descri
experiments/lerobot/src/lerobot/envs/factory.py:102
↓ 10 callersFunctionmake_transform_from_config
(cfg: ImageTransformConfig)
experiments/lerobot/src/lerobot/datasets/transforms.py:218
↓ 10 callersMethodregister_before_step_hook
Registers a function to be called before each step. Args: fn: A callable that accepts the step index and the current transition.
experiments/lerobot/src/lerobot/processor/pipeline.py:1240
↓ 10 callersMethodresolve_tag
(self, repo_id: Optional[str])
experiments/olmo/data/robot_processing.py:359
↓ 10 callersFunctionresolve_vcodec
Validate vcodec and resolve 'auto' to best available HW encoder, fallback to libsvtav1.
experiments/lerobot/src/lerobot/datasets/video_utils.py:101
↓ 10 callersMethodsend_action
(self, action: Tensor)
experiments/lerobot/examples/rtc/eval_with_real_robot.py:121
↓ 10 callersMethodstart_episode
Start encoder threads for a new episode. Args: video_keys: List of video feature keys (e.g. ["observation.images.laptop"])
experiments/lerobot/src/lerobot/datasets/video_utils.py:743
↓ 10 callersMethodstep
Execute one environment step with given action.
experiments/lerobot/src/lerobot/rl/gym_manipulator.py:254
↓ 10 callersFunctionwrite_info
(info: dict, local_dir: Path)
experiments/lerobot/src/lerobot/datasets/utils.py:272
↓ 9 callersMethod__init__
( self, config: ActionExpertConfig, llm_dim: int, llm_kv_dim: Optional[int] =
experiments/olmo/nn/action_expert.py:547
↓ 9 callersMethod_check_cached_episodes_sufficient
Check if the cached dataset contains all requested episodes and their video files.
experiments/lerobot/src/lerobot/datasets/lerobot_dataset.py:900
↓ 9 callersFunction_get_gcs_retry
()
experiments/olmo/io.py:599
↓ 9 callersMethod_get_motor_id
Get CAN ID for a motor.
experiments/lerobot/src/lerobot/motors/robstride/robstride.py:960
↓ 9 callersMethod_get_motor_recv_id
Get motor recv_id from name or ID.
experiments/lerobot/src/lerobot/motors/damiao/damiao.py:847
↓ 9 callersMethod_mask_action_dim_tensor
( cls, tensor: torch.Tensor, *, action_dim_is_pad: Optional[torch.Tensor],
experiments/olmo/models/molmoact2/molmoact2.py:1312
↓ 9 callersMethod_should_suggest_migration
Check if directory has JSON files but no processor configs. This method implements smart migration detection to avoid false positives:
experiments/lerobot/src/lerobot/processor/pipeline.py:1041
↓ 9 callersFunction_to_float_vector
(value: Any)
experiments/scripts/run_open_loop_inference_lerobot.py:194
↓ 9 callersMethodasync_read
Return the most recent new frame. This method retrieves the latest frame captured by the background thread. If a new frame is already
experiments/lerobot/src/lerobot/cameras/camera.py:122
↓ 9 callersMethodbuild_tokenizer
(self)
experiments/olmo/nn/llm.py:654
↓ 9 callersMethodcount
(self)
experiments/lerobot/src/lerobot/utils/utils.py:382
↓ 9 callersFunctioncreate_default_stats
Create default dataset statistics for testing.
experiments/lerobot/tests/processor/test_diffusion_processor.py:58
↓ 9 callersFunctioncreate_default_stats
Create default dataset statistics for testing.
experiments/lerobot/tests/processor/test_classifier_processor.py:56
↓ 9 callersFunctiondeserialize_json_into_object
Loads the JSON data from `fpath` and recursively fills `obj` with the corresponding values (strictly matching structure and types). Tuple
experiments/lerobot/src/lerobot/utils/io_utils.py:34
↓ 9 callersMethoddtype
(self)
experiments/lerobot/src/lerobot/policies/groot/action_head/flow_matching_action_head.py:405
↓ 9 callersFunctionflatten_dict
Flatten a nested dictionary by joining keys with a separator. Example: >>> dct = {"a": {"b": 1, "c": {"d": 2}}, "e": 3} >>> print
experiments/lerobot/src/lerobot/datasets/utils.py:143
↓ 9 callersFunctionformat_big_number
(num, precision=0)
experiments/lerobot/src/lerobot/utils/utils.py:186
↓ 9 callersMethodformat_image_points
Format points for a single image
experiments/olmo/preprocessing/point_formatter.py:41
↓ 9 callersMethodget_observation
(self)
experiments/lerobot/examples/rtc/eval_with_real_robot.py:117
↓ 9 callersFunctionget_openai_key
()
experiments/olmo/eval/evaluators.py:64
← previousnext →201–300 of 8,779, ranked by callers