MCPcopy Create free account

hub / github.com/allenai/molmoact2 / functions

Functions8,779 in github.com/allenai/molmoact2

↓ 1,779 callersMethodappend
(self, bias_module: nn.Module)
experiments/olmo/nn/llm.py:925
↓ 1,018 callersMethodinfo
Processes an 'info' dictionary. Subclasses must implement this method. Args: info: The input 'info' dictionary from the transitio
experiments/lerobot/src/lerobot/processor/pipeline.py:1648
↓ 626 callersMethodget
Get the next action from the queue. Returns: Tensor | None: The next action (action_dim,) or None if queue is empty.
experiments/lerobot/src/lerobot/policies/rtc/action_queue.py:67
↓ 399 callersMethodget
(self, item, rng)
experiments/olmo/data/dataset.py:38
↓ 350 callersMethodto
(self, *args, **kwargs)
experiments/lerobot/tests/async_inference/test_e2e.py:77
↓ 333 callersFunctioncreate_transition
Create an `EnvTransition` dictionary with sensible defaults. Args: observation: Observation dictionary. action: Action dicti
experiments/lerobot/src/lerobot/processor/converters.py:179
↓ 276 callersMethodto
Override to method to ensure all components move together.
experiments/lerobot/src/lerobot/policies/sarm/modeling_sarm.py:465
↓ 220 callersMethodreplace
(self, batch_samples, batch_mask)
experiments/lerobot/src/lerobot/policies/vqbet/vqbet_utils.py:1346
↓ 194 callersMethodget
(self, key: str, default: Any = None)
experiments/olmo/config.py:75
↓ 192 callersMethodvalues
(self)
experiments/lerobot/src/lerobot/motors/calibration_gui.py:214
↓ 166 callersMethodsize
Return the number of cached decoders.
experiments/lerobot/src/lerobot/datasets/video_utils.py:291
↓ 140 callersFunctionresource_path
( folder: PathOrStr, fname: str=None, local_cache: Optional[PathOrStr] = None, progress: Optional[Prog
experiments/olmo/util.py:448
↓ 127 callersMethodadd
Saves a transition, ensuring tensors are stored on the designated storage device.
experiments/lerobot/src/lerobot/rl/buffer.py:190
↓ 123 callersMethodempty
Check if the queue is empty. Returns: bool: True if no actions remain, False otherwise.
experiments/lerobot/src/lerobot/policies/rtc/action_queue.py:93
↓ 110 callersMethodfrom_pretrained
Download the object from the Huggingface Hub and instantiate it. Args: pretrained_name_or_path (`str`, `Path`):
experiments/lerobot/src/lerobot/utils/hub.py:88
↓ 108 callersMethodparameters
Override to return trainable parameters from both models.
experiments/lerobot/src/lerobot/policies/sarm/modeling_sarm.py:622
↓ 102 callersMethodeval
Set evaluation mode for both models.
experiments/lerobot/src/lerobot/policies/sarm/modeling_sarm.py:618
↓ 100 callersMethodextend
(self, n, dim=0)
experiments/olmo/preprocessing/preprocessor_utils.py:54
↓ 95 callersMethodget
Retrieves a processor step class from the registry by its name. Args: name: The name of the step to retrieve. Returns:
experiments/lerobot/src/lerobot/processor/pipeline.py:102
↓ 94 callersFunctionmean_metric
(v)
experiments/olmo/eval/evaluators.py:71
↓ 94 callersMethodupdate
(self, preds: List[str], gts: List[List[str]])
experiments/olmo/eval/evaluators.py:2591
↓ 91 callersMethodwrite
Write a value to a single motor.
experiments/lerobot/src/lerobot/motors/motors_bus.py:87
↓ 84 callersMethodsleep
(self)
examples/yam/gello_min/env.py:15
↓ 81 callersMethodmax
Return the maximum latency or None if empty.
experiments/lerobot/src/lerobot/policies/rtc/latency_tracker.py:54
↓ 80 callersFunctionget_global_rank
()
experiments/olmo/torch_util.py:87
↓ 80 callersFunctionpreprocessor
Fixture to provide the XVLA preprocessor for tests.
experiments/lerobot/tests/policies/xvla/test_xvla_original_vs_lerobot.py:148
↓ 76 callersMethodget
(self, item, rng)
experiments/olmo/data/spatial_datasets.py:261
↓ 72 callersFunctiontransition_to_batch
Convert an `EnvTransition` back to the canonical batch format used in LeRobot. This is the inverse of `batch_to_transition`. Args:
experiments/lerobot/src/lerobot/processor/converters.py:368
↓ 66 callersMethodget
( self, item: int, rng: np.random.Generator, *, normalize_state_action
experiments/olmo/data/lerobot_wrapper.py:2638
↓ 64 callersMethodadd_frame
This function only adds the frame to the episode_buffer. Apart from images — which are written in a temporary directory — nothing is
experiments/lerobot/src/lerobot/datasets/lerobot_dataset.py:1171
↓ 62 callersMethodmerge
Merge new actions into the queue. This method operates differently based on RTC mode: - RTC enabled: Replaces the queue, accounting f
experiments/lerobot/src/lerobot/policies/rtc/action_queue.py:128
↓ 61 callersMethodlog
Log the elapsed time.
experiments/olmo/train/timer.py:224
↓ 61 callersMethodsave_episode
This will save to disk the current episode in self.episode_buffer. Video encoding is handled automatically based on batch_encoding_s
experiments/lerobot/src/lerobot/datasets/lerobot_dataset.py:1225
↓ 59 callersMethodconnect
(self, calibrate: bool = True)
experiments/lerobot/tests/mocks/mock_robot.py:102
↓ 55 callersMethodclear
Clear the cache and close file handles.
experiments/lerobot/src/lerobot/datasets/video_utils.py:284
↓ 55 callersMethodload
Load from a YAML file.
experiments/olmo/config.py:41
↓ 55 callersMethodmax
(*other: 'TensorSpec')
experiments/olmo/preprocessing/preprocessor_utils.py:79
↓ 54 callersMethod__init__
(self, split, task, use_resize=False)
experiments/olmo/data/video_datasets.py:939
↓ 54 callersMethodupdate
(self, val: float, n: int = 1)
experiments/lerobot/src/lerobot/utils/logging_utils.py:39
↓ 52 callersMethoddevice
(self)
experiments/lerobot/src/lerobot/policies/groot/action_head/flow_matching_action_head.py:401
↓ 51 callersMethodcreate
Create a LeRobot Dataset from scratch in order to record data.
experiments/lerobot/src/lerobot/datasets/lerobot_dataset.py:1642
↓ 50 callersFunctionfile_exists
Check if a local or remote file exists. :param path: Path/URL to a file.
experiments/olmo/io.py:333
↓ 49 callersMethodsearch
Given a starting state and a step function, apply beam search to find the most likely target sequences. Returns a tuple of `
experiments/olmo/nn/beam_search.py:1004
↓ 47 callersFunctionget_world_size
Get the world size of the given process group. .. warning:: This will always return 1 if a distributed group has not been initialize
experiments/olmo/torch_util.py:70
↓ 46 callersFunctionread_file
(path: PathOrStr, mode="r")
experiments/olmo/io.py:113
↓ 45 callersMethodpad
( self, x: torch.Tensor, seq_dim: int, value: Union[int, float], lengt
experiments/olmo/nn/cp_load_balancer.py:323
↓ 45 callersMethodsave_pretrained
Saves the pipeline's configuration and state to a directory. This method creates a JSON configuration file that defines the pipeline's struct
experiments/lerobot/src/lerobot/processor/pipeline.py:397
↓ 44 callersMethodstart
(self)
experiments/lerobot/src/lerobot/utils/utils.py:349
↓ 43 callersMethoddevice
(self)
experiments/olmo/models/model.py:171
↓ 42 callersMethoddecode
(frame)
experiments/olmo/data/video_point_tracking_datasets.py:514
↓ 42 callersMethodqsize
Get the number of remaining actions in the queue. Returns: int: Number of unconsumed actions.
experiments/lerobot/src/lerobot/policies/rtc/action_queue.py:82
↓ 41 callersMethodstate_dict
(self)
experiments/lerobot/tests/processor/test_pipeline.py:75
↓ 41 callersMethodupdate
Update the running statistics with a batch of vectors. Args: batch: An array where all dimensions except the last are batch dimen
experiments/lerobot/src/lerobot/datasets/compute_stats.py:48
↓ 40 callersMethodget
(self, idx, rng)
experiments/olmo/data/video_datasets.py:1052
↓ 40 callersFunctionto_tensor
Convert various data types to PyTorch tensors with configurable options. This is a unified tensor conversion function using single dispatch
experiments/lerobot/src/lerobot/processor/converters.py:32
↓ 39 callersMethodsave
Save to a YAML file.
experiments/olmo/config.py:63
↓ 39 callersMethodtrack
Track debug information for a denoising step at a given time. If a step with the given time already exists, it will be updated with the new d
experiments/lerobot/src/lerobot/policies/rtc/debug_tracker.py:125
↓ 38 callersFunctionbarrier
()
experiments/olmo/torch_util.py:169
↓ 38 callersFunctionempty_lerobot_dataset_factory
()
experiments/lerobot/tests/fixtures/dataset_factories.py:557
↓ 38 callersMethodget_timestep
(self)
experiments/lerobot/src/lerobot/async_inference/helpers.py:216
↓ 36 callersMethodfinalize
Close the parquet writers. This function needs to be called after data collection/conversion, else footer metadata won't be written to the pa
experiments/lerobot/src/lerobot/datasets/lerobot_dataset.py:1131
↓ 36 callersFunctionlog_say
(text: str, play_sounds: bool = True, blocking: bool = False)
experiments/lerobot/src/lerobot/utils/utils.py:226
↓ 36 callersMethodnorm
(self, images: Tensor)
experiments/scripts/generate_depth_annotation.py:643
↓ 36 callersFunctionnormalize_path
Normalize a path/URL. :param path: The path/URL to normalize.
experiments/olmo/io.py:40
↓ 36 callersMethodstep
(self, action: np.ndarray)
experiments/lerobot/src/lerobot/envs/libero.py:322
↓ 34 callersFunctiongather_examples_as_html
Builds a HTML table visualization of the predictions
experiments/olmo/eval/evaluators.py:103
↓ 34 callersMethodload
(self)
experiments/olmo/data/video_datasets.py:967
↓ 34 callersMethodload_state_dict
(self, state: dict[str, torch.Tensor])
experiments/lerobot/tests/processor/test_pipeline.py:79
↓ 33 callersMethodencode
(self, x: str)
experiments/olmo/tokenizer.py:135
↓ 33 callersFunctionpolicy_feature_factory
PolicyFeature factory
experiments/lerobot/tests/conftest.py:76
↓ 33 callersMethodsave_pretrained
Save object in local directory. Args: save_directory (`str` or `Path`): Path to directory in which the o
experiments/lerobot/src/lerobot/utils/hub.py:36
↓ 32 callersMethodbackward
(ctx: Any, *grad_output: Tensor)
experiments/olmo/nn/ulysses.py:144
↓ 32 callersMethodconnect
Establish communication with the robot. Args: calibrate (bool): If True, automatically calibrate the robot after connect
experiments/lerobot/src/lerobot/robots/robot.py:125
↓ 31 callersMethoddecode
This method forwards all its arguments to LlamaTokenizerFast's [`~PreTrainedTokenizer.decode`]. Please refer to the docstring of this
experiments/lerobot/src/lerobot/policies/groot/eagle2_hg_model/processing_eagle2_5_vl.py:438
↓ 31 callersFunctionis_url
Check if a path is a URL. :param path: Path-like object to check.
experiments/olmo/io.py:77
↓ 30 callersFunctionis_pixmo_point_and_count_question
Could this question be counting question that the model should use pointing for? This check is conservative, so it will have a high recall
experiments/olmo/preprocessing/detect_counting_question.py:123
↓ 30 callersMethodload
(self)
experiments/olmo/data/dataset.py:121
↓ 29 callersMethodclose
(self)
experiments/lerobot/src/lerobot/envs/libero.py:352
↓ 29 callersFunctionset_seed
Set seed for reproducibility.
experiments/lerobot/src/lerobot/utils/random_utils.py:167
↓ 28 callersMethodclose
Close the encoder, canceling any in-progress episode.
experiments/lerobot/src/lerobot/datasets/video_utils.py:894
↓ 28 callersFunctioninit_logging
Initialize logging configuration for LeRobot. In multi-GPU training, only the main process logs to console to avoid duplicate output. Non-mai
experiments/lerobot/src/lerobot/utils/utils.py:130
↓ 28 callersFunctionmake_pre_post_processors
Create or load pre- and post-processor pipelines for a given policy. This function acts as a factory. It can either load existing processor
experiments/lerobot/src/lerobot/policies/factory.py:220
↓ 27 callersMethoddisconnect
Disconnect from the robot and perform any necessary cleanup.
experiments/lerobot/src/lerobot/robots/robot.py:209
↓ 27 callersFunctionis_counting_question
(question, style=None, check_multi_line=False)
experiments/olmo/preprocessing/detect_counting_question.py:132
↓ 27 callersMethodpush_to_hub
Upload model checkpoint to the Hub. Use `allow_patterns` and `ignore_patterns` to precisely filter which files should be pushed to t
experiments/lerobot/src/lerobot/utils/hub.py:130
↓ 27 callersFunctionwrite_file
Write something to a file in a local or remote directory. :param dir: The path/URL of the directory to write the file to. :param fname:
experiments/olmo/io.py:194
↓ 26 callersFunctionsave_local_dataset
(dataset: datasets.Dataset, name: str, n_procs, n_val=None)
experiments/olmo/data/pixmo_datasets.py:79
↓ 25 callersMethod__init__
( self, dim: int, hidden_dim: int, hidden_act: str, device: Union[str,
experiments/olmo/hf_model/modeling_molmoact2.py:1458
↓ 25 callersFunctionlerobot_dataset_factory
( info_factory, stats_factory, tasks_factory, episodes_factory, hf_dataset_factory, mo
experiments/lerobot/tests/fixtures/dataset_factories.py:468
↓ 25 callersMethodsample
Sample a random batch of transitions and collate them into batched tensors.
experiments/lerobot/src/lerobot/rl/buffer.py:232
↓ 25 callersMethodtrain
Set training mode for both models.
experiments/lerobot/src/lerobot/policies/sarm/modeling_sarm.py:611
↓ 24 callersMethod_check_results
( self, batch_size: int = 5, expected_top_k: Optional[np.array] = None, # type: ignor
experiments/tests/beam_search_test.py:118
↓ 24 callersFunctionnormalize_stage_tau
Normalize stage+tau reward to [0, 1] with custom breakpoints. Maps stage index + within-stage tau to normalized progress [0, 1]. The bre
experiments/lerobot/src/lerobot/policies/sarm/sarm_utils.py:244
↓ 23 callersMethod__init__
( self, in_features, hidden_features=None, out_features=None, act_laye
experiments/lerobot/src/lerobot/policies/xvla/modeling_florence2.py:236
↓ 23 callersMethodstop
(self)
experiments/lerobot/src/lerobot/datasets/image_writer.py:183
↓ 22 callersFunction_tensor_all_finite
(tensor: Optional[torch.Tensor])
experiments/olmo/train/trainer.py:428
↓ 22 callersFunction_warn_annotated_task
( repo_id: str, warning_kind: str, message: str, *args: object, )
experiments/olmo/data/lerobot_wrapper.py:322
↓ 22 callersFunctionimg_tensor_factory
()
experiments/lerobot/tests/fixtures/dataset_factories.py:62
↓ 22 callersFunctionis_pixmo_point_and_count_question
Returns whether the question could be a counting question that would use pointing for This check is conservative by design, so it will have
experiments/olmo/data/detecting_counting_question.py:86
↓ 21 callersFunction_tensor_all_finite
(tensor: Optional[torch.Tensor])
experiments/olmo/nn/action_expert.py:37
next →1–100 of 8,779, ranked by callers