Build the parameter buffer in each pp rank

Stop the finished sequences.

This function should only be called inside by WorkerGroup

Detect which version of robotwin to use based on config

hdfs capable to check whether a file_path is exists

Expands attention_mask from `[bsz, seq_len]` to `[bsz, 1, tgt_seq_len, src_seq_len]`.

Expands attention_mask from `[bsz, seq_len]` to `[bsz, 1, tgt_seq_len, src_seq_len]`.

micro_batch: Returns: entropy: # (bs, response_len) log_probs: # (bs, response_len)

Generate minibatch - routes to appropriate implementation based on task suite

Generate minibatch for Libero using multiprocessing

Generate minibatch for Robotwin using threading

Generate one step for OpenVLA-OFT

Generate one step for OpenVLA

Handle syncing of files between current directory and checkpoint. Creates backups if files exist but differ, and copies current versions to

Profiles the memory usage and initializes the KV cache.

Initialize the distributed environment.

Automatically make a mixed number evalable e.g. 7 3/4 => 7+3/4

Make causal mask used for bi-directional self-attention.

Make causal mask used for bi-directional self-attention.

Make minibatch iterator for updating the actor See PPO paper for details. https://arxiv.org/abs/1707.06347

Calculate the mapping of global layer_idx to local layer_idx Returns: layer_map (Dict: int -> tuple(int, int, int)): mapping f

Calculate the mapping of global layer_idx to local layer_idx Returns: layer_map (Dict: int -> tuple(int, int, int)): mapping f

hdfs mkdir

Attempts to parse latex to an expression sympy can read.