Extract the last LaTeX boxed expression from a string. Args: string: Input string containing LaTeX code Returns: The last bo

r"""Make an iterator from the DataProto. This is built upon that TensorDict can be used as a normal Pytorch dataset. See https://pytorch.org/t

Make minibatch iterator for updating the actor Args: data (DataProto): a DataProto containing keys ``input_ids``

r"""Works like os.makedirs() but supports hdfs. Super-mkdir; create a leaf directory and all intermediate ones. Works like mkdir, except tha

Exact match of math if and only if: 1. numerical equal: both can convert to float and are equal 2. symbolic equal: both can convert to sy

Normalize a final answer to a quantitative reasoning question. This code comes from https://arxiv.org/pdf/2206.14858.pdf, page18.

convert_qkv_gate_up_by_simple_split is a parameter affected by the vLLM version.

Remove the LaTeX boxed command from a string. Args: s: String with format "\\boxed{content}" Returns: The content inside the

This is the equivalent of torch.repeat_interleave(x, dim=1, repeats=n_rep). The hidden states go from (batch, num_key_value_heads, seqlen, he

This is the equivalent of torch.repeat_interleave(x, dim=1, repeats=n_rep). The hidden states go from (batch, num_key_value_heads, seqlen, he

Set ulysses sequence parallel process group.

Offload model weights and discard kv cache.

spawn to a dictionary of worker groups, each with a subset of method with prefix.

Split the elements in a tuple/interval, while handling well-formatted commas in large numbers

Split the elements in a tuple/interval, while handling well-formatted commas in large numbers

Update the policy with an iterator of DataProto Args: data (DataProto): an iterator over the DataProto that returns by

Verify if the solution is correct. Args: solution_str: The solution string to verify answer: The ground truth answer stri

Binds the methods of each worker to the WorkerDict. Note that we only bind public methods that are decorated by register

broadcast tensor in tp shards across mp_group

broadcast tensor in tp shards across mp_group

broadcast tensor in tp shards across mp_group

broadcast tensor in tp shards across mp_group

broadcast tensor in tp shards across mp_group

broadcast tensor in tp shards across mp_group

broadcast tensor in tp shards across mp_group

broadcast tensor in tp shards across mp_group

broadcast tensor in tp shards across mp_group

broadcast tensor in tp shards across mp_group

broadcast tensor in tp shards across mp_group

Build the parameter buffer in each pp rank

Check if the resource pool can be satisfied in this ray cluster.

Compute various autocorrelation-based features.

Compute change point frequency using sliding window variance method. Args: sequence: 1D entropy sequence window_size: Si

This function should only be called inside by WorkerGroup

Creates the train and validation dataloaders.

- megatron: base class should be MegatronWorker - fsdp: base class should be Worker

hdfs capable to check whether a file_path is exists

Expands attention_mask from `[bsz, seq_len]` to `[bsz, 1, tgt_seq_len, src_seq_len]`.

Expands attention_mask from `[bsz, seq_len]` to `[bsz, 1, tgt_seq_len, src_seq_len]`.

Expands attention_mask from `[bsz, seq_len]` to `[bsz, 1, tgt_seq_len, src_seq_len]`.

fetch gate_up tensor in tp shards

fetch gate_up tensor in tp shards