allgather params of all pp ranks. Return a list of handles

This function should return a class instance that delegates the calls to every cls in cls_dict

Converts a string to a sequence of ids (integer), using the tokenizer and vocabulary. Args: text (`str`, `List[str]` or

Args: input_ids: input ids. shape (batch_size, seq_length) attention_mask: attention_mask. shape (batch_size, seq_le

Args: input_ids: input ids. shape (batch_size, seq_length) attention_mask: attention_mask. shape (batch_size, seq_le

We assume: - The model takes input: (input_ids, attention_mask, position_ids). No rmpad for the input - The communication sha

Get all the parameters of the models in all pp ranks Returns: params: List[List[Dict[str, Tensor]]]: a list of parameters in all

get order of seq lengths to make partitions balanced, this is used in balacing sum of seqlength across dp ranks and microbatches Paramete

Return a dictionary containing name to a shape and dtype.

The answer will be considered correct if: (a) it normalizes to the same string as the ground truth answer OR (b) sympy can simplify t

load all model params to cuda

Compute the log_probs from logits with rmpad input_ids and logits. Note that logits_rmpad = model(input_ids_rmpad). For each sentences, there is a

A memory efficient implementation of logprobs_from_logits

Make minibatch iterator for updating the actor Args: data (DataProto): a DataProto containing keys ``input_ids``

r"""Works like os.makedirs() but supports hdfs. Super-mkdir; create a leaf directory and all intermediate ones. Works like mkdir, except tha

Exact match of math if and only if: 1. numerical equal: both can convert to float and are equal 2. symbolic equal: both can convert to sy

Normalize the pp vpp params into a complete named parameters. This is useful when gather parameters from pp ranks and passed to a model witho

AllGather data from sp region This is because the data is first sharded along the FSDP dimension as we utilize the DP_COMPUTE

This is the equivalent of torch.repeat_interleave(x, dim=1, repeats=n_rep). The hidden states go from (batch, num_key_value_heads, seqlen, he

spawn to a dictionary of worker groups, each with a subset of method with prefix.

Split the elements in a tuple/interval, while handling well-formatted commas in large numbers

Update the policy with an iterator of DataProto Args: data (DataProto): an iterator over the DataProto that returns by

verify the batch and save as ``acc`` tensor