Extract content inside the last \boxed in LaTeX text

extract output between ```output\n...\n```, use regex, there might be multiple outputs, each output may have multiple lines

Fold a batch dim from [bsz, xxx] into [new_bsz, bsz // new_bsz, xxx]

Groups problems by contest ID (including problem letters like A1) into a list of tuples.

We assume: - The model takes input: (input_ids, attention_mask, position_ids). No rmpad for the input - The communication sha

Gather the label from data. The value in label should be [0, vocab_size) Args: data: (..., vocab_size) label (torch.IntTensor) :

Generate ground truth response given a prompt.

Extract benchmark name from path

Get corresponding jsonl file path

Return a local temp path that joins cache_dir and basename of hdfs_path Args: hdfs_path: cache_dir: Returns:

Note that here we only asks execute_all and execute_rank_zero to be implemented Leave the choice of how these two functions handle argument '

Get or create thread-local tokenizer

Get ulysses sequence parallel rank.

Compute the response log_probs from full logits. Note that logits = model(input_ids) Args: input_ids: [batch_size, seqlen] lo

Compute the log_probs from logits with rmpad logits and pad input. Note that logits_rmpad = model(input_ids_rmpad). For each sentences, there is a