Expands attention_mask from `[bsz, seq_len]` to `[bsz, 1, tgt_seq_len, src_seq_len]`.

Make causal mask used for bi-directional self-attention.

Make causal mask used for bi-directional self-attention.

Calculate the mapping of global layer_idx to local layer_idx Returns: layer_map (Dict: int -> tuple(int, int, int)): mapping f

Calculate the mapping of global layer_idx to local layer_idx Returns: layer_map (Dict: int -> tuple(int, int, int)): mapping f

hdfs mkdir

For each param, if it is a tp-splited param, we all-gather from micro_dp group.

Build the memory references. The memory buffers are built using the build_memory_buffer API. This API will allocate a weight buffer pointer to the

Calculate the Elo rating for a given contest based on problem status.

Calculate average tokens and keyword frequencies in the first code element

Check the consistency of the DataProto. Mainly for batch and non_tensor_batch We expose this function as a public one so that user can call th

Clean the units in the number.

Only collect the data from the tp=0 and pp=last and every dp ranks

treat pp as dp. Only collect data on tp=0

Computing reward given input_ids. The transformers should output a tensor with shape [batch_size, sequence_length], and the value at [EOS]

Args: model_name: actor_override_config_kwargs: Returns:

name: name of the parameter param: training parameters infer_params (List[torch.Tensor]): a list of parameters all-gathered f

User passes in dp data. The data is dispatched to all tp/pp ranks with the same dp

treat pp as dp.