Generates a response for the current turn of interaction. Returns a tuple containing: - should_terminate_sequence (bool): Tru

Compute the log probabilities of the given labels under the given logits. Args: logits: Logits of the model (e.g., huggingface Causa

Get the enum for the reduction method of cross entropy.

Get the forward function for given model architecture.

Generate and return an NPU profiler object. Args: contents (list[str]): A list of options to control the collection content,

Get PEFT class from model config. Args: model_config: Model configuration object. bridge: Megatron-Bridge AutoBridge instance.

Get a generator that yields per-tensor parameters and optional peft config. Returns: Generator[tuple[str, torch.Tensor]]

Get rollout worker actor class for colocated and standalone mode.

Gets the position ids for GLM4V in padding-free format. The batch dim has been removed and the input_ids should be a 1D tensor representing a

Get statistics (sync - deprecated, use get_statistics instead)

Create a TensorDict from tensors and non-tensor data. Automatically handles nested structures in lists by converting them to NonTensorStack.

Get ulysses sequence parallel rank.

Init hybrid rollout server, rollout engine and training engine(fsdp/megatron) fused in same process. Args: worker_group: RayWorke

Initialize resource pool manager.

Initialize distributed training workers using Ray backend. Creates: 1. Ray resource pools from configuration 2. Worker groups

判断一个值是否为空： - None - 字符串为纯空白 - 字符串只含 Markdown代码围栏 ```（可能伴随换行、空格）

Check if padding is enabled for the DataProto. Returns: bool: True if padding is enabled, False otherwise.

check if the package version is greater than or equal to the minimum version

Convert a list of dictionaries to a dictionary of lists. Args: list_of_dict: List of dictionaries with same keys Returns:

Load adapter parameters from checkpoint. Loads from Megatron's distributed checkpoint structure: reads from checkpoint_path/mp_rank_{tp:02d}_

Load an FSDP checkpoint for this rank. Downloads and loads: - model and optimizer shards - extra state dict (sch

Load merged state_dict to sharded Megatron module in training.

Compute the log_probs from logits with rmpad input_ids and logits. Note that logits_rmpad = model(input_ids_rmpad). For each sentences, there is a

Make minibatch iterator for updating the actor Args: data (DataProto): a DataProto containing keys ``input_ids``

End a mark range in the profiler. Args: range_id (str): The id of the mark range to end.

Start a mark range in the profiler. Args: message (str, optional): The message to be displayed in the profiler. Defaults to N

Exact match of math if and only if: 1. numerical equal: both can convert to float and are equal 2. symbolic equal: both can convert to sy

Convert a MCP Tool to an OpenAI ChatCompletionTool.

Generate an MD5 hash of a path string. This function is used to create unique identifiers for paths, typically for creating cache directories

Given a config, do we need critic.

Normalize a final answer to a quantitative reasoning question. This code comes from https://arxiv.org/pdf/2206.14858.pdf, page18.

Transform the model name in each model_chunk in each pp stage into the name in inference engine

Offload.

On group commit forward.

pad a 2D list (e.g. responses, logprobs) to a 2D tensor.

pad a 2D tensors (e.g. responses, logprobs) in the last dim to max_seq_length. input shape: [bs, seq_length] output shape: [bs, max_seq_l

Pad the DataProto by concating with padding_candidate.repeat(padding_size) Args: padding_size (int): the number of repeated paddi

postprocess the output of a forward_backward_batch. output_lst is a list of dict containing outputs for each micro-batch reorder entropy and o

_summary_ For fused kernels, the output is a dictionary with keys like 'log_probs', 'entropy', etc. This function post-processes each tensor i

Postprocess packed sequences