Compute variance of tensor with masked values.

计算归一化折扣累积增益（NDCG） :param sorted_docs: 一个列表，表示已经排好序的文档 :param golden_answer_list: 一个列表，表示所有相关文档（golden answers） :return: NDCG 值

Transform the model name in each model_chunk in each pp stage into the name in inference engine

offload params of models that are not of current pp rank to cpu

pad a 2D list (e.g. responses, logprobs) to a 2D tensor.

pad the tokens such that the total length is a multiple of sp world size Args: unpad_tokens: (total_nnz, ...). Tokens after removing padd

从 content 中解析 tool call

Process (text-based) predictions from llm into actions and validity flags. Args: predictions: List of raw predic

处理单个视频，提取帧并转换为 base64 格式的 OpenAI 消息内容。 Returns: base64_content 列表

This disables various destructive functions and prevents the generated code from interfering with the test (e.g. fork bomb, killing other pro

渲染答案卡片

渲染文件标签列表

生成 vis.js 图的 HTML 代码 Args: nodes: [{"id": str, "label": str, "title": str, "color": dict, "shape": str, ...}] edges: [{"

渲染记忆卡片

渲染搜索徽章

渲染侧边栏

渲染思考块

Note that this operation is in-place

重置状态（新问题时调用）

if test(generated_code) is not None it'll try to run the code. otherwise it'll just return an input and output pair.

Call search service API.

Select specific indices from the DataProto. Args: idxs (torch.Tensor or numpy.ndarray or list): Indices to selec

This function sets the global logging format and level. It will be called when import verl

Set input tensor to be used instead of forward()'s input. When doing pipeline parallelism the input from the previous stage comes fro

Set pad_token_id to eos_token_id if it is None. Args: tokenizer (transformers.PreTrainedTokenizer): The tokenizer to be set.

Sets up embedding layer in first stage and output layer in last stage. This function initalizes word embeddings in the final stage when we ar

Slice the DataProto and return a new DataProto object. This is an improved version of direct slicing which returns a DataProtoItem.

Rescales the image so that the following conditions are met: 1. Both dimensions (height and width) are divisible by 'factor'. 2. The total num

Sort the placement groups by node ip, all bundles in a single placement group should be on the same node. FSDPCheckpointManager saves sharde

spawn to a dictionary of worker groups, each with a subset of method with prefix.

Union two tensordicts.

Union two dict. Will throw an error if there is an item not the same object with the same key. Args: dict1: dict2: Returns:

更新节点的 tooltip（摘要）

verify the batch and save as ``acc`` tensor

Compute Categorical entropy loss Args: logits: `(torch.Tensor)` shape: (bs, response_length, vocab_size) eos_mask: `(

Compute entropy when the logits are sharded in tp ranks Args: vocab_parallel_logits: (total_nnz, vocab_size // tp_size) Returns:

We will expand this function gradually based on the available datasets

We will expand this function gradually based on the available datasets

We will expand this function gradually based on the available datasets

Main method to prepare for the model one or several sequences(s) and image(s). This method forwards the `text` and `kwargs` arguments

Enhanced indexing for DataProto objects. Args: item: Can be one of: - int: A single index

Note that we also return the raw_input_ids so that it can be combined with other chat template