Calculate mean values for each key across a list of dictionaries. Args: dict_list: List of dictionaries with numeric values

r"""Merge multiple datasets to a unified dataset.

Rewrite documents using AutoGEO Mini (local model). Args: model_path: Path to the model checkpoint data_dir: Directory contai

r"""Monitorgit the training progress and logs.

r"""Compute ORPO's odds ratio (OR) loss for batched log probabilities of the policy model.

Parse command-line arguments for the e2b_router script. Arguments: --host (str): The hostname or IP address to bind the server to. D

Parse command-line arguments for the morph_router script. Arguments: --host (str): The hostname or IP address to bind the server to.

r"""Freeze vision tower for VLM LoRA tuning.

r"""Implement training loop for the PPO stage, like _inner_training_loop() in Huggingface's Trainer.

r"""Prepare the model before training. Include: (1) cast the layernorm in fp32 (2) make output embedding layer require grads (3) add

r"""Print a data example to stdout.

Pushes the model to branch on a Hub repo.

r"""Read a JSON/JSONL file from cloud storage (S3 or GCS). Args: cloud_path: str Cloud path in the format: - 's3:

r"""Reward function that checks for clear step-by-step reasoning. Regex pattern: Step \d+: - matches "Step 1:", "Step 2:", etc. ^\

r"""Resize token embeddings.

r"""Restore the layernorm parameters in the model. The model is already unwrapped (and gathered).

Rewrite a document using AutoGEO rules. Args: document: Original document text to rewrite dataset: Name of the dataset (Resea

Construct rule candidate data from evaluation results. Args: num_examples: Number of examples to process data_dir: Directory

Executes a submission against a test case using the Piston execution environment. Args: client: PistonClient instance for executing

Save checkpoint for resuming. Args: checkpoint_data: Data to save checkpoint_name: Name of the checkpoint

r"""Save CLI commands to launch training.

r"""Save model predictions to `output_dir`. A custom behavior that not contained in Seq2SeqTrainer.

r"""Save model predictions to `output_dir`. A custom behavior that not contained in Seq2SeqTrainer.

Save individual result and update main file.

Scores a single test case by running the submission against the provided input and output. Args: client: PistonClient instance for e

r"""Find the index of largest number that fits into the knapsack with the given capacity.

r"""Compute SimPO loss for batched log probabilities of the policy model.

r"""Avoid flash attention import error in custom model files.

r"""Split the dataset and returns a dataset dict containing train set and validation set. Support both map dataset and iterable dataset.

r"""Test the SGLang engine's basic chat functionality.

r"""Test the SGLang engine's streaming chat functionality.

r"""Extract all the function calls from the assistant message. It should be an inverse function of `function_formatter`.

r"""Generate the system message describing all the available tools.

r"""Pad batched data to the longest sequence in the batch. We generate 2 * n examples where the first n examples represent chosen examples an

r"""Convert a single example in the dataset to the standard format.

r"""Pad batched data to the longest sequence in the batch.

r"""Ensure server is cleaned up when object is deleted.

Initialize logger. Args: log_dir: Directory to save log files task_name: Name of the task (used in log filena

Initializes the RoutedSandbox with the specified router URL. Args: router_url (str): The URL of the E2B Router.

Initialize the routed MorphCloud sandbox client. Args: router_url: The URL of the MorphCloud router, including host and

Initialize the E2B provider. Args: num_parallel: Number of parallel sandboxes to use e2b_router_url: URL for the E2B

Initialize the Morph provider. Args: num_parallel: Number of parallel executions to use morph_router_url: URL for the

Initialize the MorphCloud execution client. Args: api_key: Optional API key for MorphCloud. If not provided, will use MO

r"""Initialize an inference engine.