Evaluate an abstract syntax tree using the content of the variables stored in a state and only evaluating a given set of functions. This

Logs a message to the console. Args: level (LogLevel, optional): Defaults to LogLevel.INFO.

Run the agent for the given task. Args: task (`str`): Task to perform. stream (`bool`): Whether to run in a

Uses the `post_processor` to decode the model output.

Prepare parameters required for model invocation, handling parameter priorities. Parameter priority from high to low: 1. Exp

Uses the `pre_processor` to prepare the inputs for the `model`.

Get the source code of a class or callable object (e.g.: function, method). First attempts to get the source code using `inspect.getsource`. I

Sometimes APIs fail to properly parse a tool call: this function tries to parse.

Convert a function into an instance of a dynamically created Tool subclass. Args: tool_function (`Callable`): Function to convert in

Reads past llm_outputs, actions, and observations or errors from the memory into a series of messages that can be used as input to th

Subsequent messages with the same role will be concatenated to a single message. output_message_list is a list of messages that will be used

Convert the agent to a dictionary representation. Returns: `dict`: Dictionary representation of the agent.

Update total cost and check threshold Args: cost: Cost to add (in USD) Returns:

Helper method to handle generators in all types of comprehensions

Writes content to a file with UTF-8 encoding.

Append result to output file in thread-safe manner Args: result: Result dictionary to append output_file: Path to output

Exact match of math if and only if: 1. numerical equal: both can convert to float and are equal 2. symbolic equal: both can convert to sy

Process a single experiment entry Args: entry: Dictionary containing a question/problem model: Model

Run an experiment with the unified framework - supports both agent and reasoning modes

Returns a dictionary representing the tool

Get the Gradio app code.

Get the requirements.

Get the tool's code.

Calculate cost based on model pricing Args: input_tokens: Number of input tokens output_tokens: Number of output tokens

Calculate the total cost of API calls based on token usage. Returns: dict: Dictionary containing cost information including:

Clean up resources.

Create a model instance for this worker Args: worker_id: ID of the worker thread/process use_local_m

Escapes square brackets in code segments while preserving Rich styling tags.

Sometimes an LLM can try to assign a variable to final_answer, which would break the final_answer() tool. This function fixes this behaviour

Loads a tool defined on the Hub. <Tip warning={true}> Loading a tool from the Hub means that you'll download the tool and e

Get source code for a method, including bound methods.

Creates a safe copy of a module or returns the original if it's a function

Get a footnote string for a step log with duration and token information

To be implemented in child classes

Convert an instance to its class source code representation.

Load dataset from file Args: file_path: Path to dataset file Returns: List of examples

Load a file from the given path. Args: file_path (str): Path to the file. Returns: dataset (list): loaded d

Recursive function to make objects JSON serializable

Compute a canonical form for a mathematical expression using sympy. Uses a shared cache across processes for memoization. Args: