Return if the caller is main. Equilavent to ``__name__ == '__main__'``.

Evaluate multiple answer pairs concurrently using LLM

Evaluate a single pair of answers using LLM

Load a LoRA adapter with the specified name and path

Load a LoRA adapter with the specified name and path

Parse a Python assert statement and extract the expected output from the right side of the '==' operator as a string. :param statement:

starter_code : str

Parse the query plan response to extract sub-queries

发送URL列表到解析服务器并获取解析结果 Args: urls: 需要解析的URL列表 Returns: 解析结果列表

Process a single sequence through its entire reasoning chain with MAX_TOKENS limit

Process a single question through RAG pipeline

Process a single sequence through its entire reasoning chain

Process a single sequence through its entire reasoning chain with MAX_TOKENS limit

Forces all other calls to return False. Equilavent of a ``break`` statement.

This disables various destructive functions and prevents the generated code from interfering with the test (e.g. fork bomb, killing other pro

This disables various destructive functions and prevents the generated code from interfering with the test (e.g. fork bomb, killing other pro

Run the model for a single prompt and return the output Static method to be used in multiprocessing Calls the _run_single met

Args: func: The function to run. The function must accept a single argument. tasks: A list of tasks i.e. arguments to func.

Args: func: The function to run. The function must accept a single argument. tasks: A list of tasks i.e. arguments to func.

if test(generated_code) is not None it'll try to run the code. otherwise it'll just return an input and output pair.

Unload a LoRA adapter with the specified name

Unload a LoRA adapter with the specified name

初始化Web解析器客户端 Args: base_url: API服务器的基础URL，默认为本地测试服务器

初始化Web解析器客户端 Args: base_url: API服务器的基础URL，默认为本地测试服务器

初始化速率限制器 Args: rate_limit: 在时间窗口内允许的最大请求数 time_window: 时间窗口大小(秒)，默认60秒