Check if the power expression can be computed. Parameters: expr (sympy expression): The expression to check. Returns:

Chat with agent.

判断一个单词是否全部由中文组成 :param word: :return:

Check position bias for judgellm's judgement. Args: judged_answers: The successfully extracted judgement. references: The referen

Check whether the answer solved the query.

Helper function to clean and normalize string data. It strips leading and trailing whitespace and replaces multiple whitespace characters wit

Helper function to clean and normalize string data. It strips leading and trailing whitespace and replaces multiple whitespace characters wit

Clean the units in the number.

Default parameters used in the paper

Download object at the given URL to a local path. Modified from https://pytorch.org/docs/stable/hub.html#torch.hub.download_url_to_file

Estimates pass@k of each problem and returns them in an array.

Estimates pass@k of each problem and returns them in an array.

Estimates pass@k of each problem and returns them in an array.

(默认 expression1 为 Ground_Truth) 函数: 判断两个表达式是否在数学意义上等价 步骤1: 提取表达式, 防止有的模型会给出"x=1"而不是"1" 步骤2: 使用 sympy 库进行等价判断.

Computes the extended tree edit distance between trees A and B with extended-zss algorithm Args: A(Node): Root node of tree 1 B(No

r''' ensure evaluator can work correctly under any data input

r''' ensure evaluator can work correctly under any data input

r''' ensure evaluator can work correctly under any data input

Generate results given a list of inputs. Args: inputs (List[str]): A list of strings. max_out_len (int): The maximum

Generate gradient color for text (darker version)

Generate gradient color

Generate the prompt for one test example in generative evaluation with `prompt_template`. If `prompt_template` is not provided, the `i

For given example, generate four circular examples.

Format command template given available gpu ids.

Get all file paths in the folder with specified extensions.

Returns the keyword args of `build_description`.

Get lengths of the tokenized strings. Args: prompt (str): Input string. Returns: int: Length of the input to

Get lengths of the tokenized strings. Args: prompt (str): Input string. Returns: int: Length of the input to

Get lengths of the tokenized string. Only English and Chinese characters are counted for now. Users are encouraged to override this me

Loads the labeling and accuracy functions dynamically based on the specified task for core metric computation. Parameters: - task: The sp