Calculate the substitution cost between words a and b 计算两个单词替换操作的编辑cost，最大为2，等于一次删除和一次添加

Get lengths of the tokenized strings. Args: prompt (str): Input string. Returns: int: Length of the input to

Get lengths of the tokenized strings. Args: prompt (str): Input string. Returns: int: Length of the input to

Request toxicity scores for PerspectiveAPI. Args: predictions: Text to perform evaluation. Returns: dict: ou

Get evaluation value of a partial output. Args: x (str): The input text to be evaluated. y (str): The partial output

Get evaluation values of partial outputs. Args: x (str): The input text to be solved. ys (List[str]): The partial out

Get votes of partial outputs. Args: x (str): The input text to be solved. ys (List[str]): The partial outputs to be e

Better answer postprocessor for better instruction-aligned models like GPT.

Solve the Traveling Salesman Problem using a greedy algorithm. :param distance_matrix: 2D numpy array where the element at [i, j] is the dist

Identify errors in model responses based on provided items, task, and prompt style. Args: items (list): A list of items containing mo

Import a Python source file and return the loaded module. Args: fname: The full path to the source file. It may container characters

Initialize error identification components. Args: task (str): The task for which error identification components are being initialized.

Function: Check if two intervals are mathematically equivalent Step 1: Simplify interval expressions, remove irreleva

Validates the solution for the KSP instance. :param instance: A dictionary of the KSP instance. :param solution: A dictionary of the

Provides the optimal solution for the KSP instance with dynamic programming. :param knapsacks: A dictionary of the knapsacks.

Launch multiple tasks. Args: tasks (list[dict]): A list of task configs, usually generated by Partitioner.

Launch multiple tasks. Args: tasks (list[dict]): A list of task configs, usually generated by Partitioner.

Load humaneval dataset for pass k mode. Note that you can use num_repeats > 1 when your model does not support `num_return_sequence`

Load whole dataset. Args: path(str): Path of cibench dataset. internet_check(bool): Whether to check internet.

Load humaneval dataset for pass k mode. Note that you can use num_repeats > 1 when your model does not support `num_return_sequence`

Args: path (str): The path to the dataset. local_mode (bool): Whether to use local give path or use a