Exact match of math if and only if: 1. numerical equal: both can convert to float and are equal 2. symbolic equal: both can convert to sy

Parse the code function from a string. Args: input_str: A string containing the code function

Parse the last num_inputs inputs and message from a string. Args: input_str: A string containing the inputs and message num_

Parse a Python code snippet into an Abstract Syntax Tree (AST). Args: code_snippet: A string containing Python code

Split the elements in a tuple/interval, while handling well-formatted commas in large numbers

Parameters: * dataset: {None, "HumanEval", "HumanEvalPlus"} * task_id: ralated to dataset * impl: {"canonical", source code} * in

Changed the prompt length of validation set to have another prompt length. Create the train and val dataloader.

Preprocesses the two numbers to have the same length by padding with zeros

Find an available port dynamically

This function uses samples to estimate the accuracy reward for each program, also computes the code complexity and mean edit distance of generated pro

Get or create a ProcessPool with appropriate size

Automatically make a mixed number evalable e.g. 7 3/4 => 7+3/4

Load input/output datasets from JSONL files

Attempts to parse latex to an expression sympy can read.

Evaluates polynomial with coefficients xs at point x. return xs[0] + xs[1] * x + xs[1] * x^2 + .... xs[n] * x^n

This is a hacky function to return some garbages so that we can successfully run the function .

This is a hacky function to return some garbages so that we can successfully run the function .

Save input/output datasets as JSONL files

Recognizes the "height" as the perpendicular distance from the base to the apex of the pyramid

Parses an expression with sympy.

Wait for the Docker container to be ready

Wait for the Docker container to be ready

This function takes two strings containing various "&" characters and transforms them so that the indices of "&" are aligned. This is useful

Calculate the edit distance between two Abstract Syntax Trees. Args: ast1: First AST ast2: Second AST Retur

Backup tokenizer_config.json and remove specified keys.

Calculate average tokens and keyword frequencies in the first code element