Convert a DuckDB file to Snowflake database.

Copy the database file to sandbox.

Copy migration files to sandbox if migration_directory is specified.

Copy shared project contents to sandbox.

Copy shared scripts to sandbox.

Copy various task files to sandbox.

Copy text to clipboard using pbcopy (macOS) or xclip (Linux).

Create or replace a Snowflake database.

Recursively merge two dictionaries.

Discover DuckDB files in the configured source directory.

Display a detailed summary table of benchmark results.

Dump tables from a DuckDB database to parquet + CSV. Args: db_path: Path to the .duckdb file relations: List of relation names to

Dump tables from Snowflake to parquet + CSV. Uses fetch_pandas_all() and DataFrame.to_parquet()/to_csv() directly. Args: relations:

Execute SQL query against the database.

Export all tables from a DuckDB file to Parquet format. Args: duckdb_path: Path to the DuckDB file output_di

Export entire DuckDB database to Parquet using DuckDB's EXPORT DATABASE command. This is more efficient than exporting tables individ

Export a single table from DuckDB to Parquet format using direct DuckDB export.

Extract task details from task.yaml files and save to TSV. Calls the extract_task_details script to do the work. Args: output_fi

Extract only the JSON lines from a log file that may contain mixed content. The log file may contain terminal output before the JSON

Extract details from all task.yaml files.

Extract deduplicated list of tool names from the agent's log file. This method can be overridden by subclasses to provide agent-spec

Filter files based on include/exclude logic.

Find failing equality tests from run_results.json.

Find the matching variant for the given db_type and project_type.

Format the agent's log file into a human-readable string. This method can be overridden by subclasses to provide agent-specific

Parse and format a log file in one step. Args: log_path: Path to the log file to parse Returns: For

Format message with truncation to 97 characters.

Format the stage name for display.

Format timestamp for display.

Format the parsed turns into a readable text string. Args: turns: List of turn dictionaries from parse_log_file

Format the summary data into a table format for display.

Format tool input parameters nicely.

Determine database type from file extension.

Load a list of terminal commands from a YAML file.

Generate an equality test for a solution seed table. Args: table_name: Name of the table to test config: Optional configuration f

Generate an existence test for a solution seed table. Args: table_name: Name of the table to test Returns: Generated SQL tes

Generate an HTML table of benchmark results with action links.

Generate an HTML transcript using claude-code-transcripts. This method extracts JSON lines from the log file (which may contain

Generate both equality and existence tests for a solution seed table. Args: table_name: Name of the table to generate tests for t

Define the canonical column order for the merged TSV.

Get the path to a specific dbt project directory. Args: project_name: Name of the project directory project_type: Typ

Get DuckDB connection from profiles.yml.

Get the path to a specific DuckDB database file. Args: db_name: Name of the database file (without .duckdb extension)

Return the Jinja macro that implements equality test logic.

Get the path to a specific migration script.

Get all host IDs ordered by ID where IS_SUPERHOST is not null.

Get all host IDs ordered by ID where IS_SUPERHOST is not null.

Get the profile name from project type and db type.

Get Snowflake connection from profiles.yml.

Parse solution_seeds into SolutionSeedConfig objects.

Get the task configuration from task.yaml.

Get unified diff for a specific file.

Initialize the Rich logging system with the list of tasks.

Initialize the Rich table with task rows.

Insert 50 new hosts: 25 superhosts and 25 non-superhosts. Names are copied from existing hosts to test unique_key handling.

Check if python can connect to an actively running docker daemon.

Check if .env exists and is loadable.

Check if this failure mode is an infrastructure/harness error vs a task failure.

Check if a result is an error (infrastructure/harness issue) vs a task failure.

Check if python can connect to an actively running podman daemon.

Load the JSON diff data from the corresponding file_diffs.json file.

Load migration configuration from a YAML file. Args: migration_file: Path to the migration YAML file (relative to migrations dir), o

Load a Parquet file into Snowflake using internal stage and COPY INTO.

Load profiles.yml file.

Load and parse a YAML file.

Centralized info logging function for the harness. Args: logger: The logger instance to use task: The task being run

Main entry point.

Generate HTML dashboard for the latest experiment and open it.

Main function to generate HTML results.

Main function to extract task details and generate CSV. Args: output_file: Optional path to save the TSV file to quiet: If True,

Main entry point.

Interactive wizard for creating new ADE-Bench tasks.

Create a comparison result when one relation is missing.

Merge all results.tsv files from saved experiments into a single TSV. Args: experiments_dir: Path to the experiments_saved directory

Merge asciinema markers into a recording. Inserts marker events into an asciinema recording file at specified timestamps. Ma