Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/dbt-labs/ade-bench
/ types & classes
Types & classes
90 in github.com/dbt-labs/ade-bench
⨍
Functions
626
◇
Types & classes
90
↳
Endpoints
6
↓ 20 callers
Class
PluginSet
Configuration for a set of plugins (skills and MCP servers).
ade_bench/harness_models.py:258
↓ 11 callers
Class
TrialHandler
ade_bench/handlers/trial_handler.py:173
↓ 10 callers
Class
McpServerConfig
Configuration for an MCP server.
ade_bench/harness_models.py:239
↓ 9 callers
Class
PluginSetLoader
Loads and resolves plugin sets from YAML configuration.
ade_bench/plugins/loader.py:9
↓ 8 callers
Class
ConcreteInstalledAgent
Concrete subclass for testing AbstractInstalledAgent.
tests/agents/installed_agents/test_abstract_installed_agent.py:9
↓ 8 callers
Class
SkillOrigin
Configuration for a skill origin.
ade_bench/harness_models.py:247
↓ 7 callers
Class
FileDiffHandler
Handles file diffing operations for test execution.
ade_bench/handlers/file_diff_handler.py:189
↓ 6 callers
Class
PluginSetsConfig
Root configuration containing all plugin sets.
ade_bench/harness_models.py:282
↓ 6 callers
Class
SkillsHandler
Installs skills from plugin set configuration.
ade_bench/plugins/skills_handler.py:10
↓ 6 callers
Class
TerminalCommand
ade_bench/harness_models.py:225
↓ 4 callers
Class
AgentResult
ade_bench/agents/base_agent.py:20
↓ 4 callers
Class
ResultsHTMLGenerator
Generates HTML dashboard for experiment results.
scripts_python/generate_results_html.py:20
↓ 3 callers
Class
AgentName
ade_bench/agents/agent_name.py:4
↓ 3 callers
Class
BenchmarkResults
ade_bench/harness_models.py:107
↓ 3 callers
Class
DatabaseInfo
Information about a shared database.
ade_bench/database/pool_manager.py:32
↓ 3 callers
Class
DockerComposeManager
ade_bench/terminal/docker_compose_manager.py:32
↓ 3 callers
Class
NamedAgentFactory
ade_bench/agents/agent_factory.py:33
↓ 3 callers
Class
OpenAICodexAgent
ade_bench/agents/installed_agents/openai_codex/openai_codex_agent.py:15
↓ 3 callers
Class
SetupOrchestrator
Orchestrator that calls setup functions and configures plugins.
ade_bench/setup/setup_orchestrator.py:17
↓ 3 callers
Class
TmuxSession
ade_bench/terminal/tmux_session.py:13
↓ 2 callers
Class
Dataset
A class for loading and iterating over tasks in a dataset.
ade_bench/utils/dataset.py:7
↓ 2 callers
Class
Terminal
ade_bench/terminal/terminal.py:10
↓ 2 callers
Class
TimeoutSet
Complete set of timeouts for a task execution.
ade_bench/utils/timeout_manager.py:13
↓ 2 callers
Class
TrialResults
ade_bench/harness_models.py:78
↓ 1 callers
Class
AsciinemaHandler
Handles operations related to asciinema recordings, including marker management.
ade_bench/handlers/asciinema_handler.py:6
↓ 1 callers
Class
ClaudeCodeLogFormatter
Log formatter for Claude Code agent JSON-lines format.
ade_bench/agents/installed_agents/claude_code/log_formatter.py:23
↓ 1 callers
Class
ClaudeParser
Parser for Claude agent responses to extract runtime, token usage, and cost metrics.
ade_bench/parsers/claude_parser.py:7
↓ 1 callers
Class
CodexParser
Parser for Codex agent responses to extract runtime, token usage, and cost metrics.
ade_bench/parsers/codex_parser.py:7
↓ 1 callers
Class
Config
ade_bench/config.py:11
↓ 1 callers
Class
DebugBreakpointException
Exception raised when a debug breakpoint is hit.
ade_bench/utils/debug_breakpoint.py:6
↓ 1 callers
Class
DockerComposeEnvVars
ade_bench/terminal/docker_compose_manager.py:20
↓ 1 callers
Class
DuckDBExtractor
Shared utilities for DuckDB data extraction and analysis.
scripts_python/duckdb_utils.py:16
↓ 1 callers
Class
DuckDBToSnowflakeConverter
Main converter class that handles the entire conversion pipeline.
scripts_python/migrate_duckdb_to_snowflake.py:50
↓ 1 callers
Class
FileContentManager
Manages file content storage with deduplication using content hashing.
ade_bench/handlers/file_diff_handler.py:16
↓ 1 callers
Class
FileDiff
Represents the differences between two file snapshots.
ade_bench/handlers/file_diff_handler.py:96
↓ 1 callers
Class
FileSnapshot
Represents a snapshot of files in a directory at a specific point in time.
ade_bench/handlers/file_diff_handler.py:44
↓ 1 callers
Class
GeminiParser
Parser for Gemini agent responses to extract runtime, token usage, and cost metrics.
ade_bench/parsers/gemini_parser.py:7
↓ 1 callers
Class
Harness
ade_bench/harness.py:47
↓ 1 callers
Class
ParserName
ade_bench/parsers/parser_factory.py:9
↓ 1 callers
Class
ParserResult
Result from parsing test output, containing both test results and status messages.
ade_bench/parsers/base_parser.py:15
↓ 1 callers
Class
RichTaskLogger
Rich-based logger that shows one row per task with live updates.
ade_bench/utils/logger.py:13
↓ 1 callers
Class
RunMetadata
ade_bench/harness_models.py:52
↓ 1 callers
Class
SolutionSeedConfig
Configuration for a single solution seed.
ade_bench/harness_models.py:202
↓ 1 callers
Class
TaskScanner
Scans an ade-bench tasks directory and returns structured task metadata.
ade_bench/utils/task_scanner.py:50
Class
AbstractInstalledAgent
ade_bench/agents/installed_agents/abstract_installed_agent.py:28
Class
AgentFactory
ade_bench/agents/agent_factory.py:22
Class
BaseAgent
ade_bench/agents/base_agent.py:53
Class
BaseLLM
ade_bench/llms/base_llm.py:16
Class
BaseParser
ade_bench/parsers/base_parser.py:25
Class
ClaudeCodeAgent
ade_bench/agents/installed_agents/claude_code/claude_code_agent.py:16
Class
ContextLengthExceededError
Raised when the LLM response indicates the context length was exceeded.
ade_bench/llms/base_llm.py:4
Class
DatabasePoolManager
Manages shared database files and provides copy-on-write functionality.
ade_bench/database/pool_manager.py:45
Class
DatabaseType
ade_bench/database/pool_manager.py:12
Class
DbtParser
ade_bench/parsers/dbt_parser.py:5
Class
EnvModel
ade_bench/utils/env_model.py:6
Class
FailureMode
ade_bench/harness_models.py:16
Class
GeminiCLIAgent
ade_bench/agents/installed_agents/gemini_cli/gemini_cli_agent.py:15
Class
LogFormatter
Base class for agent log formatters.
ade_bench/agents/log_formatter.py:14
Class
MacroAgent
ade_bench/agents/installed_agents/macro/macro_agent.py:15
Class
MacroParser
Parser for Macro agent responses to extract token usage and cost metrics.
ade_bench/parsers/macro_parser.py:8
Class
NoneAgent
ade_bench/agents/none_agent.py:10
Class
ParseError
Raised when the LLM response cannot be parsed into the expected format.
ade_bench/llms/base_llm.py:10
Class
ParserFactory
ade_bench/parsers/parser_factory.py:16
Class
RequireNameMeta
ade_bench/agents/base_agent.py:12
Class
SageAgent
ade_bench/agents/sage_agent.py:26
Class
ShSolution
ade_bench/agents/sage_agent.py:13
Class
Task
ade_bench/handlers/trial_handler.py:55
Class
TaskDifficulty
ade_bench/handlers/trial_handler.py:40
Class
TaskInfo
Structured metadata for an ade-bench task, loaded from task.yaml.
ade_bench/utils/task_scanner.py:17
Class
TaskMetadata
Metadata for a task.
ade_bench/harness_models.py:212
Class
TaskPrompt
ade_bench/handlers/trial_handler.py:28
Class
TestColumnComparison
tests/scripts/test_compare_tables.py:27
Class
TestConfigureMcpServersBasic
tests/agents/installed_agents/test_abstract_installed_agent.py:45
Class
TestConfigureMcpServersDbtDetection
tests/agents/installed_agents/test_abstract_installed_agent.py:101
Class
TestConfigureMcpServersFailure
tests/agents/installed_agents/test_abstract_installed_agent.py:195
Class
TestConfigureMcpServersNoop
tests/agents/installed_agents/test_abstract_installed_agent.py:36
Class
TestDumpTablesDuckDB
Test dumping tables from DuckDB.
tests/scripts/test_dump_tables.py:18
Class
TestEmptyTables
tests/scripts/test_compare_tables.py:244
Class
TestExactRowMatching
tests/scripts/test_compare_tables.py:72
Class
TestFindFailingEqualityTests
tests/scripts/test_detect_failing_equality_tests.py:18
Class
TestFuzzyRowMatching
tests/scripts/test_compare_tables.py:113
Class
TestHTMLGeneration
tests/scripts/test_compare_tables_html.py:27
Class
TestNullHandling
tests/scripts/test_compare_tables.py:224
Class
TestReasoningEffortEnvVar
tests/agents/installed_agents/test_openai_codex_agent.py:8
Class
TestResolveRelations
tests/scripts/test_detect_failing_equality_tests.py:69
Class
TestSystematicDiffs
tests/scripts/test_compare_tables.py:151
Class
TimeoutManager
Manages timeout resolution with task-specific overrides. This is the single source of truth for timeout resolution in ADE-Bench. It eliminate
ade_bench/utils/timeout_manager.py:50
Class
UnitTestStatus
ade_bench/parsers/base_parser.py:9
Class
VariantConfig
Configuration for a task variant.
ade_bench/harness_models.py:186
Class
YamlSolution
ade_bench/agents/sage_agent.py:18