MCPcopy Create free account

hub / github.com/dbt-labs/ade-bench / types & classes

Types & classes90 in github.com/dbt-labs/ade-bench

↓ 20 callersClassPluginSet
Configuration for a set of plugins (skills and MCP servers).
ade_bench/harness_models.py:258
↓ 11 callersClassTrialHandler
ade_bench/handlers/trial_handler.py:173
↓ 10 callersClassMcpServerConfig
Configuration for an MCP server.
ade_bench/harness_models.py:239
↓ 9 callersClassPluginSetLoader
Loads and resolves plugin sets from YAML configuration.
ade_bench/plugins/loader.py:9
↓ 8 callersClassConcreteInstalledAgent
Concrete subclass for testing AbstractInstalledAgent.
tests/agents/installed_agents/test_abstract_installed_agent.py:9
↓ 8 callersClassSkillOrigin
Configuration for a skill origin.
ade_bench/harness_models.py:247
↓ 7 callersClassFileDiffHandler
Handles file diffing operations for test execution.
ade_bench/handlers/file_diff_handler.py:189
↓ 6 callersClassPluginSetsConfig
Root configuration containing all plugin sets.
ade_bench/harness_models.py:282
↓ 6 callersClassSkillsHandler
Installs skills from plugin set configuration.
ade_bench/plugins/skills_handler.py:10
↓ 6 callersClassTerminalCommand
ade_bench/harness_models.py:225
↓ 4 callersClassAgentResult
ade_bench/agents/base_agent.py:20
↓ 4 callersClassResultsHTMLGenerator
Generates HTML dashboard for experiment results.
scripts_python/generate_results_html.py:20
↓ 3 callersClassAgentName
ade_bench/agents/agent_name.py:4
↓ 3 callersClassBenchmarkResults
ade_bench/harness_models.py:107
↓ 3 callersClassDatabaseInfo
Information about a shared database.
ade_bench/database/pool_manager.py:32
↓ 3 callersClassDockerComposeManager
ade_bench/terminal/docker_compose_manager.py:32
↓ 3 callersClassNamedAgentFactory
ade_bench/agents/agent_factory.py:33
↓ 3 callersClassOpenAICodexAgent
ade_bench/agents/installed_agents/openai_codex/openai_codex_agent.py:15
↓ 3 callersClassSetupOrchestrator
Orchestrator that calls setup functions and configures plugins.
ade_bench/setup/setup_orchestrator.py:17
↓ 3 callersClassTmuxSession
ade_bench/terminal/tmux_session.py:13
↓ 2 callersClassDataset
A class for loading and iterating over tasks in a dataset.
ade_bench/utils/dataset.py:7
↓ 2 callersClassTerminal
ade_bench/terminal/terminal.py:10
↓ 2 callersClassTimeoutSet
Complete set of timeouts for a task execution.
ade_bench/utils/timeout_manager.py:13
↓ 2 callersClassTrialResults
ade_bench/harness_models.py:78
↓ 1 callersClassAsciinemaHandler
Handles operations related to asciinema recordings, including marker management.
ade_bench/handlers/asciinema_handler.py:6
↓ 1 callersClassClaudeCodeLogFormatter
Log formatter for Claude Code agent JSON-lines format.
ade_bench/agents/installed_agents/claude_code/log_formatter.py:23
↓ 1 callersClassClaudeParser
Parser for Claude agent responses to extract runtime, token usage, and cost metrics.
ade_bench/parsers/claude_parser.py:7
↓ 1 callersClassCodexParser
Parser for Codex agent responses to extract runtime, token usage, and cost metrics.
ade_bench/parsers/codex_parser.py:7
↓ 1 callersClassConfig
ade_bench/config.py:11
↓ 1 callersClassDebugBreakpointException
Exception raised when a debug breakpoint is hit.
ade_bench/utils/debug_breakpoint.py:6
↓ 1 callersClassDockerComposeEnvVars
ade_bench/terminal/docker_compose_manager.py:20
↓ 1 callersClassDuckDBExtractor
Shared utilities for DuckDB data extraction and analysis.
scripts_python/duckdb_utils.py:16
↓ 1 callersClassDuckDBToSnowflakeConverter
Main converter class that handles the entire conversion pipeline.
scripts_python/migrate_duckdb_to_snowflake.py:50
↓ 1 callersClassFileContentManager
Manages file content storage with deduplication using content hashing.
ade_bench/handlers/file_diff_handler.py:16
↓ 1 callersClassFileDiff
Represents the differences between two file snapshots.
ade_bench/handlers/file_diff_handler.py:96
↓ 1 callersClassFileSnapshot
Represents a snapshot of files in a directory at a specific point in time.
ade_bench/handlers/file_diff_handler.py:44
↓ 1 callersClassGeminiParser
Parser for Gemini agent responses to extract runtime, token usage, and cost metrics.
ade_bench/parsers/gemini_parser.py:7
↓ 1 callersClassHarness
ade_bench/harness.py:47
↓ 1 callersClassParserName
ade_bench/parsers/parser_factory.py:9
↓ 1 callersClassParserResult
Result from parsing test output, containing both test results and status messages.
ade_bench/parsers/base_parser.py:15
↓ 1 callersClassRichTaskLogger
Rich-based logger that shows one row per task with live updates.
ade_bench/utils/logger.py:13
↓ 1 callersClassRunMetadata
ade_bench/harness_models.py:52
↓ 1 callersClassSolutionSeedConfig
Configuration for a single solution seed.
ade_bench/harness_models.py:202
↓ 1 callersClassTaskScanner
Scans an ade-bench tasks directory and returns structured task metadata.
ade_bench/utils/task_scanner.py:50
ClassAbstractInstalledAgent
ade_bench/agents/installed_agents/abstract_installed_agent.py:28
ClassAgentFactory
ade_bench/agents/agent_factory.py:22
ClassBaseAgent
ade_bench/agents/base_agent.py:53
ClassBaseLLM
ade_bench/llms/base_llm.py:16
ClassBaseParser
ade_bench/parsers/base_parser.py:25
ClassClaudeCodeAgent
ade_bench/agents/installed_agents/claude_code/claude_code_agent.py:16
ClassContextLengthExceededError
Raised when the LLM response indicates the context length was exceeded.
ade_bench/llms/base_llm.py:4
ClassDatabasePoolManager
Manages shared database files and provides copy-on-write functionality.
ade_bench/database/pool_manager.py:45
ClassDatabaseType
ade_bench/database/pool_manager.py:12
ClassDbtParser
ade_bench/parsers/dbt_parser.py:5
ClassEnvModel
ade_bench/utils/env_model.py:6
ClassFailureMode
ade_bench/harness_models.py:16
ClassGeminiCLIAgent
ade_bench/agents/installed_agents/gemini_cli/gemini_cli_agent.py:15
ClassLogFormatter
Base class for agent log formatters.
ade_bench/agents/log_formatter.py:14
ClassMacroAgent
ade_bench/agents/installed_agents/macro/macro_agent.py:15
ClassMacroParser
Parser for Macro agent responses to extract token usage and cost metrics.
ade_bench/parsers/macro_parser.py:8
ClassNoneAgent
ade_bench/agents/none_agent.py:10
ClassParseError
Raised when the LLM response cannot be parsed into the expected format.
ade_bench/llms/base_llm.py:10
ClassParserFactory
ade_bench/parsers/parser_factory.py:16
ClassRequireNameMeta
ade_bench/agents/base_agent.py:12
ClassSageAgent
ade_bench/agents/sage_agent.py:26
ClassShSolution
ade_bench/agents/sage_agent.py:13
ClassTask
ade_bench/handlers/trial_handler.py:55
ClassTaskDifficulty
ade_bench/handlers/trial_handler.py:40
ClassTaskInfo
Structured metadata for an ade-bench task, loaded from task.yaml.
ade_bench/utils/task_scanner.py:17
ClassTaskMetadata
Metadata for a task.
ade_bench/harness_models.py:212
ClassTaskPrompt
ade_bench/handlers/trial_handler.py:28
ClassTestColumnComparison
tests/scripts/test_compare_tables.py:27
ClassTestConfigureMcpServersBasic
tests/agents/installed_agents/test_abstract_installed_agent.py:45
ClassTestConfigureMcpServersDbtDetection
tests/agents/installed_agents/test_abstract_installed_agent.py:101
ClassTestConfigureMcpServersFailure
tests/agents/installed_agents/test_abstract_installed_agent.py:195
ClassTestConfigureMcpServersNoop
tests/agents/installed_agents/test_abstract_installed_agent.py:36
ClassTestDumpTablesDuckDB
Test dumping tables from DuckDB.
tests/scripts/test_dump_tables.py:18
ClassTestEmptyTables
tests/scripts/test_compare_tables.py:244
ClassTestExactRowMatching
tests/scripts/test_compare_tables.py:72
ClassTestFindFailingEqualityTests
tests/scripts/test_detect_failing_equality_tests.py:18
ClassTestFuzzyRowMatching
tests/scripts/test_compare_tables.py:113
ClassTestHTMLGeneration
tests/scripts/test_compare_tables_html.py:27
ClassTestNullHandling
tests/scripts/test_compare_tables.py:224
ClassTestReasoningEffortEnvVar
tests/agents/installed_agents/test_openai_codex_agent.py:8
ClassTestResolveRelations
tests/scripts/test_detect_failing_equality_tests.py:69
ClassTestSystematicDiffs
tests/scripts/test_compare_tables.py:151
ClassTimeoutManager
Manages timeout resolution with task-specific overrides. This is the single source of truth for timeout resolution in ADE-Bench. It eliminate
ade_bench/utils/timeout_manager.py:50
ClassUnitTestStatus
ade_bench/parsers/base_parser.py:9
ClassVariantConfig
Configuration for a task variant.
ade_bench/harness_models.py:186
ClassYamlSolution
ade_bench/agents/sage_agent.py:18