* Track step performance * @param step Agent step

Get an authenticated GitHub client. Returns: Authenticated GitHub client

* Get the current health state of all keys

Handle EC2 commands.

Handle common AWS errors and convert to appropriate exceptions. Args: error: The exception that was raised.

Handle GitHub commands.

* Loads and parses the configuration * * @returns Promise<AgenticBenchmarkConfig> - The parsed configuration

Print an error message with optional suggestion.

* Process a response to update key health * * @param response The response metadata to process

* Run adversarial tests * @param tests Tests to run * @returns Test results

* Sets the tasks to run * * @param tasks - Tasks to run

* Start the server

* Calculate security score * @param results Test results * @returns Security score

* Create a checkpoint * @param name Name of the checkpoint * @returns Checkpoint hash

* Clean up resources

* Estimate token count for a given text

* Estimate token count for a given text * This is a rough estimate as the actual tokenization depends on the model * @param text The text to est

* Estimate token count for a given text * This is a rough estimate as the actual tokenization depends on the model * @param text The text to est

* Estimate token count for a given text * This is a rough estimate as the actual tokenization depends on the model * @param text The text to est

Format data for output in the specified format.

Format a resource name according to a template. Args: name_format: Format string for the name. **kwa

* Get metrics * @returns Metrics

Get details for a specific branch. Args: repo: Repository name or full path (owner/repo). branch: Br

Get details for a specific security group. Args: group_id: The ID of the security group. Re

Handle CLI errors with user-friendly messages. Args: error: The exception that was raised Returns: Exit cod

Handle CLI errors and return appropriate exit code.

List EC2 instances with optional filtering. Args: filters: List of filters to apply. Each filter is a dict with

Main entry point for the CLI.

* Multiplies two numbers. * @param {number} a - The first number. * @param {number} b - The second number. * @returns {number} The product of a and

* Check if a request can proceed with a given API key * * @param apiKey The API key to check * @param provider The provider this key belongs

* Display help information

* Process a request through the tumbler * @param request The request to process * @returns The response from the selected model

* Runs a single task * * @param task - Task to run * @param agentSize - Size of the agent * @param stepCount - Number of steps * @retu

* Select the best API key to use from a pool * * @param provider The provider to select a key for * @param apiKeys Array of available API ke

* Select a key using health-aware strategy

* Set processing parameters * @param params Parameters to set

Start a stopped EC2 instance. Args: instance_id: The ID of the instance to start. wait: Whether to w

Stop a running EC2 instance. Args: instance_id: The ID of the instance to stop. force: Whether to fo

Deep merge two dictionaries. Args: target: Target dictionary to merge into source: Source dictionary to merge from

Get credentials from AWS Secrets Manager. Args: secret_name: Name of the secret Returns:

* Adds two numbers. * @param {number} a - The first number. * @param {number} b - The second number. * @returns {number} The sum of a and b.

* Calculate overall metrics * @param steps Agent steps * @returns Overall metrics

* Compute a diff between two files * @param oldText Previous version of code * @param newText New version of code * @returns A DiffResult with diff

* Create a new Edge Function * @param slug Function slug * @param name Function name * @param body Function body * @param verifyJwt Whethe