Load credentials from file. Raises: FileNotFoundError: If credentials file doesn't exist json.JSONDe

Load configuration from environment variables. Environment variables are converted to nested dictionaries based on double underscore

Verify that the credentials have access to the service. This method should be overridden by subclasses to perform a simple,

Verify that the token has access to GitHub API. Raises: AuthenticationError: If authentication fails.

* Add feedback to a contribution * @param id The ID of the contribution * @param feedback The feedback to add * @returns Whether the feedback

* Add a file to a vector store * @param vectorStoreId Vector store ID * @param fileId File ID

* Add a file to a vector store * @param vectorStoreId Vector store ID * @param fileId File ID

* Add a file to a vector store * @param vectorStoreId Vector store ID * @param fileId File ID

* Add a file to a vector store * @param vectorStoreId Vector store ID * @param fileId File ID

* Analyze and compute diff between two versions of code * @param path Path to the file * @param oldContent Previous version of code * @param

* Apply changes to a file and commit them * @param path Path to the file * @param message Commit message * @returns Commit hash

* Applies environment variables to the configuration * * @param config - The configuration to apply environment variables to

* Applies statistical analysis to results * * @param results - Results to analyze * @returns BenchmarkResult[] - Analyzed results

* Check if two strings are similar (used for detecting changed lines) * @param a First string * @param b Second string * @returns True if the strin

* Assert that a value is true * @param value Value to check

* Calculate adaptability metric * @param results Test results * @returns Adaptability score (0-1, higher is better)

* Calculate adaptability metric * @param results Test results * @returns Adaptability score (0-1, higher is better)

* Calculate adaptability metric * @param results Test results * @returns Adaptability score (0-1, higher is better)

* Calculates the effect size * * @param prevResult - Previous result * @param currResult - Current result * @returns number - Effect size

* Calculate efficiency metric * @param results Test results * @returns Efficiency score (0-1, higher is better)

* Calculate efficiency metric * @param results Test results * @returns Efficiency score (0-1, higher is better)

* Calculate efficiency metric * @param results Test results * @returns Efficiency score (0-1, higher is better)

* Calculate safety metric * @param results Test results * @returns Safety score (0-1, higher is better)

* Calculate safety metric * @param results Test results * @returns Safety score (0-1, higher is better)

* Calculate safety metric * @param results Test results * @returns Safety score (0-1, higher is better)

* Calculate tool accuracy * @param step Agent step * @returns Tool accuracy

* Calculate trajectory score * @param steps Agent steps * @returns Trajectory score

* Calculates the p-value for the Wilcoxon signed-rank test * * @param prevResult - Previous result * @param currResult - Current result *

Check if the prerequisites for deployment are met. Args: request: Parameters for the deployment Returns: Re

Check if input text contains potentially malicious content. Args: input_text: The text to check Returns: Se

Check if output text contains sensitive information. Args: output_text: The text to check Returns: Sensitiv

* Clear metrics

* Clear all entries from the vector store * Useful for testing or resetting the database

* Combine benchmark results * @param results Array of benchmark results * @returns Combined results

* Compute a diff between two files, focusing on function-level changes * @param oldText Previous version of code * @param newText New version of cod

* Create an assistant (if supported) * @param options Options for the assistant

* Create a new Edge Function * @param args Command-line arguments

* Create a mock provider * @param name Provider name * @param options Provider options * @returns Mock provider

* Create an OpenAI provider * @param name Provider name * @param options Provider options * @returns OpenAI provider

* Create an OpenRouter provider * @param name Provider name * @param options Provider options * @returns OpenRouter provider

* Create a prompt for the OpenAI API * @param task Task description * @param files Files to process * @returns Prompt text

Mock create_ec2_instance function.

Mock create_ec2_instance function.

Create an EC2 instance.

Create a new EC2 instance. Args: name: Name tag for the instance. instance_type: EC2 instance type (

Create a GitHub issue.

Credential command that raises an error.

* Delete an Edge Function * @param slug Function slug

Delete an EC2 key pair. Args: key_name: The name of the key pair to delete.

Delete an EC2 security group. Args: group_id: The ID of the security group to delete.

* Detect explicit rate limiting signals in a response

* Detect rate limit information from response headers

* Detect rate limiting from timing anomalies

* Divides the first number by the second. * @param {number} a - The numerator * @param {number} b - The denominator * @returns {number} The quotien

EC2 command that raises an error.

* Execute adversarial scenario * @param testType Test type * @returns Test result

* Execute a step using an assistant * @param step The step to execute * @param context The current context * @returns The updated context

* Execute a command * @param body The request body * @returns The HTTP response

* Execute the echo command * @param body The request body * @returns The HTTP response

* Execute a step using a simple LLM call * @param step The step to execute * @param context The current context * @returns The updated contex

* Execute the ping command * @returns The HTTP response

* Execute a query * @param body The request body * @returns The HTTP response

* Execute the random query * @returns The HTTP response

* Execute a single step in a flow * @param step The step to execute * @param context The current context * @returns The updated context

* Execute the time query * @returns The HTTP response

* Execute a tool call * @param toolCall The tool call to execute * @param context The current context * @returns The tool call output

* Extract an error message from an error if available

* Extract an error type from an error if available