Check if a type is a TypedDict. Works with both typing.TypedDict and typing_extensions.TypedDict.

Load tool secrets from a .env file.

Create mock results for multi-model comparative evaluation.

Resolve the API key for a given provider for evals. Args: provider: The model provider provider_api_key: API key provided vi

Resolve API keys for all providers from flags and environment. Priority: --api-key flag > environment variable > .env file Args: api

Run a command and return success status and output.

Send a notification to the client.

Store an error result for a task.

Update linked_principal_id in usage.json. Args: principal_id: The principal_id to link to the current anon_id

Clean up any pending requests.

Create event data dictionary from EventMessage. For JSONRPCError messages with ``_transport`` metadata, the ``_transport`` key is str

Remove a single task and its bookkeeping slots. Cancels any tracked background ``asyncio.Task`` for ``task_id`` before dropping the r

Extract text content from a JSONRPCResponse.

Format conversation messages as rich HTML for context display.

Format conversation messages as plain text.

Format the run statistics summary as a Markdown bullet list.

Emit a structured WARNING log for a failed tool call.

Helper: register a tool returning `return_type` and get the MCP tool.

Helper: minimal valid ``ResourceServerAuth`` kwargs.

Parse model preferences into standard format.

Write data atomically to usage.json file Args: data: The data to write to the usage file

Add all the tools in a module to the catalog.

Build and return the comparative case. Returns: The configured ComparativeCase. Raises: ValueError: If no tr

Create a Windows ``STARTUPINFO`` configured with ``SW_HIDE``. Returns: A configured ``STARTUPINFO`` instance on Windows when available,

Read cache, print notification if update available, fork background check.

Configure Claude Code to connect to an Arcade Cloud MCP gateway. Writes to ``~/.claude.json`` (user-scope). The file contains many other Clau

Configure Gemini CLI to connect to an Arcade Cloud MCP gateway. Writes to ``~/.gemini/settings.json`` using the ``mcpServers`` map with the `

Configure OpenCode to connect to an Arcade Cloud MCP gateway. Writes to the ``mcp`` map in ``~/.config/opencode/opencode.json`` using the ``{

Filter evaluation results to show only failed cases and calculate original counts. Args: all_evaluations: List of evaluation results

Find the model with the highest score for a case. Args: case_models: Dict mapping model -> case_result with evaluation. Returns

Find an existing gateway whose allow-list is a superset of *tool_allow_list* and whose ``auth_type`` matches.

Load a Toolkit from a Python package

Get the Cursor configuration file path.

Get the full command path by traversing the context hierarchy.

Retrieve the metadata for the tool invocation. Raises a ValueError if the metadata is not found.

Atomic ``get_result`` that also returns whether the payload was a stored error. Returns ``(payload, is_error)``: - ``is_erro

Get tool secrets from .env file for stdio servers. Discovers .env file by traversing upward from the current directory through parent directo

Return example prompts for the given toolkit names.

Group comparative results by suite -> case -> model for case-first comparison. When multiple models run the same comparative evaluation, thi

Process ASGI request with proper session handling. Args: scope: ASGI scope receive: ASGI receive function

Check if capture results contain multiple models. Args: captures: List of CaptureResult objects. Returns: True if more

Check if evaluation results contain multiple models. Args: results: Nested list of evaluation results. Returns: True if

Negotiate the protocol version for this session. If the server supports the client's requested version, return it. Otherwise, return the serv

Context manager for the OAuth callback server. Ensures the server is properly shut down even if an error occurs. The caller is responsib

Run evaluation suites and display results. Individual task failures are caught and reported without crashing the entire batch. Args:

Save the configuration to the YAML file in the configuration directory. Sets file permissions to 600 (owner read/write only) for sec

Check if PostHog alias is needed. Alias is needed when the user is authenticated, but the retrieved principal_id doesn't match the pe

Begin collecting spans for the current async context.

Extracts the result value for the tool output. The executor guarantees that `data` is either a string, a dict, or None.

Get tool secrets.

Track a background asyncio.Task for a managed task.

Validate that the Python code in the given file is syntactically correct. Args: file_path: Path to the Python file to va

Build extra metadata for error reporting.

Create RFC 6750 + RFC 9728 compliant 401 response. The WWW-Authenticate header format follows: - RFC 6750 (OAuth 2.0 Bearer Token Usa

Create a consistent error response for tool requirement failures. NOTE: structuredContent must be None on error responses. Per the MCP spec,

Create a tool context from a tool definition and session

Drive a missing-Authorization 401 and return the decoded WWW-Authenticate header value.

Extract the base suite name by removing the track suffix. Examples: "My Suite [track_a]" with track "track_a" -> "My Suite"

Format conversation messages as Markdown for context display.

Format conversation messages as plain text for context display.

Format evaluation details.

Get the registry for a track or the default internal registry. Args: track: Optional track name. If provided, gets or creates the

Get the resource owner from the current model context.

Handle HttpError and its subclasses.

Handle a successful login event. Upon a successful login, we retrieve and persist the principal_id for the logged in user. We then al

Handle a successful logout event. Upon a successful logout, we rotate the anon_id and clear the linked principal_id.

POST JSON payload, return (status, response_headers, body_dict).

Check if a single task has passed its TTL. O(1), no sweep.

Return True if *uri* contains RFC 6570-style template variables.

Create evaluation results with multi-run stats for TWO models.

Build a MiddlewareContext with otel meta configured. Sets the request_context ContextVar so TelemetryPassbackMiddleware reads it from the Con

Build a JSONRPCResponse wrapping a CallToolResult.

Helper to create a materialized tool with a single input param ValueSchema.

Process tool calls by resolving names and applying defaults. Args: tool_calls: List of (tool_name, args) tuples.

Return a fresh Receive callable that replays ``body`` as a single ``http.request`` message, then chains to ``original_receive``. After the se

Resolve a tool name to its original registry key. Handles both original names (e.g., "Google.Search") and normalized names (e.g., "Go

Resolve the Windows roaming AppData directory via ``platformdirs``. ``platformdirs`` is the de-facto standard Python library for resolving OS

Insert or replace a ``[mcp_servers.<name>]`` section in Codex's ``config.toml``. Preserves all other content (including comments, formatting, and

Validate a Bearer auth-param value against RFC 6750 ``error-char``. Returns ``value`` unchanged when valid. Raises ``ValueError`` with a prec

Register a file-backed resource at build time.