Generate new anonymous ID and clear linked principal_id. Used after logout to prevent cross-contamination between multiple accounts o

Run the session message loop. Reads messages from the stream and processes them concurrently to allow server-initiated reque

Run evaluation suites in capture mode and output results. Capture mode records tool calls without scoring them. Individual task failures

Send a request to the client and wait for response. Args: method: Request method params: Request parameters

Set the current model context and return a token to reset it.

Add or update a secret to the tool context.

Converts a snake_case name to PascalCase.

Whether this validator supports OAuth discovery endpoints. Returns True if the validator can serve OAuth 2.0 Protected Resource Metadata

Whether negotiated version includes all features of the given version. Uses feature-set subset check -- NOT lexical string comparison.

Convert to dictionary for JSON serialization.

Get number of registered tracks. Returns: Number of tracks.

Returns True if the evaluation is in warning state.

Write ``content`` to ``path`` atomically, preserving a ``.bak`` backup. A crash mid-write to a user config file (e.g. ``~/.claude.json``, which

Entry point for the detached background process. Fetches PyPI, writes cache. Always updates ``checked_at`` so that failed checks don't bypass the

Build server capabilities dict for the given protocol version. Returns a dict suitable for both ServerCapabilities construction and s

Build server info dict for the given protocol version. For 2025-06-18: returns name, version, title. For 2025-11-25+: also includes i

Terminate subprocesses reliably, including uv child trees on Windows.

Convert an ExpectedToolCall, ExpectedMCPToolCall, or tuple to a NamedExpectedToolCall with default arguments populated. Args

Shared CORS headers for 401, 403, and OPTIONS preflight responses.

Create and run the server directly without reload. This is used when reload=False or when running as a child process.

Create a mock CaptureResult with a case that has no tool calls and no runs.

Delete a secret from the engine.

Opaque base64url-encoded cursor with {taskId, createdAt}. The cursor format is an internal detail -- clients treat it as an opaque string.

Format evaluation details as HTML table.

Build the summary lines used by regular and comparative formatters.

Build the summary table and pass rate used by regular and comparative formatters.

Return a string identifying the active org+project (for cache scoping).

Create a case dict with multi-run stats populated.

Flatten the content return into a list of content blocks. ``context.sampling.create_message`` returns either a single ``SamplingMessageConten

Send notifications/tasks/status to the originating session.

Process a single message. Args: message: Either a JSON string (stdio) or SessionMessage object (http)

Return sys_id unchanged, or resolve an INC-prefixed number to its sys_id.

Run evaluation using Anthropic client. Args: client: The Anthropic client. model: The model name. case: T

Register a wildcard and a specific template that overlap.

Build the `uv sync` command for the current runtime context. When this suite runs under pytest, avoid reinstalling pytest itself. Thi

Return the tail of a UTF-8 log file for diagnostics.

Convert an MCP Tool object to the MCP-style dict format used by EvalSuite.

Try to flush notifications if in async context.

Upsert a secret to the engine.

Validate request headers.

Route TypedDict input-field types through a strict Pydantic model. The raw TypedDict → Pydantic validator path does NOT honor extra='forbid',

Persist the toolkit map to disk, scoped to the active org/project.

Convenience: register a file-backed resource.

Add a route to the router.

Add a tool for build-time materialization (pre-server). ``execution`` declares MCP 2025-11-25 task-augmentation policy (``taskSupport

Perform PostHog alias synchronously (blocking). Must be called BEFORE the first event with the new distinct_id. This is done synchron

Check if the user is already logged in. Args: suppress_message: If True, suppress the logged in message. Returns: True

Clean up request context.

Coerces empty lists to None, otherwise returns the list unchanged.

Create a stdio session. Since stdio is inherently single-session, this will fail if a session is already active.

App factory for uvicorn reload support. This function is called by uvicorn when using reload mode with an import string. It rediscovers

Create a new toolkit from a template with user input.

Ensure the user is logged in, triggering OAuth if needed. Returns the valid access token.

Evaluates the closeness of datetime values within a specified tolerance.

DEPRECATED: Use ToolOutputFactory.fail instead. This method will be removed in version 3.0.0

Fetch tools from the Arcade Engine and group them by toolkit name. Results are cached to ``~/.arcade/cache/tools.json`` for 5 minutes so repe

Fetch projects in an organization. Args: coordinator_url: Base URL of the Coordinator access_token: Valid access token

Return False to suppress log record, True to allow it.

Translate a gql exception into a ToolRuntimeError.

Return extra server capabilities to advertise. Override in subclasses to declare capabilities (e.g. serverExecutionTelemetry).

Get the catalog of tools available in the worker.

Get the path to the Arcade configuration file.

Get list of tracks configured for this case. Returns: List of track names.

Get the active org_id and project_id from config. Returns: Tuple of (org_id, project_id) Raises: CLIError if no active

Get the project to use: default if available, otherwise first in list.

Extract server name and version via the MCP initialize endpoint. Args: base_url: Base URL of the server Returns: Tuple

Get the appropriate stdio configuration based on whether uv is installed.

Build a stdio config that runs ``arcade mcp stdio`` with ``--tool-package`` flags. This configuration is used by MCP clients (Claude Desktop, Cur

Get the VS Code configuration file path.

Get the Windows username when running in WSL.

Returns True if the given type is a union, i.e. a Union[T1, T2, ...] or T1 | T2 | ... etc.

Check if uv is installed and available in PATH.

Check if running in Windows Subsystem for Linux.

Handle tool calls. Override to add tool-specific processing.

Validate if a path is valid to be served or deployed.