Run all cases, print confusion matrix, save results JSON.

Helper to get AsyncOpenAI or AsyncAzureOpenAI client that was created for the deployment The same OpenAI client is re-used to optimi

Compute CORS allowed origins and credentials flag from environment variables. Extracted into a function so it can be unit-tested without rel

Extract a semantic-cache prompt from chat or Responses API request kwargs.

Get SSL verification setting for boto3 clients. This ensures that custom CA certificates are properly used for all AWS API calls,

Return True for any IP not safe to reach from a user-supplied URL. Policy: default-deny via ``ip.is_global`` (RFC 6890), plus an explicit exc

Load eval cases from a JSONL file. One JSON object per line.

Stub spend_counter_cache (and user_api_key_cache) so we can observe invalidation calls. Both caches are looked up via ``from litellm.proxy.pr

Helper to build a minimal deployment dict as returned by router.get_model_list.

Create a real httpx.HTTPStatusError for testing.

Create a mock FastAPI Request object.

Capability probes read the cost map under ``custom_llm_provider``; ``llm_provider`` only tags raised exceptions.

Build a MagicMock prisma_client whose env-vars table returns ``row``.

Return a mock that mirrors litellm's ``AsyncHTTPHandler`` contract. Two properties of the real handler matter for these tests and were the so

Parse direct JSON response (non-streaming). Supports multiple agent response schemas: 0. {"jsonrpc": "2.0", "result": {"mess

Build a minimal ModelPreferences-like object.

Safely convert a 'created' field value to an integer. Some providers (like SambaNova) return the 'created' field as a float (Unix timest

Updates the config fields with the new values from the DB Args: current_config (dict): Current configuration dictionary

Write deployment health states to the router's health state cache for health-check-driven routing. No-op if the feature is disabled.

Add a success callback to litellm._async_success_callback

Return the headers and body fields that authenticate the client to the token endpoint. ``client_secret_basic`` is a confidential-client method, s

Checks if token can call a given model 1. First checks native key-level model permissions (current implementation) 2. If not allowed nat

Classify a single user prompt. Falls back to GENERAL when no rule matches. Empty/whitespace-only also returns GENERAL.

Helper function to create a PostHog event payload for logging Args: kwargs (Dict[str, Any]): request kwargs containing s

Check if a provider is defined via JSON

Extract original video ID without encoding.

If the request is websearch, filter out deployments that don't support web search

Snapshot, send, and drain in one consistent step. Overrides the base implementation so the same snapshot drives both the HTTP send an

Get all fallbacks for a given model from the router's fallback configuration. Args: model: The model name to get fallbacks for

Return the API base URL for the provider

Resolve xAI API keys while preserving endpoint-specific legacy order. Chat uses xai_key before XAI_API_KEY without adding a generic

Extract base URL from OpenAPI spec.

Returns the config model for the guardrail This is used to render the config model in the UI.

Get the cost of using built-in tools. Supported tools: - Web Search - File Search - Vector Store (Azure)

Get the guardrail translation handler for a given call type. Args: call_type: The type of call (e.g., completion, acompletion, anthr

Create a mock UserAPIKeyAuth token for testing

If model_name is provided, only return access groups for that model. Parameters: - model_name: Optional[str] - the received

Extract the original provider file/batch ID from an encoded ID. Handles IDs that start with "file-" or "batch_" prefix.

Get the server root path from the environment variables. - If SERVER_ROOT_PATH is set, return it. - Otherwise, default to "/".

Get the set of Perplexity unified search parameters. These are the standard parameters that providers should transform from.

Extract tags from request body metadata. Args: request_body: The request body dictionary Returns: List of tag names (st

Handle callback logging failures by incrementing Prometheus metrics. Call this method in exception handlers within your callback whe

Evict from both cache layers; call after every LiteLLM_Config write.

Check if the user is allowed to call the vector store endpoint. Cover: 1. Creating a vector store index 2. Reading a vector store in

Process input messages by applying guardrails to text content.

Process input text fields ('query' and 'instruction') by applying guardrails and writing the sanitized values back. Args:

Call from ``pytest_recording_configure(config, vcr)`` in each conftest.

Helper utility to run an async function in a sync context. Handles the case where there is an existing event loop running. Args:

Store NaCl-encrypted access_token in Redis with the given TTL.

Set the UserAPIKeyAuth in the auth context variable. Args: user_api_key_auth: UserAPIKeyAuth object mcp_auth

Strip LiteLLM routing prefixes from model name.

Get URL and params for retrieving file content.

Transform Brave Search API response to LiteLLM unified SearchResponse format.

Translate OpenAI response to Anthropic format. Args: response: The OpenAI ModelResponse tool_name_mapping: O