Input: "image_url": "data:image/jpeg;base64,{base64_image}", Return: "source": { "type": "base64", "media_type": "image/

OpenAI tool invokes: { "role": "assistant", "content": null, "tool_calls": [ { "id": "call_abc123",

Count number of requests and tokens in a batch input file. Args: file_id: The file ID to read custom_llm_pro

Create an AnthropicMessagesImageParam from an image URL input. Supports both URL references (for HTTP/HTTPS URLs) and base64 encoding.

Return a deep copy of metadata with callback_vars values decrypted. Legacy plaintext rows pass through unchanged (decrypt failure → original).

Persist the serialized export for the provided time window.

Runs the CustomGuardrail's async_moderation_hook() in parallel

Handle /{name}/mcp for MCP server aliases, toolsets, MCP access group tags, and comma-separated lists. Resolution order: 1. Registered MCP se

Embed schema constraints into a Cohere parameter description. ``CohereParameterDefinition`` only has ``type``, ``description``, and ``isRequi

Fetch an agent card from ``base_url`` using the strategy chosen by ``discovery_mode``. Returns the parsed JSON from the first path that r

Get all updates from the queue.

Get all loaded policies. Returns: Dictionary mapping policy names to Policy objects

Generate a JWT token for CLI authentication with configurable expiration. The expiration time can be controlled via the LITELLM_CLI_

Ensures messages alternate between user and assistant roles by adding placeholders only when there are consecutive messages of the same role.

Build Datadog tags as a list of individual tag strings. Returns a list of "key:value" strings suitable for Datadog LLM Observability (which e

Detect the content type of image data using existing LiteLLM utils. Args: image_data: Can be BytesIO, bytes, BufferedRea

- Check if team id in proxy Team Table - if valid, return LiteLLM_TeamTable object with defined limits - if not, then raise an error

Get the last consecutive block of messages from the user. Example: messages = [ {"role": "user", "content": "Hello, how are you?

Convert a string (or list of strings) to a LitellmUserRoles enum if valid (case-insensitive). Handles list inputs since some SSO providers (

Get the next standardized reset time based on the duration. All durations will reset at predictable intervals, aligned from the current time

- Check if object permission id in proxy ObjectPermissionTable - if valid, return LiteLLM_ObjectPermissionTable object - if not, then rai

Sync version: return set of deployment IDs currently marked unhealthy and not stale.

Return the decoded OAuth2 payload dict for a user+server pair, or None.

Parse a single Cohere SSE chunk into a LiteLLM ModelResponseStream. ``prior_tool_calls_emitted`` lets the caller signal whether tool calls we

Handle streaming A2A request. Args: request_id: A2A JSON-RPC request ID params: A2A MessageSendParams contai

Check if a tool is an Anthropic-native ``web_search_*`` tool. Native clients (Anthropic SDK, Claude Desktop, Anthropic Console) send too

True if the call was rejected for being over budget (vs a provider error).

Validates API key format: - sk- keys: must match ^sk-[A-Za-z0-9_-]+$ - hashed keys: must match ^[a-fA-F0-9]{64}$ - Length between 20

Combine the path component of ``base_url`` with ``endpoint_path``. Preserves any path prefix configured on the base URL and resolves

Load config values into proxy global state

Normalize server name by replacing spaces with underscores

Override periodic_flush to work with asyncio.Queue.

Prepare token exchange parameters for Generic SSO. Args: request: Request object generic_include_client_id:

Process input text by applying guardrails. Args: data: Request data dictionary containing 'input' parameter

Identity values to write into Baggage, filtered to ``promoted_keys``. ``promoted_keys`` selects from ``_PROMOTABLE``; ``metadata_keys`` selects

Redact sensitive information (tokens, secrets) from data before logging. Handles strings, dicts, and lists recursively. Keys contain

Re-synchronize the in-memory MCP server registry with the database.

Merge OCI credentials from optional_params (explicit, always wins) and environment variables (fallback). Returns a dict with resolved va

Safely get Vertex AI location without mutating the litellm_params dict. Unlike get_vertex_ai_location(), this does NOT pop values fr