Build a mock FastAPI Request with configurable headers.

Build a model_call_details dict that mimics real proxy/SDK flows.

Map OpenAI size format to OpenRouter aspect_ratio format. Uses the same mapping as image generation since OpenRouter handles

Stub out the DB helpers resolve_and_validate_end_user_id delegates to.

Reject URL-valued ``model``/``file_id`` unless admin-allowlisted. Some providers (HuggingFace, Oobabooga, Gemini files) accept a URL in the i

Walk the precedence chain and return the first matching credential name. Checks (in order): 1. project_model_config[model_name][provider

Run non-streaming post-call guardrail hooks on an assembled streaming response, then fire success logging via ``dispatch_success_hand

Engine/app-mode search request (vertex_engine_id set).

Only raise exception for "BLOCKED" actions, not for "ANONYMIZED" actions. If `self.mask_request_content` or `self.mask_response_cont

Removes or redacts base64-encoded file data (e.g., PDFs, images, audio) from messages and responses before sending to SQS. B

Strips the 'data: ' prefix from Server-Sent Events (SSE) chunks. Some providers like sagemaker send it as `data:`, need to handle bo

Validate that return_to matches the configured control_plane_url origin. Returns True if return_to is valid and should be used.

Verify ``candidate_url`` shares scheme, host, and port with ``expected_url``. Use when an upstream API returns a URL meant for follow-up requests

Receives - messages: List of dict - messages in the openai format Returns - messages - List[dict] - filtered list of

Runs before the LLM API call to validate and potentially modify input. Uses 'PROMPT' messageType as this is input to the model.

Close the WebSocket

Apply an extractor table to ``source``, dropping ``None`` results.

Derive the deterministic three-character prefix for a server. Uses SHA-256 of ``f"{server_id}#{attempt}"`` and folds the first eight bytes in

fal.ai image generation cost calculator

Calculate the cost of web search requests for X.AI models. X.AI Live Search costs $25 per 1,000 sources used. Each source costs $0.025.

Extract tool names from the request body for the given route. Uses guardrail translation handlers when available, else standalone extractors

Extract TTL from cached messages. Returns the first valid TTL found. Args: messages: List of messages to extract TTL from Retur

Get all of the configured mcp servers for the user in the db with their associated teams ``` curl --location 'http://localhos

Filter and transform beta headers based on provider's mapping configuration. This function: 1. Only allows headers that are present in t

Flush all updates from the queue and return all updates aggregated by entity type.

Aggregate updates by daily_transaction_key.

Extract app roles from the Microsoft Entra ID (Azure AD) id_token JWT. App roles are assigned in the Azure AD Enterprise Application

Must return the base completion call args

Returns a list of deployments that match the requested model and tags in the request. Executes tag based filtering based on the tags in requ

Returns end user object from database or cache. If end user exists but has no budget_id, applies the default budget (if configured via l

For a given model group name, return the combined model info Returns: - ModelGroupInfo if able to construct a model group

Get the server root path from the environment variables. - If SERVER_ROOT_PATH is set, return it. - Otherwise, default to "/".

Build the AgentCore URL, construct a JSON-RPC envelope, and sign the request. Args: request_id: A2A JSON-RPC request ID

Atomically increment spend counters for budget enforcement. Uses spend_counter_cache (DualCache with Redis backend when available) so co

Retrieve information about a key. Parameters: key: Optional[str] = Query parameter representing the key in the request user_a

Check if a resource ID is a base64 encoded unified ID. Args: resource_id: The resource ID to check prefix: The expected pref

Load the local backup model cost map bundled with the package.

Create GenericGuardrailAPIInputs with tool_calls.

Resets the budget for all LiteLLM End-Users (Customers), and Team Members if their budget has expired The corresponding Budget durati

Resolve the auth value for an MCP server. Priority: 1. ``mcp_auth_header`` — per-request/per-user override 2. OAuth2 Token Exchange (OBO

smtp_host, smtp_port, smtp_username, smtp_password, sender_name, sender_email,

Bulk-write all deployment health states as a single cache entry.

Transform Responses API response to chat completion response

Get URL and params for retrieving a file.

Transform Search request to Brave Search API format. Transforms Perplexity unified spec parameters: - query → q (same)

Trim a list of messages to fit within a model's token limit. Args: messages: Input messages to be trimmed. Each message is a diction

Update headers with optional anthropic beta.