Apply Bedrock guardrail to a batch of texts for testing purposes. This method allows users to test Bedrock guardrails without making

Validate that a polling URL points to a BFL-controlled host. BFL returns polling URLs on subdomains like ``gateway.bfl.ai`` that differ from

Pre-call hook to sanitize user prompts.

Example Usage: ``` from litellm import Router client = Router(model_list = [ { "model_na

Run a Prisma read coroutine with one transport-reconnect-and-retry. The canonical "self-heal a transient DB transport blip" wrapper used by `

Receives - messages: List of dict - messages in the openai format Returns - messages - List[dict] - filtered list of

Extracts and processes file data from various input formats. Args: file_data: Can be a tuple of (filename, content, [content_type],

Return the API key for this provider.

Get the global AttachmentRegistry singleton. Returns: The global AttachmentRegistry instance

Get Azure AD token from various authentication methods. This function tries different methods to obtain an Azure AD token: 1. From an ex

Retrieves the Levo configuration based on environment variables. Returns: LevoConfig: Configuration object containing Le

In-memory TTL for management-object cache writes (keys, teams, users, budgets, ...). Honors ``general_settings.user_api_key_cache_ttl``, whi

Hash a password using scrypt with a random salt.

1. Create a global list of pass-through endpoints (db + config) 2. Clear all existing pass-through endpoints from the FastAPI app routes

Activate the live-call socket probe for non-VCR-marked tests. Call this from inside the per-test autouse ``_vcr_outcome_gate`` fixture *befor

Returns true, if message is marked as needing to be cached. Used for anthropic/gemini context caching. Follows the anthropic format {"c

Yield every text fragment from ``messages`` AND ``input``. Walks every role (user, assistant, system, …) — guardrails inspect the entire conv

Create a MockPrismaClient for /spend/logs/ui endpoint tests. Args: mock_spend_logs: List of mock spend log dicts. filter_fn:

Default to exclude_unset to avoid Pydantic serializer warnings for OpenAIObject-derived types.

Redacts or excludes fields from StandardLoggingPayload before callbacks receive it. This method handles two features: 1. tur

Scrub known secret/credential patterns from *value* and return the result.

Setup guardrail with all UofT patterns (mimics the policy template sub-guardrail)

Transform a Responses API tools into a Chat Completion tools

Transform generate_content request to litellm completion format Args: model: The model name contents: Genera

Convert Anthropic thinking param to Responses API reasoning param. ``thinking.budget_tokens`` is bucketed via the shared ``r

Verify a password against a stored hash. Supports scrypt and SHA256.

Encode model_id into an output item ID for encrypted-content items. Format: ``encitem_{base64("litellm:model_id:{model_id};item_id:{original_

Shared response-building logic (also used by the handler).

Build a synthetic FastAPI Request for sampling sub-calls. Converts the original MCP connection's HTTP headers into ASGI scope format so that

Creates an AiohttpTransport with RequestNotRead error handling Note: aiohttp TCPConnector ssl parameter accepts: - SSLContex

Return (start_date, end_date) for the common 7-day range used in UI spend tests.

Extract citation tokens and search queries from Perplexity API response and add them to the usage object using standard LiteLLM field

If `exc` is an HTTPException with a dict `detail`, mutate it in place to add `guardrail_name` and `guardrail_mode` taken from the callback in

Walk a Bedrock Converse request body and collect text content. Returns (texts, holders) where each holder is the (container, key) pair t

Check if database is connected and raise HTTPException if not.

Check if a model has zero cost (no configured pricing). Uses the router's get_model_group_info method to get pricing information. Args:

Build a MagicMock prisma_client whose user-credentials table returns ``row`` for find_unique and behaves async-correctly for upsert/find_many.

Enforce the authorized model and apply Presidio PII masking to a ``response.create`` message before it is forwarded to the upstream

Validate a managed GCS file_id and return (bucket, url-encoded-object-path).

Convert a list of database records to domain models.

Apply guardrails to inputs from policy names and/or a direct list of guardrail names. Runs all guardrails in order; if one fails, the error

For masking logged request/response. Return a modified version of the request/result.

Actual callback function that Boto3 will call.

Check if background responses are complete and track their cost. - Get all status="queued" or "in_progress" and file_purpose="respons

Parse a Responses API streaming chunk and convert to OpenAI format. Args: chunk: Dict containing the Responses API event

Public entry point — returns the model cost map dict. 1. If ``LITELLM_LOCAL_MODEL_COST_MAP`` is set, uses the local backup only. 2. Othe

Perform a health check on a specific MCP server. Args: server_id: The ID of the server to health check mcp_a