Build a minimal ModelResponse-like dict.

`preserve_litellm_internal_headers` must only be True when the input is a LiteLLM-owned dict (e.g. `_hidden_params["additional_headers"]` tha

Disconnect and reconnect the Prisma client with a new database URL. Kills the old engine subprocess directly (SIGTERM → SIGKILL) rather than

A call that should have succeeded but didn't is a hard failure, never a skip: if the proxy can't make a call it's expected to, the test must fail.

Check if management route is disabled and raise exception

Determine if message logging should be redacted. Priority order: 1. Dynamic parameter (turn_off_message_logging in request) 2. Heade

Transform a TinyFish response to LiteLLM's unified ``SearchResponse``. Mappings (per-result): - ``title`` → ``SearchResult.t

Transform the video creation request for Veo API. Veo expects: { "instances": [ {

Translate an OpenAI ResponsesAPIResponse to AnthropicMessagesResponse.

Expects LAGO_API_BASE, LAGO_API_KEY, LAGO_API_EVENT_CODE, Optional: LAGO_API_CHARGE_BY in t

Run the production call path: load from env, write to env.

Assert `fired` was called exactly once and every other op seam was not.

Get the function names from the previous 1-2 functions in the call stack. Args: num_frames: Number of previous frames to include (de

Force the OpenAI-compatible `model` field in the response to match what the client requested. LiteLLM internally prefixes some provider/depl

Build the minimal proxy_server module attributes that _run_centralized_common_checks reads. ``master_key`` defaults to a non-None value becau

Redact match-like fields from a Bedrock ApplyGuardrail JSON payload. Delegates to :func:`redact_nested_match_and_regex_keys` (same rules as

Strip ``s3://`` / ``gcs://`` entries from the DB-overlay value for fields whose contents reach ``get_instance_fn``. The same scheme is allowed

Add server name prefix to any MCP resource name.

- Check if the cache key is in-memory - Else: - add missing cache key from REDIS - update in-memory cache

Attempt to reconnect the Prisma client in a singleflight manner. Returns: bool: True if reconnection succeeded, else Fal

Removes litellm api key from headers Args: headers: Request headers litellm_key_header_name: Custom header name for LiteLLM

Seed a scratch-tagged key via /key/generate; returns its cleartext. Shared by the write-scenario matrices (key update/regenerate/delete). key

Register a teardown action for any resource the test just created.

Render the per-classification summary at session end. Output sections (only included when non-empty): * **Verdict counts** — full breakdown

Return a deep copy of metadata with callback_vars values encrypted at rest. Idempotent: a value that already decrypts cleanly is left unchanged s

Expand a permission list of server_ids/names/aliases into concrete server_ids against the current region's config + DB registry union

Get list of policy names attached to the given context. Args: context: The request context to match against Ret

Get the model tpm limit for a given api key. Priority order (returns first found): 1. Key metadata (model_tpm_limit) 2. Key model_ma

Get the MCP Server from the server name. Uses priority-based matching to avoid collisions: 1. First pass: exact alias match

Mock iter_lines method for synchronous streaming.

Load attachments from a configuration list. Args: attachments_config: List of attachment dictionaries from YAML.

Helper to create a mock file object

Route a requested model to the corresponding llm deployments based on the regex pattern loop through all the patterns and find the m

Log a spend-tracking error, with the traceback gated on the env var. By default this behaves like ``verbose_proxy_logger.exception`` — the ac

Transform a LiteLLM search request to TinyFish's querystring format. Maps LiteLLM's unified-spec params (see ``BaseSearchCon

Walk the model_config precedence chain in team/project metadata. If a matching credential is found, set api_base/api_key/api_version on data

Build a managed container ID with provider and model info encoded. Format: cntr_{base64("litellm:custom_llm_provider:{provider};model_id:{mod

Build filter conditions for key listing. Visibility rules: - Users always see their own keys (user_id match) - Team admins see ALL keys f

Build the User-Agent string for Databricks API calls. If a custom user agent is provided, the partner name (part before /) i

Creates a span for Guardrail, if any guardrail information is present in standard_logging_object

Utility to create a mocked async httpx client for the given method.

Get the API endpoint for a given model.

Build a minimal mock ResponsesAPIResponse.

Build a router model_list from a compact spec. spec entry shape: { "model_name": str, "quality_tier": Optional[int],

Resolve the target Phoenix/Arize project for this request. Proxy priority: ``user_api_key_auth_metadata.phoenix_project_name_overrid

Calculate response cost using result + logging object variables. used for consistent cost calculation across response headers + logg

Run a reconnect cycle with a single overall timeout budget. Uses the _engine_confirmed_dead flag (set by waitpid thread / pidfd / po

Transforms ResponseAPIUsage or ImageUsage to a Usage object. Both have the same spec with input_tokens, output_tokens, and i

Try to transform Vertex AI batch output to OpenAI format. If conversion fails at any point, return the original content as-is.

Build a mocked Repello analyze response with the given verdict.

The four required attributes on the SERVER span must all be set.

Try calling the function_with_retries If it fails after num_retries, fall back to another model group

Synthesize a chat-style messages list for posting to a guardrail API. Each returned message has a plain-string ``content`` — multimodal text

Check if route is a passthrough route. Supports both exact match and prefix match.

Convert a file-type document dict to a document_url-type document dict with an inline base64 data URI. Accepts document dicts like:

Validate and configure the Databricks environment. Authentication priority: 1. OAuth M2M (DATABRICKS_CLIENT_ID + DATABRICKS_

Decode provider and model_id from encoded video_id.