Map OpenAI-style tools/functions to Vertex AI format. Args: value: List of tool definitions optional_params:

Check if a record exists.

Guarantees response from 'get_secret' is either boolean or none. Used for fixing linting errors. Args: secret_name: The name of the

Setup guardrail with all Canadian PII patterns (mimics the policy template)

Check if the given model supports function calling and return a boolean value. Parameters: model (str): The model name to be checked.

Keep this state less - leave the state management (e.g. tracking current_output_item_id, current_response_id, current_conversation_id, curren

Get the OpenAI compatible provider info for Baseten

Build a mock httpx response with the given JSON body.

Transforms OpenAI JSONL content to Bedrock batch format Bedrock batch format: { "recordId": "alphanumeric string", "modelInput": {JS

Adds/updates to kwargs: - num_retries - litellm_trace_id - metadata

Convert an OpenAI-format message array to OCI GENERIC format.

Implementing async callbacks, to handle asyncio event loop issues when custom integrations need to use async functions.

Raise HTTP 403 if the user's role is blocked from accessing the given feature by the UI settings stored in general_settings. Args:

Create an audit log for an object.

Create the rate limit keys for the given key and value.

For closing connection on server shutdown

Get the bedrock route for the given model.

Read current spend from the cross-pod spend counter. Reads Redis FIRST (authoritative cross-pod value), not DualCache's async_get_cache

Check if key valid

Resolve the request route from the ASGI scope, with ``root_path`` stripped. Prefer this over ``request.url.path`` for any auth, ACL, routing

Handle MCP requests through StreamableHTTP.

Returns a dictionary of label + values for prometheus. Ensures end_user param is not sent to prometheus if it is not supported. When ``

Alerting based on thresholds: - https://github.com/BerriAI/litellm/issues/1298 - Responses taking too long - Requests are ha

Helper function to know if a provider implementation supports httpx timeout

Build JWT claims for the outbound MCP access token. Args: user_api_key_dict: LiteLLM auth context for the current reques

Inspect ``litellm.callbacks`` once and answer the per-hook capability questions used to short-circuit no-op work on the chat-completi

Call review_gate with safe defaults for the injectable hooks.

Returns the appropriate client based on the given deployment, kwargs, and client_type. Parameters: deployment (dict): Th

Lightweight server stand-in for the per-user env-var endpoints. The handlers only read ``server_id``/``server_name``/``alias``/``env_vars``/

Build a Prisma-like row object.

Common transformation logic across sync + async Gemini /generateContent calls.

Helper function to update all metadata fields (both premium and standard). Args: updated_kv: The key-value dict being used for the u

Iterate through all models in a model group to check for batch Future Improvement - cache the result.

Arize is used mainly for LLM I/O tracing, sending router+caching metrics adds bloat to arize logs

Call from ``pytest_terminal_summary``. No-op on xdist workers.