Add a coroutine to the logging queue. Hot path: never blocks, aggressively clears queue if full.

Execute pipeline steps sequentially with conditional actions. Args: steps: Ordered list of pipeline steps mo

Read config from the environment, falling back to defaults. An invalid value warns and uses the default rather than failing startup.

Resolve Anthropic credentials and return the appropriate auth header dict. Checks ANTHROPIC_API_KEY first (-> x-api-key or Bearer depending o

Get the budget reset time based on the configured timezone. Falls back to UTC if not specified.

Get API credentials and provider info from a model name in model_list. Useful for passthrough endpoints (files, batches, etc.) that n

Get the model rpm limit for a given api key. Priority order (returns first found): 1. Key metadata (model_rpm_limit) 2. Key model_ma

Map OCR parameters to provider-specific parameters.

Serialize a Pydantic model to a dictionary while preserving specific fields even if they are None. Fields listed in _PRESERVED_NONE_FIEL

Run pre-call checks and guardrail hooks for an MCP tool call. Returns a dict that may contain: - "arguments": hook-modified

Scrub known secret/credential patterns from *value* and return the result.

Optionally drop end-user ids that don't resolve to a known DB row. Default: pass-through. LiteLLM's documented pattern is that the `user` fie

Resolve ``(model, llm_provider)`` for a request being rejected by an internal proxy-side rate-limit hook. These hooks fire from ``async_

Open a session, run the provided coroutine, and clean up.

Only runs if router.slack_alerting_logger is set Sends a Slack / MS Teams alert for the LLM API call failure. Only if router.slack_alerting_l

Determine if polling via cache should be used for a request. Args: background_mode: Whether background=true was set in the request

Transform the request for Manus API. Manus requires: - `task_mode: "agent"` in the request body - `agent_profile` ex

Return a usable end-user identifier string, or None if the value isn't one. Always drops non-string structured values (dict/list/tuple/set) becau

Create the standard logging object for Anthropic passthrough handles streaming and non-streaming responses

Decode the responses_api_response_id Returns: DecodedResponseId: Structured tuple with custom_llm_provider, model_id, an

Invalidate the case-insensitive lookup map for model_cost. Call this whenever litellm.model_cost is modified to ensure the map is rebuilt. Al

Check if user is an org admin for the team's organization. Returns True if: - The team belongs to an organization, AND - The user ha

Process a single chunk of data from the stream

Returns: - ``UserAPIKeyAuth``: a resolved virtual key (cache hit or DB hit). The caller may use this directly; JWT policy has been

Sign a request for Bedrock or Sagemaker Returns: Tuple[dict, Optional[str]]: A tuple containing the headers and the json

Apply Bedrock guardrail to a batch of texts for testing purposes. This method allows users to test Bedrock guardrails without making

Validate that a polling URL points to a BFL-controlled host. BFL returns polling URLs on subdomains like ``gateway.bfl.ai`` that differ from

Pre-call hook to sanitize user prompts.

Example Usage: ``` from litellm import Router client = Router(model_list = [ { "model_na

Run a Prisma read coroutine with one transport-reconnect-and-retry. The canonical "self-heal a transient DB transport blip" wrapper used by `

Receives - messages: List of dict - messages in the openai format Returns - messages - List[dict] - filtered list of

Extracts and processes file data from various input formats. Args: file_data: Can be a tuple of (filename, content, [content_type],

Return the API key for this provider.

Get the global AttachmentRegistry singleton. Returns: The global AttachmentRegistry instance

Get Azure AD token from various authentication methods. This function tries different methods to obtain an Azure AD token: 1. From an ex

Retrieves the Levo configuration based on environment variables. Returns: LevoConfig: Configuration object containing Le

In-memory TTL for management-object cache writes (keys, teams, users, budgets, ...). Honors ``general_settings.user_api_key_cache_ttl``, whi

Hash a password using scrypt with a random salt.

1. Create a global list of pass-through endpoints (db + config) 2. Clear all existing pass-through endpoints from the FastAPI app routes

Initialize the standard callback dynamic params from the kwargs checks supported request callback params in kwargs and sets the correspondin

Activate the live-call socket probe for non-VCR-marked tests. Call this from inside the per-test autouse ``_vcr_outcome_gate`` fixture *befor

Returns true, if message is marked as needing to be cached. Used for anthropic/gemini context caching. Follows the anthropic format {"c

Yield every text fragment from ``messages`` AND ``input``. Walks every role (user, assistant, system, …) — guardrails inspect the entire conv

Load the local backup model cost map bundled with the package.

Create a MockPrismaClient for /spend/logs/ui endpoint tests. Args: mock_spend_logs: List of mock spend log dicts. filter_fn: