Context manager that overrides ``user_api_key_auth`` for a role. Usage:: def test_admin_only(client, auth_as): from litellm.

Example usage: response = router.completion(model="gpt-3.5-turbo", messages=[{"role": "user", "content": "Hey, how's it going?"}]

Returns the provider for a given model name - e.g. 'azure/chatgpt-v-2' -> 'azure' For router -> Can also give the whole litellm param dict -

Replace volatile field values with "<VOLATILE>" so dict equality works. Recursive over dicts and lists. Pass an explicit ``volatile`` set to

For a given model id, return the model info Returns - dict: the model in list with 'model_name', 'litellm_params', Optional[

Load providers from JSON configuration file

Recursively serialize data while detecting circular references. If a circular reference is detected then a marker string is returned. NUL

Get a compiled regex pattern by name. Args: pattern_name: Name of the prebuilt pattern Returns: Compiled regex pattern

Helper to construct a guardrail with test defaults.

Get the complete URL for the CometAPI call. Returns: str: The complete URL for the API call.

Calculate the cost of a given completion call fot GPT-3.5-turbo, llama2, any litellm supported llm. Parameters: completion_response

Add a callback to litellm.callbacks Ensures no duplicates are added.

Common request processing logic for both chat completions and responses API endpoints

Generate a mock UserAPIKeyAuth object

Adds LiteLLM-specific data to the request. Args: data (dict): The data dictionary to be modified. request (Request): The inc

Factory for test handlers with standard defaults.

Create a new credential. Args: credential_name (str): Name of the credential credential_info (Dict[str, Any]

Clear all policies from the registry.

Read response content.

Raises ProxyException (OpenAI API compatible) if an exception is raised

Percent-encode one user-controlled URL path segment. ``urllib.parse.quote(..., safe="")`` intentionally leaves RFC 3986 unreserved characters

Start a span for ``role`` without dedup or attribute mapping. For callers that own and manage their own span lifecycle. ``tracer`` ov

Convenience wrapper around update_environment_variables that automatically extracts metadata/litellm_metadata from kwargs, so

Count records matching the criteria.