Return the row in the db

DualCache is a cache implementation that updates both Redis and an in-memory cache simultaneously. When data is updated or inserted, it is wr

LiteLLM Params without 'model' arg (used across completion / assistants api)

Logging/Custom Handlers for proxy. Implemented mainly to: - log successful/failed db read/writes - support the max parallel request

Reference: https://docs.anthropic.com/claude/reference/messages_post to pass metadata to anthropic, it's {"user_id": "any-relevant-informati

Abstraction class on top of config loading/updating logic. Gives us one place to control all config updating logic.

Reference - https://docs.aws.amazon.com/bedrock/latest/APIReference/API_runtime_Converse.html #2 - https://docs.aws.amazon.com/bedrock/latest

A class to define the roles and permissions for a LiteLLM Proxy w/ JWT Auth. Attributes: - admin_jwt_scope: The JWT scope required for p

- treat the sub id passed in as the user id - return an error if id making request doesn't exist in proxy user table - track spend agains

LiteLLM Params with 'model' requirement - used for completions

Reference: https://cloud.google.com/vertex-ai/docs/generative-ai/chat/test-chat-prompts Reference: https://cloud.google.com/vertex-ai/generat

LiteLLM BaseConfig implementation for OCI Generative AI chat.

Represents the url or the content of an image generated by the OpenAI API. Attributes: b64_json: The base64-encoded JSON of the generate

Repository for team database operations.

Content filter guardrail that detects sensitive information using: - Prebuilt regex patterns (SSN, credit cards, API keys, etc.) - Custom

Represents user-controllable params for a LiteLLM_BudgetTable record. Budget-write paths use `model_fields.keys()` on this class as an allowlist

Repository for user database operations.

Call Claude model family in the /v1/messages API spec Supports anthropic_beta parameter for beta features.

Base for header models. Subclasses may alias to hyphenated header names (e.g. ``x-litellm-api-key``); serialization uses by_alias.

CustomLogger that intercepts WebSearch tool calls for models that don't natively support web search. Implements agentic loop: 1. Det

A user's OAuth credential: the bearer value, when it expires, and how to refresh it. ``expires_at`` is epoch seconds (``None`` means no known exp

Represents a LiteLLM_ObjectPermissionTable record

Repository for verification token (API key) database operations.

Used for slack budget alerting

Lasso Security Guardrail integration for LiteLLM. Provides content moderation, PII detection, and policy enforcement through the Lasso S

A 429 raised by litellm's proxy-side rate limiting hooks. This class deliberately inherits from BOTH :class:`litellm.exceptions.RateLimi

Prometheus metric label inputs (Python field names match historical Pydantic ``model_dump`` keys). Immutable value object: use ``dataclasses

CustomLogger that implements transparent code-interpreter execution loops. Flow: 1. Replace the native ``code_interpreter`` tool with a

Configuration class for OpenAI video generation.