Function _cached_text

openkb/agent/compiler.py:263–274

Wrap a text payload into a content-block list with an Anthropic ephemeral cache_control marker. LiteLLM passes the marker through to Anthropic (and OpenRouter → Anthropic). For other providers the marker is stripped at the request egress (see :func:`_strip_cache_control`, applied in

(text: str)

def _cached_text(text: str) -> list[dict]:
    """Wrap a text payload into a content-block list with an Anthropic
    ephemeral cache_control marker.

    LiteLLM passes the marker through to Anthropic (and OpenRouter →
    Anthropic). For other providers the marker is stripped at the request
    egress (see :func:`_strip_cache_control`, applied in :func:`_llm_call`),
    because not every provider merely *ignores* it — Gemini in particular
    turns it into a 400. The list-of-blocks payload that remains is a valid
    OpenAI-compatible content shape.
    """
    return [{"type": "text", "text": text, "cache_control": {"type": "ephemeral"}}]


def _accepts_cache_control(model: str) -> bool: