File vllm_kv_cache_memory.py

examples/core_memories/vllm_kv_cache_memory.py:None–None

#!/usr/bin/env python3
"""
Example demonstrating how to use VLLMKVCacheMemory with vLLM backend.
This example shows how to use the new vLLM-compatible KV cache memory.