MCPcopy Create free account
hub / github.com/Tiiny-AI/PowerInfer / kv_cache_clear

Method kv_cache_clear

examples/server/server.cpp:860–864  ·  view source on GitHub ↗

Source from the content-addressed store, hash-verified

858 }
859
860 void kv_cache_clear() {
861 // clear the entire KV cache
862 llama_kv_cache_clear(ctx);
863 clean_kv_cache = false;
864 }
865
866 void update_system_prompt() {
867 system_tokens = ::llama_tokenize(ctx, system_prompt, true);

Callers

nothing calls this directly

Calls 1

llama_kv_cache_clearFunction · 0.85

Tested by

no test coverage detected