MCPcopy Create free account
hub / github.com/UbiquitousLearning/mllm / Cache

Method Cache

mllm/engine/prefix_cache/Cache.cpp:11–12  ·  view source on GitHub ↗

Source from the content-addressed store, hash-verified

9namespace mllm::prefix_cache {
10
11Cache::Cache(const CacheOptions& options)
12 : options_(options), tree_(options.radix_tree_options), allocator_(options.allocator_options) {}
13
14void Cache::promote(const std::vector<int64_t>& token_ids, const std::vector<std::vector<vp_addr_t>>& key_cache_addresses,
15 const std::vector<std::vector<vp_addr_t>>& value_cache_addresses, int64_t extra_key) {

Callers

nothing calls this directly

Calls

no outgoing calls

Tested by

no test coverage detected