MCPcopy Create free account
hub / github.com/abetlen/llama-cpp-python / _evict_if_needed

Method _evict_if_needed

examples/server/server.py:12545–12552  ·  view source on GitHub ↗
(self)

Source from the content-addressed store, hash-verified

12543 self._remove_entry(entry)
12544
12545 def _evict_if_needed(self) -> None:
12546 if self.max_bytes <= 0:
12547 for entry in list(self._entries_by_id.values()):
12548 self._remove_entry(entry)
12549 return
12550 if self._size_bytes > self.max_bytes:
12551 self._evict_until(self.max_bytes)
12552 self._evict_until(int(self.max_bytes * 0.9))
12553
12554 def lookup(self, tokens: Sequence[int]) -> Optional[SequenceCache.Match]:
12555 if not tokens:

Callers 2

__init__Method · 0.95
saveMethod · 0.95

Calls 2

_remove_entryMethod · 0.95
_evict_untilMethod · 0.95

Tested by

no test coverage detected