MCPcopy Create free account
hub / github.com/abetlen/llama-cpp-python / __init__

Method __init__

examples/server/server.py:12617–12618  ·  view source on GitHub ↗
(self, scheduler: CompletionScheduler)

Source from the content-addressed store, hash-verified

12615
12616class MemoryPolicy(abc.ABC):
12617 def __init__(self, scheduler: CompletionScheduler) -> None:
12618 self.scheduler = scheduler
12619
12620 def reclaim_order(self, best_free: Optional[int]) -> List[int]:
12621 reclaim_order = [seq_id for seq_id in self.scheduler.free_sequences if seq_id != best_free]

Callers

nothing calls this directly

Calls

no outgoing calls

Tested by

no test coverage detected