MCPcopy Create free account
hub / github.com/abetlen/llama-cpp-python / copy_prompt_state

Method copy_prompt_state

examples/server/server.py:12676–12682  ·  view source on GitHub ↗
(
        self,
        source_sequence_id: int,
        dest_sequence_id: int,
        keep_len: int,
    )

Source from the content-addressed store, hash-verified

12674
12675 @abc.abstractmethod
12676 def copy_prompt_state(
12677 self,
12678 source_sequence_id: int,
12679 dest_sequence_id: int,
12680 keep_len: int,
12681 ) -> None:
12682 raise NotImplementedError
12683
12684
12685class AttentionMemoryPolicy(MemoryPolicy):

Callers 2

admit_requestMethod · 0.45
start_completionsMethod · 0.45

Calls

no outgoing calls

Tested by

no test coverage detected