MCPcopy Create free account
hub / github.com/abetlen/llama-cpp-python / draft_input_ids

Method draft_input_ids

examples/server/server.py:14194–14198  ·  view source on GitHub ↗
(self, completion: Completion)

Source from the content-addressed store, hash-verified

14192 return made_progress
14193
14194 def draft_input_ids(self, completion: Completion) -> np.ndarray:
14195 return np.array(
14196 [*completion.prompt_tokens, *completion.completion_tokens],
14197 dtype=np.intc,
14198 )
14199
14200 def process_sampled_draft_batch(
14201 self,

Callers 2

Calls

no outgoing calls

Tested by

no test coverage detected