MCPcopy Create free account
hub / github.com/abetlen/llama-cpp-python / __init__

Method __init__

examples/server/server.py:1209–1211  ·  view source on GitHub ↗
(self, max_ngram_size: int = 2, num_pred_tokens: int = 10)

Source from the content-addressed store, hash-verified

1207
1208class PromptLookupDecoding(DraftProvider):
1209 def __init__(self, max_ngram_size: int = 2, num_pred_tokens: int = 10) -> None:
1210 self._max_ngram_size = max_ngram_size
1211 self._num_pred_tokens = num_pred_tokens
1212
1213 def draft(
1214 self,

Callers

nothing calls this directly

Calls

no outgoing calls

Tested by

no test coverage detected