MCPcopy Create free account
hub / github.com/abetlen/llama-cpp-python / __init__

Method __init__

llama_cpp/llama_speculative.py:20–22  ·  view source on GitHub ↗
(self, max_ngram_size: int = 2, num_pred_tokens: int = 10)

Source from the content-addressed store, hash-verified

18 """Based on https://github.com/apoorvumang/prompt-lookup-decoding"""
19
20 def __init__(self, max_ngram_size: int = 2, num_pred_tokens: int = 10):
21 self.max_ngram_size = max_ngram_size
22 self.num_pred_tokens = num_pred_tokens
23
24 @staticmethod
25 def find_candidate_pred_tokens(

Callers

nothing calls this directly

Calls

no outgoing calls

Tested by

no test coverage detected