MCPcopy Create free account
hub / github.com/OpenBitSys/BitDistiller / tok_encode

Method tok_encode

test/general/lm_eval/base.py:154–155  ·  view source on GitHub ↗
(self, string: str)

Source from the content-addressed store, hash-verified

152
153 @abstractmethod
154 def tok_encode(self, string: str):
155 pass
156
157 @abstractmethod
158 def tok_decode(self, tokens: Iterable[int]):

Callers 5

_encode_pairMethod · 0.95
loglikelihoodMethod · 0.95
loglikelihood_rollingMethod · 0.95
_collateMethod · 0.95
greedy_untilMethod · 0.95

Calls

no outgoing calls

Tested by

no test coverage detected