Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/bytedance/ABQ-LLM
/ tok_encode
Method
tok_encode
algorithm/models/models_utils.py:184–185 ·
view source on GitHub ↗
(self, string: str)
Source
from the content-addressed store, hash-verified
182
183
@abstractmethod
184
def
tok_encode(self, string: str):
185
pass
186
187
@abstractmethod
188
def
tok_decode(self, tokens: Iterable[int]):
Callers
4
loglikelihood
Method · 0.95
loglikelihood_rolling
Method · 0.95
_collate
Method · 0.95
greedy_until
Method · 0.95
Calls
no outgoing calls
Tested by
no test coverage detected