MCPcopy Create free account
hub / github.com/zai-org/CodeGeeX / inv_vocab

Method inv_vocab

codegeex/megatron/tokenizer/tokenizer.py:138–140  ·  view source on GitHub ↗

Dictionary from vocab id token to text token.

(self)

Source from the content-addressed store, hash-verified

136 @property
137 @abstractmethod
138 def inv_vocab(self):
139 """Dictionary from vocab id token to text token."""
140 pass
141
142 @abstractmethod
143 def tokenize(self, text):

Callers

nothing calls this directly

Calls

no outgoing calls

Tested by

no test coverage detected