Code
Hub
Workspaces
Following
Digest
Agents
Trending
Connect
MCP
copy
Index your code
hub
/
github.com/zai-org/CodeGeeX
/ index
Method
index
codegeex/mindspore/src/code_tokenizer.py:112–113 ·
view source on GitHub ↗
(self, sym: str)
Source
from the content-addressed store, hash-verified
110
return
self._num_symbols
111
112
def
index(self, sym: str):
113
return
self._idx[sym]
114
115
def
string(self, idx: int):
116
return
self._symbols[idx]
Callers
2
map_token
Method · 0.95
bpe
Method · 0.80
Calls
no outgoing calls
Tested by
no test coverage detected