Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/OpenMOSS/MOSS
/ vocab_size
Method
vocab_size
models/tokenization_moss.py:190–191 ·
view source on GitHub ↗
(self)
Source
from the content-addressed store, hash-verified
188
189
@property
190
def
vocab_size(self):
191
return
len(self.encoder)
192
193
def
get_vocab(self):
194
return
dict(self.encoder, **self.added_tokens_encoder)
Callers
nothing calls this directly
Calls
no outgoing calls
Tested by
no test coverage detected