MCPcopy Create free account
hub / github.com/OpenMOSS/MOSS / vocab_size

Method vocab_size

models/tokenization_moss.py:190–191  ·  view source on GitHub ↗
(self)

Source from the content-addressed store, hash-verified

188
189 @property
190 def vocab_size(self):
191 return len(self.encoder)
192
193 def get_vocab(self):
194 return dict(self.encoder, **self.added_tokens_encoder)

Callers

nothing calls this directly

Calls

no outgoing calls

Tested by

no test coverage detected