MCPcopy Create free account
hub / github.com/LargeWorldModel/LWM / vocab_size

Method vocab_size

lwm/data.py:329–330  ·  view source on GitHub ↗
(self)

Source from the content-addressed store, hash-verified

327
328 @property
329 def vocab_size(self):
330 return len(self._tokenizer)
331
332
333class JsonDataset(object):

Callers

nothing calls this directly

Calls

no outgoing calls

Tested by

no test coverage detected