MCPcopy Create free account
hub / github.com/THUDM/GLM / GetTokenizer

Method GetTokenizer

data_utils/datasets.py:402–403  ·  view source on GitHub ↗
(self)

Source from the content-addressed store, hash-verified

400 self._tokenizer = tokenizer
401
402 def GetTokenizer(self):
403 return self._tokenizer
404
405 @property
406 def tokenizer(self):

Callers

nothing calls this directly

Calls

no outgoing calls

Tested by

no test coverage detected