MCPcopy Create free account
hub / github.com/THUDM/GLM / GetTokenizer

Method GetTokenizer

data_utils/datasets.py:306–307  ·  view source on GitHub ↗
(self)

Source from the content-addressed store, hash-verified

304 self._tokenizer = tokenizer
305
306 def GetTokenizer(self):
307 return self._tokenizer
308
309 @property
310 def tokenizer(self):

Callers 3

GetTokenizerMethod · 0.45
GetTokenizerMethod · 0.45
__init__Method · 0.45

Calls

no outgoing calls

Tested by

no test coverage detected