MCPcopy Create free account
hub / github.com/THUDM/GLM / GetTokenizer

Method GetTokenizer

data_utils/datasets.py:173–174  ·  view source on GitHub ↗
(self)

Source from the content-addressed store, hash-verified

171 self.wrapped_data.SetTokenizer(tokenizer)
172
173 def GetTokenizer(self):
174 return self.wrapped_data.GetTokenizer()
175
176 @property
177 def X(self):

Callers

nothing calls this directly

Calls 1

GetTokenizerMethod · 0.45

Tested by

no test coverage detected