MCPcopy Create free account
hub / github.com/THUDM/GLM / __init__

Method __init__

data_utils/tokenization.py:484–488  ·  view source on GitHub ↗
(self)

Source from the content-addressed store, hash-verified

482 """
483
484 def __init__(self):
485 if not hasattr(self, 'num_text_tokens'):
486 self.num_text_tokens = 0
487 if not hasattr(self, 'num_tokens'):
488 self.num_tokens = self.num_text_tokens
489
490 def __call__(self, text, process_fn=None):
491 return self.EncodeAsIds(text, process_fn)

Callers

nothing calls this directly

Calls

no outgoing calls

Tested by

no test coverage detected