MCPcopy Create free account
hub / github.com/THUDM/GLM / __init__

Method __init__

data_utils/sp_tokenizer.py:99–101  ·  view source on GitHub ↗
(self, model_path)

Source from the content-addressed store, hash-verified

97
98class Encoder_SP:
99 def __init__(self, model_path):
100 self.sp = spm.SentencePieceProcessor()
101 self.sp.Load(model_path)
102
103 def encode(self, text):
104 """

Callers

nothing calls this directly

Calls

no outgoing calls

Tested by

no test coverage detected