MCPcopy Create free account
hub / github.com/THUDM/GLM / convert_id_to_token

Method convert_id_to_token

data_utils/sp_tokenizer.py:126–127  ·  view source on GitHub ↗
(self, idx)

Source from the content-addressed store, hash-verified

124 return self.sp.PieceToId(token)
125
126 def convert_id_to_token(self, idx):
127 return self.sp.IdToPiece(idx)
128
129
130def get_encoder(encoder_file, bpe_file):

Callers 1

IdToTokenMethod · 0.80

Calls

no outgoing calls

Tested by

no test coverage detected