Method encode

codegeex/mindspore/src/tokenization_jieba.py:71–73

(self, text)

        return self.decode(ids)

    def encode(self, text):
        res = self.tokenize(text)
        return res

    def decode(self, tokens):
        text = self.sp.decode(tokens)