Convert a list or tokenization object of Ids to a text string
(self, Ids)
| 535 | raise NotImplementedError('TextTokenizer TokenToId not implemented') |
| 536 | |
| 537 | def DecodeIds(self, Ids): |
| 538 | """Convert a list or tokenization object of Ids to a text string""" |
| 539 | raise NotImplementedError('TextTokenizer DecodeIds not implemented') |
| 540 | |
| 541 | def DecodeTokens(self, Tokens): |
| 542 | """Convert a list or tokenization object of tokens to a text string""" |
nothing calls this directly
no outgoing calls
no test coverage detected