MCPcopy Create free account
hub / github.com/SooLab/CGFormer / _convert_id_to_token

Method _convert_id_to_token

bert/tokenization_utils.py:675–676  ·  view source on GitHub ↗
(self, index: int)

Source from the content-addressed store, hash-verified

673 return tokens
674
675 def _convert_id_to_token(self, index: int) -> str:
676 raise NotImplementedError
677
678 def convert_tokens_to_string(self, tokens: List[str]) -> str:
679 """ Converts a sequence of tokens (string) in a single string.

Callers 1

convert_ids_to_tokensMethod · 0.95

Calls

no outgoing calls

Tested by

no test coverage detected