MCPcopy Create free account
hub / github.com/SooLab/CGFormer / save_vocabulary

Method save_vocabulary

bert/tokenization_utils.py:715–723  ·  view source on GitHub ↗

Save the tokenizer vocabulary to a directory. This method does *NOT* save added tokens and special token mappings. Please use :func:`~transformers.PreTrainedTokenizer.save_pretrained` `()` to save the full Tokenizer state if you want to reload it using the :func

(self, save_directory)

Source from the content-addressed store, hash-verified

713 return text
714
715 def save_vocabulary(self, save_directory) -> Tuple[str]:
716 """ Save the tokenizer vocabulary to a directory. This method does *NOT* save added tokens
717 and special token mappings.
718
719 Please use :func:`~transformers.PreTrainedTokenizer.save_pretrained` `()` to save the full
720 Tokenizer state if you want to reload it using the :func:`~transformers.PreTrainedTokenizer.from_pretrained`
721 class method.
722 """
723 raise NotImplementedError

Callers

nothing calls this directly

Calls

no outgoing calls

Tested by

no test coverage detected