Save the tokenizer vocabulary to a directory. This method does *NOT* save added tokens and special token mappings. Please use :func:`~transformers.PreTrainedTokenizer.save_pretrained` `()` to save the full Tokenizer state if you want to reload it using the :func
(self, save_directory)
| 713 | return text |
| 714 | |
| 715 | def save_vocabulary(self, save_directory) -> Tuple[str]: |
| 716 | """ Save the tokenizer vocabulary to a directory. This method does *NOT* save added tokens |
| 717 | and special token mappings. |
| 718 | |
| 719 | Please use :func:`~transformers.PreTrainedTokenizer.save_pretrained` `()` to save the full |
| 720 | Tokenizer state if you want to reload it using the :func:`~transformers.PreTrainedTokenizer.from_pretrained` |
| 721 | class method. |
| 722 | """ |
| 723 | raise NotImplementedError |
nothing calls this directly
no outgoing calls
no test coverage detected