MCPcopy Create free account
hub / github.com/SooLab/CGFormer / pad_token_id

Method pad_token_id

bert/tokenization_utils_base.py:842–846  ·  view source on GitHub ↗

Id of the padding token in the vocabulary. Log an error if used while not having been set.

(self)

Source from the content-addressed store, hash-verified

840
841 @property
842 def pad_token_id(self):
843 """ Id of the padding token in the vocabulary. Log an error if used while not having been set. """
844 if self._pad_token is None:
845 return None
846 return self.convert_tokens_to_ids(self.pad_token)
847
848 @property
849 def pad_token_type_id(self):

Callers

nothing calls this directly

Calls 1

convert_tokens_to_idsMethod · 0.80

Tested by

no test coverage detected