Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/SooLab/CGFormer
/ _convert_token_to_id
Method
_convert_token_to_id
bert/tokenization_utils.py:399–400 ·
view source on GitHub ↗
(self, token)
Source
from the content-addressed store, hash-verified
397
return
self._convert_token_to_id(token)
398
399
def
_convert_token_to_id(self, token):
400
raise
NotImplementedError
401
402
def
_encode_plus(
403
self,
Callers
1
_convert_token_to_id_with_added_voc
Method · 0.95
Calls
no outgoing calls
Tested by
no test coverage detected