Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/Vision-CAIR/VisualGPT
/ items
Method
items
data/tokenization_utils_base.py:205–206 ·
view source on GitHub ↗
(self)
Source
from the content-addressed store, hash-verified
203
return
self.data.values()
204
205
def
items(self):
206
return
self.data.items()
207
208
# After this point:
209
# Extended properties and methods only available for fast (Rust-based) tokenizers
Callers
15
_encode_plus
Method · 0.95
convert_to_tensors
Method · 0.95
download_from_url
Function · 0.80
__init__
Method · 0.80
__init__
Method · 0.80
save_vocabulary
Method · 0.80
__getitem__
Method · 0.80
http_get
Function · 0.80
get_added_vocab
Method · 0.80
__init__
Method · 0.80
__init__
Method · 0.80
__init__
Method · 0.80
Calls
no outgoing calls
Tested by
no test coverage detected