MCPcopy Create free account
hub / github.com/huggingface/transformers / items

Method items

src/transformers/tokenization_utils_base.py:205–206  ·  view source on GitHub ↗
(self)

Source from the content-addressed store, hash-verified

203 return self.data.values()
204
205 def items(self):
206 return self.data.items()
207
208 # After this point:
209 # Extended properties and methods only available for fast (Rust-based) tokenizers

Callers 15

_encode_plusMethod · 0.95
convert_to_tensorsMethod · 0.95
convert_examples_to_featuresFunction · 0.80
get_final_textFunction · 0.80
trainFunction · 0.80
mainFunction · 0.80
save_vocabularyMethod · 0.80
_prune_headsMethod · 0.80
_prune_headsMethod · 0.80
_prune_headsMethod · 0.80
load_tf_weights_in_xlnetFunction · 0.80
infer_shapesFunction · 0.80

Calls

no outgoing calls

Tested by 15

_prepare_for_classMethod · 0.64
_create_and_check_torchscriptMethod · 0.64
test_multigpu_data_parallel_forwardMethod · 0.64
create_and_test_config_to_json_stringMethod · 0.64
test_pretrained_model_listsMethod · 0.64
test_padding_to_multiple_ofMethod · 0.64
test_get_vocabMethod · 0.64
test_conversion_reversibleMethod · 0.64
test_model_for_pretraining_from_pretrainedMethod · 0.64
test_parents_and_children_in_mappingsMethod · 0.64
test_mbart_enro_configMethod · 0.64
test_xsum_config_generation_paramsMethod · 0.64