Class Dictionary

fairseq/data/dictionary.py:17–304 · view source on GitHub ↗

A mapping from symbols to consecutive integers

Source from the content-addressed store, hash-verified

source not stored for this graph (policy: none)

padding_idxMethod · 0.90

build_dictionaryMethod · 0.90

_get_test_data_with_bpe_cont_markerMethod · 0.90

_get_test_data_with_bpe_end_markerMethod · 0.90

_get_test_data_with_word_vocabMethod · 0.90

dummy_dictionaryFunction · 0.90

test_finalizeMethod · 0.90

test_character_token_embedderMethod · 0.90

get_dummy_dictionaryFunction · 0.90

no outgoing calls

_get_test_data_with_bpe_cont_markerMethod · 0.72

_get_test_data_with_bpe_end_markerMethod · 0.72

_get_test_data_with_word_vocabMethod · 0.72

test_finalizeMethod · 0.72

test_character_token_embedderMethod · 0.72

get_dummy_dictionaryFunction · 0.72