MCPcopy Create free account
hub / github.com/HA-Transformer/MAT / finalize

Method finalize

fairseq/data/dictionary.py:113–156  ·  view source on GitHub ↗

Sort symbols by frequency in descending order, ignoring special ones. Args: - threshold defines the minimum word count - nwords defines the total number of words in the final dictionary, including special symbols - padding_factor can be us

(self, threshold=-1, nwords=-1, padding_factor=8)

Source from the content-addressed store, hash-verified

source not stored for this graph (policy: none)

Callers 9

build_dictionaryMethod · 0.95
dummy_dictionaryFunction · 0.95
test_finalizeMethod · 0.95
make_binary_datasetFunction · 0.45
binarizeFunction · 0.45
make_binary_datasetFunction · 0.45
binarizeFunction · 0.45
build_dictionaryMethod · 0.45
build_dictionaryMethod · 0.45

Calls

no outgoing calls

Tested by 1

test_finalizeMethod · 0.76