MCPcopy Create free account
hub / github.com/HA-Transformer/MAT / build_dictionary

Method build_dictionary

fairseq/tasks/fairseq_task.py:37–54  ·  view source on GitHub ↗

Build the dictionary Args: filenames (list): list of filenames workers (int): number of concurrent workers threshold (int): defines the minimum word count nwords (int): defines the total number of words in the final dictionary,

(cls, filenames, workers=1, threshold=-1, nwords=-1, padding_factor=8)

Source from the content-addressed store, hash-verified

source not stored for this graph (policy: none)

Callers 2

build_dictionaryFunction · 0.45
build_dictionaryFunction · 0.45

Calls 3

finalizeMethod · 0.95
DictionaryClass · 0.90

Tested by

no test coverage detected