Function make_binary_dataset

fairseq_cli/preprocess.py:97–159 · view source on GitHub ↗

(vocab, input_prefix, output_prefix, lang, num_workers)

Source from the content-addressed store, hash-verified

source not stored for this graph (policy: none)

make_datasetFunction · 0.70

printFunction · 0.85

find_offsetsMethod · 0.80

dataset_dest_fileFunction · 0.70

merge_resultFunction · 0.70

dataset_dest_prefixFunction · 0.70

binarizeMethod · 0.45

add_itemMethod · 0.45

merge_file_Method · 0.45

finalizeMethod · 0.45

no test coverage detected