hub / github.com/HA-Transformer/MAT / LanguagePairDataset

Class LanguagePairDataset

fairseq/data/language_pair_dataset.py:67–214 · view source on GitHub ↗

A pair of torch.utils.data.Datasets. Args: src (torch.utils.data.Dataset): source dataset to wrap src_sizes (List[int]): source sentence lengths src_dict (~fairseq.data.Dictionary): source vocabulary tgt (torch.utils.data.Dataset, optional): target dataset t

Source from the content-addressed store, hash-verified

source not stored for this graph (policy: none)

Callers 9

build_dataset_for_inferenceMethod · 0.90

load_langpair_datasetFunction · 0.90

build_dataset_for_inferenceMethod · 0.90

load_datasetMethod · 0.90

language_pair_datasetMethod · 0.90

_get_noising_dataset_batchMethod · 0.90

setUpMethod · 0.90

_backtranslation_dataset_helperMethod · 0.90

Calls

no outgoing calls

Tested by 4

_get_noising_dataset_batchMethod · 0.72

setUpMethod · 0.72

_backtranslation_dataset_helperMethod · 0.72