MCPcopy Create free account
hub / github.com/HA-Transformer/MAT / load_dataset

Method load_dataset

fairseq/tasks/language_modeling.py:144–176  ·  view source on GitHub ↗

Load a given dataset split. Args: split (str): name of the split (e.g., train, valid, test)

(self, split, epoch=0, combine=False, **kwargs)

Source from the content-addressed store, hash-verified

source not stored for this graph (policy: none)

Callers

nothing calls this directly

Calls 4

TokenBlockDatasetClass · 0.90
MonolingualDatasetClass · 0.90
padMethod · 0.80
eosMethod · 0.80

Tested by

no test coverage detected