Method
__init__
(self, config, tokenizer, dataset_reader)
Source from the content-addressed store, hash-verified
| 125 | |
| 126 | class PretrainDataModule(LightningDataModule): |
| 127 | def __init__(self, config, tokenizer, dataset_reader): |
| 128 | super().__init__() |
| 129 | self.config = config |
| 130 | self.tokenizer = tokenizer |
| 131 | self.dataset_reader = dataset_reader |
| 132 | |
| 133 | def setup(self, stage): |
| 134 | self.train_datasets = self.dataset_reader.read_orig_dataset("train") |
Callers
nothing calls this directly
Tested by
no test coverage detected