MCPcopy Create free account
hub / github.com/AI-Hypercomputer/maxtext / __init__

Method __init__

src/MaxText/sft/hooks.py:169–174  ·  view source on GitHub ↗
(self, config, mesh, goodput_recorder)

Source from the content-addressed store, hash-verified

167 """Data hooks for SFT."""
168
169 def __init__(self, config, mesh, goodput_recorder):
170 self.config = config
171 self.train_data_iterator, self.eval_data_iterator = create_data_iterator(config, mesh)
172 self.train_data_loader = DataLoader(config, mesh, self.train_data_iterator, goodput_recorder=goodput_recorder)
173 self.train_batch = None
174 self.eval_batch = None
175
176 @override
177 def load_next_train_batch(self, train_ctx: peft_trainer.PeftTrainer): # pylint: disable=unused-argument

Callers

nothing calls this directly

Calls 2

create_data_iteratorFunction · 0.90
DataLoaderClass · 0.90

Tested by

no test coverage detected