MCPcopy Create free account
hub / github.com/OpenBitSys/BitDistiller / training_docs

Method training_docs

test/general/lm_eval/tasks/toxigen.py:38–46  ·  view source on GitHub ↗
(self)

Source from the content-addressed store, hash-verified

36 return True
37
38 def training_docs(self):
39 if self.has_training_docs():
40 # We cache training documents in `self._training_docs` for faster
41 # few-shot processing. If the data is too large to fit in memory,
42 # return the training data as a generator instead of a list.
43 if self._training_docs is None:
44 dataset = self._preprocess_dataset("train")
45 self._training_docs = list(map(self._process_doc, dataset))
46 return self._training_docs
47
48 def test_docs(self):
49 if self.has_test_docs():

Callers

nothing calls this directly

Calls 2

has_training_docsMethod · 0.95
_preprocess_datasetMethod · 0.95

Tested by

no test coverage detected