MCPcopy Create free account
hub / github.com/Tele-AI/Telechat / PromptRawDataset

Class PromptRawDataset

deepspeed-telechat/utils/data/raw_datasets.py:7–25  ·  view source on GitHub ↗

Source from the content-addressed store, hash-verified

5from datasets import load_dataset
6
7class PromptRawDataset(object):
8
9 def __init__(self, output_path, seed, dataset_name):
10 self.output_path = output_path
11 self.seed = seed
12 self.raw_datasets = load_dataset(path="json",data_files=dataset_name)
13
14
15 def get_train_data(self):
16 return
17
18 def get_eval_data(self):
19 return
20
21 def get_prompt(self, sample):
22 return
23
24 def get_prompt_and_answer(self, sample):
25 return
26
27
28

Callers

nothing calls this directly

Calls

no outgoing calls

Tested by

no test coverage detected