MCPcopy Create free account
hub / github.com/debjitpaul/refiner / __init__

Method __init__

data_preprocessing/utils.py:155–161  ·  view source on GitHub ↗
(self, data, tokenizer, source_col="input", target_col="target", max_source_len=512, max_target_len=512)

Source from the content-addressed store, hash-verified

153
154class GlucoseDataset(Dataset):
155 def __init__(self, data, tokenizer, source_col="input", target_col="target", max_source_len=512, max_target_len=512):
156 self.tokenizer = tokenizer
157 self.data = data
158 self.max_source_len = max_source_len
159 self.max_target_len = max_target_len
160 self.source_col = source_col
161 self.target_col = target_col
162
163 def __len__(self):
164 return len(self.data)

Callers

nothing calls this directly

Calls

no outgoing calls

Tested by

no test coverage detected