MCPcopy Create free account
hub / github.com/zai-org/CodeGeeX / SubsetDataset

Class SubsetDataset

codegeex/mindspore/src/sat_dataset.py:223–236  ·  view source on GitHub ↗

Source from the content-addressed store, hash-verified

221
222
223class SubsetDataset(Dataset):
224 def __init__(self, ds, start, length):
225 assert start >= 0 and length > 0 and start + length <= len(ds), "Illegal start or length"
226 self.ds = ds
227 self.start = start
228 self.length = length
229
230 def __len__(self):
231 return self.length
232
233 def __getitem__(self, idx):
234 if idx < 0 or idx >= self.length:
235 raise IndexError("Index out of range")
236 return self.ds[idx + self.start]
237
238
239def split_train_val_test(ds, split=[0.99, 0.01, 0.0], seed=None):

Callers 2

split_train_val_testFunction · 0.85
get_code_data_evalFunction · 0.85

Calls

no outgoing calls

Tested by

no test coverage detected