MCPcopy Create free account
hub / github.com/RingBDStack/GDAP / available_indices

Method available_indices

seq2seq/utils.py:404–411  ·  view source on GitHub ↗
(self)

Source from the content-addressed store, hash-verified

402
403 @cached_property
404 def available_indices(self) -> np.array:
405 indices = list(range(len(self.dataset)))
406 # add extra samples to make it evenly divisible
407 indices += indices[: (self.total_size - len(indices))]
408 assert len(indices) == self.total_size
409 # subsample
410 available_indices = indices[self.rank: self.total_size: self.num_replicas]
411 return available_indices
412
413 def __len__(self):
414 return self.num_samples

Callers

nothing calls this directly

Calls

no outgoing calls

Tested by

no test coverage detected