MCPcopy Create free account
hub / github.com/PaddlePaddle/Knover / _distributed_batch_reader

Method _distributed_batch_reader

knover/data/dialog_reader.py:535–561  ·  view source on GitHub ↗

Distributed batch reader. Slice dataset and feed batches to different devices. Args: batch_reader: A batch reader. num_part: The number of devices. part_id: The id of current device. is_test: Whether slice dataset in testing phase. Wh

(self, batch_reader, num_part, part_id, is_test=False)

Source from the content-addressed store, hash-verified

source not stored for this graph (policy: none)

Callers 1

__wrapper__Method · 0.95

Calls

no outgoing calls

Tested by

no test coverage detected