MCPcopy
hub / github.com/PaddlePaddle/PaddleRec / create_data_loader

Function create_data_loader

tools/rec_client.py:44–57  ·  view source on GitHub ↗
(args)

Source from the content-addressed store, hash-verified

42
43
44def create_data_loader(args):
45 data_dir = args.data_dir
46 reader_path, reader_file = os.path.split(args.reader_file)
47 reader_file, extension = os.path.splitext(reader_file)
48 batchsize = args.batchsize
49 place = args.place
50 file_list = [os.path.join(data_dir, x) for x in os.listdir(data_dir)]
51 sys.path.append(reader_path)
52 reader_class = import_module(reader_file)
53 config = {"runner.inference": True}
54 dataset = reader_class.RecDataset(file_list, config=config)
55 loader = DataLoader(
56 dataset, batch_size=batchsize, places=place, drop_last=True)
57 return loader
58
59
60def run_rpc_client(args):

Callers 2

run_rpc_clientFunction · 0.70
run_web_clientFunction · 0.70

Calls 1

DataLoaderClass · 0.50

Tested by

no test coverage detected