MCPcopy Create free account
hub / github.com/pytorch/pytorch / allcompare_process

Function allcompare_process

caffe2/python/allcompare_test.py:30–56  ·  view source on GitHub ↗
(filestore_dir, process_id, data, num_procs)

Source from the content-addressed store, hash-verified

28
29
30def allcompare_process(filestore_dir, process_id, data, num_procs):
31 from caffe2.python import core, data_parallel_model, workspace, dyndep
32 from caffe2.python.model_helper import ModelHelper
33 from caffe2.proto import caffe2_pb2
34 dyndep.InitOpsLibrary("@/caffe2/caffe2/distributed:file_store_handler_ops")
35
36 workspace.RunOperatorOnce(
37 core.CreateOperator(
38 "FileStoreHandlerCreate", [], ["store_handler"], path=filestore_dir
39 )
40 )
41 rendezvous = dict(
42 kv_handler="store_handler",
43 shard_id=process_id,
44 num_shards=num_procs,
45 engine=op_engine,
46 exit_nets=None
47 )
48
49 model = ModelHelper()
50 model._rendezvous = rendezvous
51
52 workspace.FeedBlob("test_data", data)
53
54 data_parallel_model._RunComparison(
55 model, "test_data", core.DeviceOption(caffe2_pb2.CPU, 0)
56 )
57
58
59class TestAllCompare(hu.HypothesisTestCase):

Callers

nothing calls this directly

Calls 1

ModelHelperClass · 0.90

Tested by

no test coverage detected

Used in the wild real call sites across dependent graphs

searching dependent graphs…