MCPcopy
hub / github.com/deepspeedai/DeepSpeed / test_parallel_read

Method test_parallel_read

tests/unit/ops/aio/test_gds.py:76–93  ·  view source on GitHub ↗
(self, tmpdir, single_submit, overlap_events)

Source from the content-addressed store, hash-verified

74 set_dist_env = False
75
76 def test_parallel_read(self, tmpdir, single_submit, overlap_events):
77
78 h = GDSBuilder().load().gds_handle(BLOCK_SIZE, QUEUE_DEPTH, single_submit, overlap_events, IO_PARALLEL)
79
80 gds_buffer = torch.empty(IO_SIZE, dtype=torch.uint8, device=get_accelerator().device_name())
81 h.pin_device_tensor(gds_buffer)
82
83 _validate_handle_state(h, single_submit, overlap_events)
84
85 ref_file, _ = _do_ref_write(tmpdir)
86 read_status = h.sync_pread(gds_buffer, ref_file, 0)
87 assert read_status == 1
88
89 with open(ref_file, 'rb') as f:
90 ref_buffer = list(f.read())
91 assert ref_buffer == gds_buffer.tolist()
92
93 h.unpin_device_tensor(gds_buffer)
94
95 def test_async_read(self, tmpdir, single_submit, overlap_events):
96

Callers

nothing calls this directly

Calls 7

GDSBuilderClass · 0.90
get_acceleratorFunction · 0.90
_validate_handle_stateFunction · 0.70
_do_ref_writeFunction · 0.70
loadMethod · 0.45
device_nameMethod · 0.45
readMethod · 0.45

Tested by

no test coverage detected