MCPcopy
hub / github.com/hpcaitech/ColossalAI / wait

Method wait

colossalai/quantization/fp8.py:26–30  ·  view source on GitHub ↗
(self)

Source from the content-addressed store, hash-verified

24 self.remain_ops = remain_ops
25
26 def wait(self):
27 for handle in self.handles:
28 handle.wait()
29 if self.remain_ops:
30 self.remain_ops()
31
32
33def process_group_is_intranode(pg):

Callers 15

_compute_table_cMethod · 0.45
forwardMethod · 0.45
backwardMethod · 0.45
wait_chunksMethod · 0.45
wait_async_reduceMethod · 0.45
wait_all_gather_handleFunction · 0.45
sum_and_allgatherFunction · 0.45
decompressFunction · 0.45
all_gather_fp8_ringFunction · 0.45
forwardMethod · 0.45
forwardMethod · 0.45
wait_for_new_requestsMethod · 0.45

Calls

no outgoing calls

Tested by 8

check_4gpuFunction · 0.36
check_4gpuFunction · 0.36
check_4gpuFunction · 0.36
check_all2allFunction · 0.36
check_all2all_unevenFunction · 0.36
check_all_gatherFunction · 0.36
check_reduce_scatterFunction · 0.36
check_all_reduceFunction · 0.36