MCPcopy Create free account
hub / github.com/OpenGVLab/InternImage / _allreduce_fut

Function _allreduce_fut

classification/ddp_hooks.py:12–22  ·  view source on GitHub ↗

Averages the input gradient tensor by allreduce and returns a future.

(process_group: dist.ProcessGroup,
                   tensor: torch.Tensor)

Source from the content-addressed store, hash-verified

source not stored for this graph (policy: none)

Callers 1

allreduce_hookFunction · 0.85

Calls

no outgoing calls

Tested by

no test coverage detected