MCPcopy Create free account
hub / github.com/MTLab/MorphMLP / all_reduce

Function all_reduce

slowfast/utils/distributed.py:44–60  ·  view source on GitHub ↗

All reduce the provided tensors from all processes across machines. Args: tensors (list): tensors to perform all reduce across all processes in all machines. average (bool): scales the reduced tensor by the number of overall processes across all machines.

(tensors, average=True)

Source from the content-addressed store, hash-verified

source not stored for this graph (policy: none)

Callers

nothing calls this directly

Calls

no outgoing calls

Tested by

no test coverage detected