MCPcopy Create free account
hub / github.com/apple/ml-pointersect / allreduce_hook

Function allreduce_hook

cdslib/core/utils/multigpu_utils.py:137–138  ·  view source on GitHub ↗
(*unused)

Source from the content-addressed store, hash-verified

135 for param in list(module.parameters()):
136
137 def allreduce_hook(*unused):
138 Variable._execution_engine.queue_callback(allreduce_params)
139
140 if param.requires_grad:
141 param.register_hook(allreduce_hook)

Callers

nothing calls this directly

Calls

no outgoing calls

Tested by

no test coverage detected