MCPcopy Create free account
hub / github.com/AIS-SNU/Smart-Infinity / postscale_gradients

Method postscale_gradients

deepspeed/runtime/engine.py:800–801  ·  view source on GitHub ↗
(self)

Source from the content-addressed store, hash-verified

798 return torch.float32
799
800 def postscale_gradients(self):
801 return not self._config.prescale_gradients
802
803 def gradient_predivide_factor(self):
804 return self._config.gradient_predivide_factor

Callers 4

allreduce_bucketMethod · 0.95
sparse_allreduceMethod · 0.95

Calls

no outgoing calls

Tested by

no test coverage detected