MCPcopy Create free account
hub / github.com/AIS-SNU/Smart-Infinity / gradient_clipping

Method gradient_clipping

deepspeed/runtime/engine.py:818–819  ·  view source on GitHub ↗
(self)

Source from the content-addressed store, hash-verified

816 return self._config.dump_state
817
818 def gradient_clipping(self):
819 return self._config.gradient_clipping
820
821 def dynamic_loss_scale(self):
822 return self._config.loss_scale == 0

Callers 6

clip_fp32_gradientsMethod · 0.95
_take_model_stepMethod · 0.95

Calls

no outgoing calls

Tested by

no test coverage detected