MCPcopy Create free account
hub / github.com/AIS-SNU/Smart-Infinity / dynamic_loss_scale

Method dynamic_loss_scale

deepspeed/runtime/engine.py:821–822  ·  view source on GitHub ↗
(self)

Source from the content-addressed store, hash-verified

819 return self._config.gradient_clipping
820
821 def dynamic_loss_scale(self):
822 return self._config.loss_scale == 0
823
824 def initial_dynamic_scale(self):
825 return self._config.initial_dynamic_scale

Callers 4

_do_sanity_checkMethod · 0.95

Calls

no outgoing calls

Tested by

no test coverage detected