MCPcopy Create free account
hub / github.com/deepspeedai/DeepSpeed / get_mom

Method get_mom

deepspeed/runtime/engine.py:3586–3590  ·  view source on GitHub ↗
(self)

Source from the content-addressed store, hash-verified

3584 return self._get_optimizer_param("type")
3585
3586 def get_mom(self):
3587 if self.optimizer_name() in ["SGD", "RMSprop"]:
3588 return self._get_optimizer_param("momentum")
3589 else:
3590 return self._get_optimizer_param("betas")
3591
3592 def get_pld_theta(self):
3593 if self.progressive_layer_drop:

Callers 1

_report_progressMethod · 0.95

Calls 2

optimizer_nameMethod · 0.95
_get_optimizer_paramMethod · 0.95

Tested by

no test coverage detected