MCPcopy Create free account
hub / github.com/deepspeedai/DeepSpeed / get_mom

Method get_mom

deepspeed/runtime/engine.py:3461–3465  ·  view source on GitHub ↗
(self)

Source from the content-addressed store, hash-verified

3459 return self._get_optimizer_param("type")
3460
3461 def get_mom(self):
3462 if self.optimizer_name() in ["SGD", "RMSprop"]:
3463 return self._get_optimizer_param("momentum")
3464 else:
3465 return self._get_optimizer_param("betas")
3466
3467 def get_pld_theta(self):
3468 if self.progressive_layer_drop:

Callers 1

_report_progressMethod · 0.95

Calls 2

optimizer_nameMethod · 0.95
_get_optimizer_paramMethod · 0.95

Tested by

no test coverage detected