Method gradient_clipping

deepspeed/runtime/engine.py:1550–1551 · view source on GitHub ↗

(self)

Source from the content-addressed store, hash-verified

1548	return self._config.dump_state
1549
1550	def gradient_clipping(self):
1551	return self._config.gradient_clipping
1552
1553	def dynamic_loss_scale(self):
1554	return self._config.float16_config.loss_scale == 0

_configure_fp16_optimizerMethod · 0.95

_configure_bf16_optimizerMethod · 0.95

_configure_zero_optimizerMethod · 0.95

_return_mics_optimizerMethod · 0.95

clip_fp32_gradientsMethod · 0.95

_take_model_stepMethod · 0.95

test_engine_getter_returns_config_valueMethod · 0.80

test_init_without_gradient_clipping_defaults_to_oneMethod · 0.80

test_explicit_zero_disables_clippingMethod · 0.80

no outgoing calls

test_engine_getter_returns_config_valueMethod · 0.64

test_init_without_gradient_clipping_defaults_to_oneMethod · 0.64

test_explicit_zero_disables_clippingMethod · 0.64