Method gradient_clipping

deepspeed/runtime/engine.py:1352–1353 · view source on GitHub ↗

(self)

Source from the content-addressed store, hash-verified

1350	return self._config.dump_state
1351
1352	def gradient_clipping(self):
1353	return self._config.gradient_clipping
1354
1355	def dynamic_loss_scale(self):
1356	return self._config.float16_config.loss_scale == 0

_configure_fp16_optimizerMethod · 0.95

_configure_bf16_optimizerMethod · 0.95

_configure_zero_optimizerMethod · 0.95

_return_mics_optimizerMethod · 0.95

clip_fp32_gradientsMethod · 0.95

_take_model_stepMethod · 0.95

test_engine_getter_returns_config_valueMethod · 0.80

test_init_without_gradient_clipping_defaults_to_oneMethod · 0.80

test_explicit_zero_disables_clippingMethod · 0.80

no outgoing calls

test_engine_getter_returns_config_valueMethod · 0.64

test_init_without_gradient_clipping_defaults_to_oneMethod · 0.64

test_explicit_zero_disables_clippingMethod · 0.64