Method gradient_clipping

deepspeed/runtime/engine.py:1409–1410 · view source on GitHub ↗

(self)

Source from the content-addressed store, hash-verified

1407	return self._config.dump_state
1408
1409	def gradient_clipping(self):
1410	return self._config.gradient_clipping
1411
1412	def dynamic_loss_scale(self):
1413	return self._config.float16_config.loss_scale == 0

_configure_fp16_optimizerMethod · 0.95

_configure_bf16_optimizerMethod · 0.95

_configure_zero_optimizerMethod · 0.95

_return_mics_optimizerMethod · 0.95

clip_fp32_gradientsMethod · 0.95

_take_model_stepMethod · 0.95

test_engine_getter_returns_config_valueMethod · 0.80

test_init_without_gradient_clipping_defaults_to_oneMethod · 0.80

test_explicit_zero_disables_clippingMethod · 0.80

no outgoing calls

test_engine_getter_returns_config_valueMethod · 0.64

test_init_without_gradient_clipping_defaults_to_oneMethod · 0.64

test_explicit_zero_disables_clippingMethod · 0.64