MCPcopy Create free account
hub / github.com/THUDM/GLM / _update_scale

Method _update_scale

fp16/fp16.py:300–301  ·  view source on GitHub ↗
(self, has_overflow=False)

Source from the content-addressed store, hash-verified

298 self.overflow = self.loss_scaler.has_overflow(params)
299
300 def _update_scale(self, has_overflow=False):
301 self.loss_scaler.update_scale(has_overflow)
302
303 def _master_params_to_model_params(self):
304 for fp16_group, fp32_from_fp16_group in zip(self.fp16_groups, self.fp32_from_fp16_groups):

Callers 2

stepMethod · 0.95
wrapped_closureMethod · 0.95

Calls 1

update_scaleMethod · 0.45

Tested by

no test coverage detected