MCPcopy Create free account
hub / github.com/zai-org/CodeGeeX / clip_grad_norm

Method clip_grad_norm

codegeex/megatron/optimizer/optimizer.py:81–83  ·  view source on GitHub ↗
(self, clip_grad)

Source from the content-addressed store, hash-verified

79 return params
80
81 def clip_grad_norm(self, clip_grad):
82 params = self.get_parameters()
83 return clip_grad_norm_fp32(params, clip_grad)
84
85 def count_zeros(self):
86 params = self.get_parameters()

Callers 2

stepMethod · 0.80
stepMethod · 0.80

Calls 2

get_parametersMethod · 0.95
clip_grad_norm_fp32Function · 0.85

Tested by

no test coverage detected