MCPcopy Create free account
hub / github.com/MotrixLab/AiOS / after_train_iter

Method after_train_iter

detrsmpl/utils/dist_utils.py:53–58  ·  view source on GitHub ↗
(self, runner)

Source from the content-addressed store, hash-verified

51 self.bucket_size_mb = bucket_size_mb
52
53 def after_train_iter(self, runner):
54 runner.optimizer.zero_grad()
55 runner.outputs['loss'].backward()
56 if self.grad_clip is not None:
57 self.clip_grads(runner.model.parameters())
58 runner.optimizer.step()
59
60
61def reduce_mean(tensor):

Callers

nothing calls this directly

Calls 2

backwardMethod · 0.80
parametersMethod · 0.80

Tested by

no test coverage detected