MCPcopy
hub / github.com/deepspeedai/DeepSpeedExamples / log

Method log

Megatron-LM/utils.py:122–130  ·  view source on GitHub ↗

Log a group of timers.

(self, names, normalizer=1.0, reset=True)

Source from the content-addressed store, hash-verified

120 return self.timers[name]
121
122 def log(self, names, normalizer=1.0, reset=True):
123 """Log a group of timers."""
124 assert normalizer > 0.0
125 string = 'time (ms)'
126 for name in names:
127 elapsed_time = self.timers[name].elapsed(
128 reset=reset) * 1000.0/ normalizer
129 string += ' | {}: {:.2f}'.format(name, elapsed_time)
130 print_rank_0(string)
131
132
133def report_memory(name):

Callers 4

forwardMethod · 0.45
trainFunction · 0.45
trainFunction · 0.45
forwardMethod · 0.45

Calls 2

print_rank_0Function · 0.70
elapsedMethod · 0.45

Tested by

no test coverage detected