MCPcopy Index your code
hub / github.com/tensorflow/models / _do_layer_adaptation

Method _do_layer_adaptation

official/modeling/optimization/lamb.py:239–245  ·  view source on GitHub ↗

Whether to do layer-wise learning rate adaptation for `param_name`.

(self, param_name)

Source from the content-addressed store, hash-verified

237 return True
238
239 def _do_layer_adaptation(self, param_name):
240 """Whether to do layer-wise learning rate adaptation for `param_name`."""
241 if self.exclude_from_layer_adaptation:
242 for r in self.exclude_from_layer_adaptation:
243 if re.search(r, param_name) is not None:
244 return False
245 return True
246
247 def _get_variable_name(self, param_name):
248 """Get the variable name from the tensor name."""

Callers 3

_resource_apply_denseMethod · 0.95

Calls 1

searchMethod · 0.80

Tested by 1