MCPcopy
hub / github.com/openai/transformer-debugger / NormalizationHooks

Class NormalizationHooks

neuron_explainer/models/hooks.py:186–191  ·  view source on GitHub ↗

Source from the content-addressed store, hash-verified

184
185
186class NormalizationHooks(HookCollection):
187 def __init__(self):
188 super().__init__()
189 self.add_subhooks("post_mean_subtraction", FwdBwdHooks())
190 self.add_subhooks("scale", FwdBwdHooks())
191 self.add_subhooks("post_scale", FwdBwdHooks())
192
193
194class AttentionHooks(HookCollection):

Callers 4

apply_layer_normFunction · 0.90
forwardMethod · 0.90
__init__Method · 0.85
__init__Method · 0.85

Calls

no outgoing calls

Tested by

no test coverage detected