MCPcopy Create free account
hub / github.com/AtlasAnalyticsLab/AdaFisher / MinMaxNormalization

Function MinMaxNormalization

Analysis/optimizers/AdaFisher_utils.py:8–12  ·  view source on GitHub ↗
(tensor: Tensor, epsilon: float = 1e-12)

Source from the content-addressed store, hash-verified

6
7
8def MinMaxNormalization(tensor: Tensor, epsilon: float = 1e-12) -> Tensor:
9 min_tensor = tensor.min()
10 max_tensor = tensor.max()
11 range_tensor = max_tensor - min_tensor
12 return tensor.add_(-min_tensor).div_(range_tensor + epsilon)
13
14
15def update_running_avg(new: Tensor, current: Dict[Module, Tensor], gammas: list):

Callers 2

_save_inputMethod · 0.90
_save_grad_outputMethod · 0.90

Calls

no outgoing calls

Tested by

no test coverage detected