MCPcopy Create free account
hub / github.com/HA-Transformer/MAT / Adafactor

Class Adafactor

fairseq/optim/adafactor.py:65–213  ·  view source on GitHub ↗

Implements Adafactor algorithm. This implementation is based on: `Adafactor: Adaptive Learning Rates with Sublinear Memory Cost` (see https://arxiv.org/abs/1804.04235) Arguments: params (iterable): iterable of parameters to optimize or dicts defining parameter g

Source from the content-addressed store, hash-verified

source not stored for this graph (policy: none)

Callers 1

__init__Method · 0.85

Calls

no outgoing calls

Tested by

no test coverage detected