MCPcopy Create free account
hub / github.com/apple/axlearn / ScaleByLionState

Class ScaleByLionState

axlearn/common/optimizers.py:1655–1659  ·  view source on GitHub ↗

State for the Lion algorithm.

Source from the content-addressed store, hash-verified

1653
1654
1655class ScaleByLionState(NamedTuple):
1656 """State for the Lion algorithm."""
1657
1658 count: chex.Array # shape=(), dtype=jnp.int32.
1659 mu: optax.Updates
1660
1661
1662def scale_by_lion(

Callers 3

init_fnFunction · 0.85
update_fnFunction · 0.85
partition_fnFunction · 0.85

Calls

no outgoing calls

Tested by

no test coverage detected