↓ 1 callersFunctionmuon_sq_update(grad, momentum, v, mu=0.95, beta2=0.95, eps=1e-10, nesterov=True)
records/track_3_optimization/results/20260501_muonsq/train_gpt_simple_muonsq.py:191
↓ 1 callersFunctionmuon_update(update, second_moment, step, beta2=NOR_BETA2, use_contra=True, use_soft=True)
records/track_3_optimization/results/20260520_rre_extrapolation_pr300_2925/train_gpt_simple_rre_pr300_2925.py:630
↓ 1 callersFunctionmuon_update(grad, momentum, second_moment, mu=0.95, beta2=0.95, nesterov=True)
records/track_3_optimization/results/20260501_contra_muon/train_gpt_simple_contra_muon_2.py:224
↓ 1 callersFunctionmuon_update(
update,
second_moment,
step,
beta2=NOR_BETA2,
use_contra=True,
use_soft=True,
us
records/track_3_optimization/results/20260520_tail_refinterp_2900/train_gpt_tail_refinterp_2900.py:925
↓ 1 callersFunctionmuon_update(grad, momentum, second_moment, mu=0.95, beta2=0.95, nesterov=True)
records/track_3_optimization/results/20260509_contra_muon_split_cooldown/train_gpt_simple_contra_muon_split_cooldown.py:224