↓ 2 callersFunctionmuon_update(update, second_moment, step, beta2=NOR_BETA2, use_contra=True, use_soft=True)
records/track_3_optimization/results/20260529_tail_phase_readout_2850/train_gpt_tail_phase_readout_2850.py:657
↓ 2 callersFunctionsoap_precondition_momentum(update, state, beta2=SOAP_BETA2, eps=1e-8,
blend=SOAP_BLEND, denom_floor_ratio
records/track_3_optimization/results/20260520_rre_extrapolation_pr300_2925/train_gpt_simple_rre_pr300_2925.py:587
↓ 2 callersFunctionsoap_precondition_momentum(update, state, beta2=SOAP_BETA2, eps=1e-8,
blend=SOAP_BLEND, denom_floor_ratio
records/track_3_optimization/results/20260506_trustlight/train_gpt_simple_trustlight.py:349
↓ 2 callersFunctionsoap_precondition_momentum(update, state, beta2=SOAP_BETA2, eps=1e-8,
blend=SOAP_BLEND, denom_floor_ratio
records/track_3_optimization/results/20260520_tail_refinterp_2900/train_gpt_tail_refinterp_2900.py:731
↓ 2 callersFunctionsoap_precondition_momentum(update, state, beta2=SOAP_BETA2, eps=1e-8,
blend=SOAP_BLEND, denom_floor_ratio
records/track_3_optimization/results/20260525_aurora_ema_ref/train_gpt_simple_aurora_ema_ref.py:351