Method__init__(self, params, lr=0.02, weight_decay=0, mu=0.95, refresh_interval=64)
records/track_3_optimization/results/20260505_newton_muon/train_gpt_simple_newton_muon.py:230
Method__init__(self, params, lr=0.01, betas=(0.8, 0.99), eps=1e-10)
records/track_3_optimization/results/20260611_tailema_2730_submission/train_gpt_tailema_2730.py:635
Method__init__(self, params, inner_optimizer, lookahead_stepsize=0, use_scheduled_lookahead_stepsize=True, lookahead_ema=0.9
records/track_3_optimization/results/20260611_tailema_2730_submission/train_gpt_tailema_2730.py:661
Method__init__(self, params, lr=0.01, betas=(0.8, 0.99), eps=1e-10)
records/track_3_optimization/results/20260611_tailema_2730_submission/ablation/combo_2740/train_gpt_combo_2740.py:618
Method__init__(self, params, inner_optimizer, lookahead_stepsize=0, use_scheduled_lookahead_stepsize=True, lookahead_ema=0.9
records/track_3_optimization/results/20260611_tailema_2730_submission/ablation/combo_2740/train_gpt_combo_2740.py:644
Method_compute_outer_product_list(
self,
grad: Tensor,
order: int,
preconditioned_dims_selector: tuple[bool, ..
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/shampoo_preconditioner_list.py:1774
Method_compute_outer_product_list(
self,
grad: Tensor,
order: int,
preconditioned_dims_selector: tuple[bool, ..
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/shampoo_preconditioner_list.py:1817
Method_compute_preconditioned_gradient(
self,
grad: Tensor,
preconditioned_dims_selector: tuple[bool, ...],
kronecke
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/shampoo_preconditioner_list.py:1605
Method_compute_preconditioned_gradient(
self,
grad: Tensor,
preconditioned_dims_selector: tuple[bool, ...],
kronecke
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/shampoo_preconditioner_list.py:1626