Function get_optimizer

experiments/nmt.py:32–41 · view source on GitHub ↗

(learning_rate, parameters, betas, eps, amsgrad, weight_decay, lr_decay, warmup_steps, init_lr)

Source from the content-addressed store, hash-verified

source not stored for this graph (policy: none)

pretrain_modelFunction · 0.85

trainFunction · 0.85

AdamWClass · 0.90

InverseSquareRootSchedulerClass · 0.90

ExponentialSchedulerClass · 0.90

no test coverage detected