See https://arxiv.org/pdf/1706.03762.pdf lrate = d_model**(-0.5) * \ min(step_num**(-0.5), step_num*warmup_steps**(-1.5)) Args: d_model: int The number of expected features in the encoder inputs. warmup_steps: int The number of steps t
source not stored for this graph (policy: none)