Method
__init__
(self, params, lr=1e-3, betas=(0.9, 0.999), eps=1e-8,
weight_decay=0, amsgrad=False, max_norm=None, norm_type=2)
Source from the content-addressed store, hash-verified
| 21 | class AdamWWithClip(AdamW): |
| 22 | |
| 23 | def __init__(self, params, lr=1e-3, betas=(0.9, 0.999), eps=1e-8, |
| 24 | weight_decay=0, amsgrad=False, max_norm=None, norm_type=2): |
| 25 | super(AdamWWithClip, self).__init__(params, lr, betas, eps, weight_decay, amsgrad) |
| 26 | self.max_norm = max_norm |
| 27 | self.norm_type = norm_type |
| 28 | |
| 29 | def step(self, closure=None): |
| 30 | |
Callers
nothing calls this directly
Tested by
no test coverage detected