Function adjust_learning_rate

Adjust the lr according to the schedule. Args: Optimizer: torch optimizer to update. epoch(int): number of the current epoch. curr_step(int): number of optimization step taken so far. num_training_step(int): total number of optimization steps. args: addit

(
    optimizer,
    epoch: int,
    curr_step: int,
    num_training_steps: int,
    args,
)