Saves model and optimizer to given directory. Args: model_dir: Model directory to save. step: Current training step.

This will be True only in one process, even in distributed mode, even when training on multiple machines.

Save a model and its configuration file to a directory, so that it can be re-loaded using the `:func:`~transformers.PreTrainedModel.from_pret

r""" Generates sequences for models with a LM head. The method currently supports greedy decoding, beam-search decoding, sampling with temperature, sa

This will be True only in one process, even in distributed mode, even when training on multiple machines.

Performs a single optimization step. Arguments: closure (callable, optional): A closure that reevaluates the model

Add a new hypothesis to the list.

Run evaluation and return metrics. The calling script will be responsible for providing a method to compute metrics, as they are

Helper to get num of examples from a DataLoader, by accessing its Dataset.

Helper to get num of examples from a DataLoader, by accessing its Dataset.

:returns next idx, (agg_op id, col_id)

Saving best-practices: if you use default names for the model, you can reload it using from_pretrained(). Will only save fro

Main training entry point. Args: model_path: (Optional) Local path to model if model to train has been i