Find the labels used by a given model. Args: model_class (`type`): The class of the model.

A utility function that asks a question to the user to get an answer, potentially looping until it gets a valid answer. Args: qu

Add a dictionary of special tokens (eos, pad, cls, etc.) to the encoder and link them to class attributes. If special tokens are NOT

Returns whether this model can generate sequences with `.generate()`. Returns: `bool`: Whether this model can generate s

Get the index of the token in the encoded output comprising a character in the original string for a sequence of the batch.

Get the word in the original string corresponding to a character in the original string of a sequence of the batch. Can be c

Downsample mesh.

A utility method that massages the config file and can optionally verify that the values match. 1. Replace "auto" values with `Train

Framework-agnostic version of `numpy.reshape` that will work on torch/TensorFlow/Jax tensors as well as NumPy arrays.

Framework-agnostic version of `numpy.squeeze` that will work on torch/TensorFlow/Jax tensors as well as NumPy arrays.

Creates an optimizer with a learning rate schedule using a warmup phase followed by a linear decay. Args: init_lr (`float`):

Returns the model's output embeddings. Returns: `nn.Module`: A torch module mapping hidden states to vocabulary.

Retrieves sequence ids from a token list that has no special tokens added. This method is called when adding special tokens using the

Concat the `new_tensors` to `tensors` on the first dim and pad them on the second if needed. Works for tensors or nested list/tuples/dict of

Parses the commit message to detect if a command is there to skip, force all or part of the CI. Args: commit_message (`str`): The co

Tie the weights between the input embeddings and the output embeddings. If the `torchscript` flag is set in the configuration, can't

Converts `image` to the channel dimension format specified by `channel_dim`. Args: image (`numpy.ndarray`): The image to

Traces `root` and returns the corresponding FX `torch.fx.Graph` representation. `root` can either be a `torch.nn.Module` instance or

Framework-agnostic version of `numpy.transpose` that will work on torch/TensorFlow/Jax tensors as well as NumPy arrays.

Utility method to check if the model has correctly adapters injected on it.

Add `arrays` to the internal storage, Will initialize the storage to the full size at the first arrays passed so that if we're bound

Convert the inner content to tensors. Args: tensor_type (`str` or [`~utils.TensorType`], *optional*): Th

Create a schedule with a learning rate that decreases linearly from the initial lr set in the optimizer to 0, after a warmup period during wh

Converts the old size parameter in the config into the new dict expected in the config. This is to ensure backwards compatibility with the ol

Checks if `torch_npu` is installed and potentially if a NPU is in the environment

Get number of (optionally, trainable or non-embeddings) parameters in the module. Args: only_trainable (`bool`, *optiona

Prune a linear layer (a model parameters) to keep only entries in index. Return the pruned layer as a new layer with requires_grad=True.

Helper function for reproducible behavior to set the seed in `random`, `numpy`, `torch` and/or `tf` (if installed). Args: seed (`int

start tracking for the caller's stage

Performs a single optimization step. Args: closure (callable, optional): A closure that reevaluates the model and

Converts `image` to a PIL Image. Optionally rescales it and puts the channel dimension back as the last axis if needed. Args: im

Converts `image` to a PIL Image. Optionally rescales it and puts the channel dimension back as the last axis if needed. Args

Calculate rouge using rouge_scorer package. Args: pred_lns: list of summaries generated by model tgt_lns: list of groundtruth sum

Imports transformers directly Args: path (`str`): The path to the source file file (`str`, optional): The file to join with the p

Evaluate an absract syntax tree using the content of the variables stored in a state and only evaluating a given set of functions. This

Returns the number of spaces that start a line indent.

Checks if a repo contains a given file without downloading it. Works for remote repos and local folders. <Tip warning={false}> This fun

Checks if `intel_extension_for_pytorch` is installed and potentially if a XPU is in the environment

A method executed at the end of each Transformer model initialization, to execute code that needs the model's modules properly initia

Verify that out_indices and out_features are valid for the given stage_names.

Create the repo if needed, cleans up repo_id with deprecated kwargs `repo_url` and `organization`, retrieves the token.

Returns the list of files with their last modification timestamp.

Uploads all modified files in `working_dir` to `repo_id`, based on `files_timestamps`.

Commit new `contents` to `filenames` inside a given `repo`.

Retrieves all the files associated to a model. Args: model_type (`str`): A valid model type (like "bert" or "gpt2") framewor

Find the target (height, width) dimension of the output image after resizing given the input image and the desired size. Args: i

Convert frequency from hertz to mels. Args: freq (`float` or `np.ndarray`): The frequency, or multiple frequencies, in h

this function has to be called in init function if cache_policy is enabled. Thus, let's always call it in init funciton to make it si

Tests if `x` is a tensorflow tensor or not. Safe to call even if tensorflow is not installed.

Pads the `image` with the specified (height, width) `padding` and `mode`. Args: image (`np.ndarray`): The image to pad.

Function that is called by `.generate()` to push new tokens

Overwrite this method here for any operation that is expensive and needs to be executed before you start using your tool. Such as loa

Recursively unwraps a model from potential containers (as used in distributed training). Args: model (`torch.nn.Module`): The model

Shows a one-time warning if the input_ids appear to contain padding and no attention mask was given.

A utility to add some content inside a given file. Args: file_name (`str` or `os.PathLike`): The name of the file in which we want to

A utility to add some content inside a given text. Args: text (`str`): The text in which we want to insert some content. conte