Converts an index (integer) in a token (str) using the vocab.

Converts an index (integer) in a token (str) using the vocab.

Converts a token (str) in an id using the vocab.

Run evaluation and returns metrics. The calling script will be responsible for providing a method to compute metrics, as they are ta

Run prediction and returns predictions and potential metrics. Depending on the dataset and your use case, your test dataset may cont

Converts a token (str) in an id using the vocab.

Pad encoded inputs (on left/right and up to predefined length or max length in the batch) Args: encoded_inputs:

Build model inputs from a sequence or a pair of sequence for sequence classification tasks by concatenating and adding special tokens

Returns vocab as a dict

Perform an evaluation step on `model` using `inputs`. Subclass and override to inject custom behavior. Args: mo

Save the vocabulary and special tokens file to a directory. Args: save_directory (`str`): The directory