Create a mask from the two sequences passed to be used in a sequence-pair classification task. T5 does not make use of token type ids

Args: hidden_states (`torch.FloatTensor`): input to the layer of shape `(batch, seq_len, embed_dim)` attention_mask (

r""" Args: labels (`torch.LongTensor` of shape `(batch_size, sequence_length)`, *optional*): Labels for computing

r""" labels (`torch.LongTensor` of shape `(batch_size,)`, *optional*): Labels for computing the sequence classification/regression

DOC_AWARE_PIPELINE_K assigns k batch indices to one doc

Retrieve sequence ids from a token list that has no special tokens added. This method is called when adding special tokens using the

Returns vocab as a dict

Save the vocabulary and special tokens file to a directory. Args: save_directory (`str`): The directory i

Returns vocab size

To be used as decorator, automatically bookkeep a RNG for the wrapped function.