This implementation downloads the remote resource and caches it locally. The resource will only be downloaded if not previously requested.

Utility for deleting a directory. Useful for cleaning the storage space that contains various training artifacts like checkpoints, data etc.

same output as PIL.ImageEnhance.Color

Concatenates multiple datasets into a single dataset. It supports may-style datasets and DataPipeline from WebDataset. Currently, does not s

same output as PIL.ImageEnhance.Contrast

Simply create the symlinks for a given file1 to file2. Useful during model checkpointing to symlinks to the latest successful checkpoint.

A property to get and create dataloaders by split just in need. If no train_dataset_ratio is provided, concatenate map-style dataset

Overwrite model.train with this function to make sure train/eval mode does not change anymore.

Download a file from google drive Downloading an URL from google drive requires confirmation when the file of the size is too big (google

same output as PIL.ImageOps.equalize PIL's implementation is different from cv2.equalize

Set to True to skip training.

r""" encoder_hidden_states (:obj:`torch.FloatTensor` of shape :obj:`(batch_size, sequence_length, hidden_size)`, `optional`): Seq

r""" encoder_hidden_states (:obj:`torch.FloatTensor` of shape :obj:`(batch_size, sequence_length, hidden_size)`, `optional`): Seq

r""" labels (:obj:`torch.LongTensor` of shape :obj:`(batch_size, sequence_length)`, `optional`): Labels for computing the masked l

r""" Args: labels (`torch.LongTensor` of shape `(batch_size, sequence_length)`, *optional*): Labels for computing

Get image ids that satisfy given filter conditions. default skips that filter :param quesIds (int array) : get image ids for gi

Given a file, get the size of file in MB