Constructor. Args: data_dir: root directory of the data preprocess: image preprocess function seq_len: seq

Environment wrapper which returns raw observations. Args: abs_datasets_dir: absolute datset directory observation_sap

Initialize the weights.

Prunes heads of the model. heads_to_prune: dict of {layer_num: list of heads to prune in this layer}

Decay the learning rate with half-cycle cosine after warmup

Load tf checkpoints in a pytorch model