Check whether duplicate names exist in list of 'external embeddings'. Args: embeddings (List[dict]): A list of embedding

Check whether overlap exist in token ids of 'external_embeddings'. Args: embeddings (List[dict]): A list of embedding to be check

Evaluate a function without caching intermediate activations, allowing for reduced memory at the expense of extra compute in the backward pas

Compute binned relative position bias

Compute the gradient of the classifier, i.e. nabla_{x} log p_t(cond | x_t).

Create a 1D, 2D, or 3D convolution module.

Computes efficient dot-product attention given query, transposed key, and value. This is efficient version of attention presented in https

loads additional models in conditioning