Very simple multi-layer perceptron (also called FFN)

Very simple multi-layer perceptron (also called FFN)

Track a series of values and provide access to smoothed values over a window or the global series average.

ResNet backbone with frozen BatchNorm.

Absolute pos embedding, learned.

This is a more standard version of the position embedding, very similar to the one used by the Attention is all you need paper, generalized t

BatchNorm2d where the batch statistics and the affine parameters are fixed. Copy-paste from torchvision.misc.ops with added eps before rqsrt

Randomly selects between transforms1 and transforms2, with probability p for transforms1 and (1 - p) for transforms2