The same as logkv(), but if called many times, values averaged.

Log a dictionary of key-value pairs

Usage: @profile("my_func") def my_func(): code

Scale the parameters of a module and return it.

Set logging threshold on current logger.

Setup a distributed process group.

set up logger

https://stackoverflow.com/questions/15008758/parsing-boolean-values-with-argparse

Synchronize a sequence of Tensors across ranks from rank 0.

Converts a torch Tensor into an image Numpy array Input: 4D(B,(3/1),H,W), 3D(C,H,W), or 2D(H,W), any range, RGB channel order Output: 3D(

Compute training losses for a single timestep. :param model: the model to evaluate loss on. :param x_start: the [N x C x ...]

Update target parameters to be closer to those of source parameters using an exponential moving average. :param target_params: the targe