Convert primitive modules to float16.

Convert primitive modules to float32, undoing convert_module_to_f16().

Convert the torso of the model to float16.

Convert the torso of the model to float32.

Convert the torso of the model to float32.

Download a file from a url and place it in root. Args: url (str): URL to download file from root (str): Directory to place downlo

Write all of the diagnostics from the current iteration

Apply the module to `x` given `emb` timestep embeddings.

Apply the block to a Tensor, conditioned on a timestep embedding. :param x: an [N x C x ...] Tensor of features. :param emb:

Apply QKV attention. :param qkv: an [N x (H * 3 * C) x T] tensor of Qs, Ks, and Vs. :return: an [N x (H * C) x T] tensor aft

Apply QKV attention. :param qkv: an [N x (3 * H * C) x T] tensor of Qs, Ks, and Vs. :return: an [N x (H * C) x T] tensor aft

Apply the model to an input batch. :param x: an [N x C x ...] Tensor of inputs. :param timesteps: a 1-D batch of timesteps.

Apply the model to an input batch. :param x: an [N x C x ...] Tensor of inputs. :param timesteps: a 1-D batch of timesteps.

Get directory that log files are being written to. will be None if there is no output directory (i.e., if you didn't call start)

List all directories at a given root Args: root (str): Path to directory whose folders need to be listed prefix (bool, optional):

List all files ending with a suffix at a given root Args: root (str): Path to directory whose folders need to be listed suffix (s

The same as logkv(), but if called many times, values averaged.

Log a dictionary of key-value pairs

Take the mean over all non-batch dimensions.

Usage: @profile("my_func") def my_func(): code

Scale the parameters of a module and return it.

Set logging threshold on current logger.

https://stackoverflow.com/questions/15008758/parsing-boolean-values-with-argparse

Update target parameters to be closer to those of source parameters using an exponential moving average. :param target_params: the targe