helper function to log only on global rank 0

r""" a helper function to run method on the owner of rref and fetch back the result using RPC

r""" Create one RRef for each parameter in the given local module, and return a list of RRefs.

helper function for python 2 and 3 to call os.makedirs() avoiding an error if the directory to be created already exists

Tokenizes a text file.

verification that we have at least 2 gpus to run dist examples

r""" a helper function to run method on the owner of rref and fetch back the result using RPC

Computes the accuracy over the k top predictions for the specified values of k

quick function to format numbers to gigabyte and round to 4 digit precision

Creates a string description of a polynomial.

Precompute the frequency tensor for complex exponentials (cis) with given dimensions. This function calculates a frequency tensor with compl

Wraps hidden states in new Tensors, to detach them from their history.

torch.repeat_interleave(x, dim=2, repeats=n_rep)

Initializes the GAT model. Args: in_features (int): number of input features per node. n_hidden (int): output size

calculates the attention scores e_ij for all pairs of nodes (i, j) in the graph in vectorized parallel form. for each pair of source and targe

r""" Create one RRef for each parameter in the given local module, and return a list of RRefs.

r""" The trainer creates a distributed RNNModel and a DistributedOptimizer. Then, it performs training using random input data.