Computes and stores the average and current value

A thread-safe future implementation. Used only as one-to-one pipe.

Pipe for master-slave communication.

An abstract `SyncMaster` object. - During the replication, as the data parallel will trigger an callback of each module, all slave devices should

r"""Applies Batch Normalization over a 2D or 3D input (a mini-batch of 1D inputs with optional additional channel dimension) as described in the p

r"""Applies Batch Normalization over a 4D input (a mini-batch of 2D inputs with additional channel dimension) as described in the paper `Batch

Data Parallel with a replication callback. An replication callback `__data_parallel_replicate__` of each module will be invoked after being

r"""Applies Synchronized Batch Normalization over a 2d or 3d input that is seen as a mini-batch. .. math:: y = \frac{x - mean[x]}{ \

r"""Applies Batch Normalization over a 4d input that is seen as a mini-batch of 3d inputs .. math:: y = \frac{x - mean[x]}{ \sqrt{Va

r"""Applies Batch Normalization over a 5d input that is seen as a mini-batch of 4d inputs .. math:: y = \frac{x - mean[x]}{ \sqrt{Va