Source: https://github.com/slowbull/DDPG/blob/master/src/explorationnoise.py I think that: It makes Zero-mean Gaussian Noise

The noise of Ornstein-Uhlenbeck Process Source: https://github.com/slowbull/DDPG/blob/master/src/explorationnoise.py It makes Zero

Experience Replay Buffer save environment transition in a continuous RAM for high performance training we save trajectory in order

Experience Replay Buffer for Multiple Processing `int max_len` the max_len of ReplayBuffer, not the total len of ReplayBufferMP `i

Preprocess a standard OpenAI gym environment for training. `object env` a standard OpenAI gym environment, it has env.reset() and env.step()