If CUDA is available and in GPU mode, host memory will be allocated pinned, using cudaMallocHost. It avoids dynamic pinning for transfers (DMA). The improvement in performance seems negligible in the single GPU case, but might be more significant for parallel training. Most importantly, it improved stability for large models on many GPUs.
source not stored for this graph (policy: none)