* @brief Whether a layer should be shared by multiple nets during data * parallelism. By default, all layers except for data layers should * not be shared. data layers should be shared to ensure each worker * solver access data sequentially during data parallelism. */
| 99 | * solver access data sequentially during data parallelism. |
| 100 | */ |
| 101 | virtual inline bool ShareInParallel() const { return false; } |
| 102 | |
| 103 | /** @brief Return whether this layer is actually shared by other nets. |
| 104 | * If ShareInParallel() is true and using more than one GPU and the |