Sync the model weight by NCCL. (For `NCCL` sync method)
(self)
| 338 | |
| 339 | @abstractmethod |
| 340 | def sync_weight_nccl(self) -> None: |
| 341 | """Sync the model weight by NCCL. (For `NCCL` sync method)""" |
| 342 | |
| 343 | @abstractmethod |
| 344 | async def upload_state_dict(self) -> None: |