MCPcopy Create free account
hub / github.com/togethercomputer/OpenChatKit / get_data_parallel_world_size

Function get_data_parallel_world_size

training/comm/comm_utils.py:33–35  ·  view source on GitHub ↗
()

Source from the content-addressed store, hash-verified

31
32
33def get_data_parallel_world_size() -> int:
34 assert _DATA_PARALLEL_WORLD_SIZE is not None
35 return _DATA_PARALLEL_WORLD_SIZE
36
37
38def get_pipeline_parallel_comm() -> NCCLCommunicator:

Callers 4

train_loopFunction · 0.85
mainFunction · 0.85
train_loopFunction · 0.85
mainFunction · 0.85

Calls

no outgoing calls

Tested by

no test coverage detected