MCPcopy Index your code
hub / github.com/togethercomputer/OpenChatKit / get_data_parallel_comm

Function get_data_parallel_comm

training/comm/comm_utils.py:23–25  ·  view source on GitHub ↗
()

Source from the content-addressed store, hash-verified

21 return _LOCK
22
23def get_data_parallel_comm() -> NCCLCommunicator:
24 assert _DATA_PARALLEL_COMM is not None
25 return _DATA_PARALLEL_COMM
26
27
28def get_data_parallel_rank() -> int:

Callers 8

train_loopFunction · 0.85
mainFunction · 0.85
train_loopFunction · 0.85
mainFunction · 0.85
__init__Method · 0.85
__init__Method · 0.85
__init__Method · 0.85
__init__Method · 0.85

Calls

no outgoing calls

Tested by

no test coverage detected