MCPcopy Create free account
hub / github.com/togethercomputer/OpenChatKit / get_data_parallel_rank

Function get_data_parallel_rank

training/comm/comm_utils.py:28–30  ·  view source on GitHub ↗
()

Source from the content-addressed store, hash-verified

26
27
28def get_data_parallel_rank() -> int:
29 assert _DATA_PARALLEL_RANK is not None
30 return _DATA_PARALLEL_RANK
31
32
33def get_data_parallel_world_size() -> int:

Callers 9

train_loopFunction · 0.85
mainFunction · 0.85
train_loopFunction · 0.85
mainFunction · 0.85
__init__Method · 0.85
__init__Method · 0.85
__init__Method · 0.85
__init__Method · 0.85
__init__Method · 0.85

Calls

no outgoing calls

Tested by

no test coverage detected