MCPcopy Create free account
hub / github.com/OpenDriveLab/ReSim / get_data_parallel_group

Function get_data_parallel_group

SwissArmyTransformer/sat/mpu/initialize.py:116–120  ·  view source on GitHub ↗

Get the data parallel group the caller rank belongs to.

()

Source from the content-addressed store, hash-verified

114
115
116def get_data_parallel_group():
117 """Get the data parallel group the caller rank belongs to."""
118 assert _DATA_PARALLEL_GROUP is not None, \
119 'data parallel group is not initialized'
120 return _DATA_PARALLEL_GROUP
121
122
123def get_node_group():

Callers 4

__init__Method · 0.90
__init__Method · 0.90
get_data_parallel_rankFunction · 0.85

Calls

no outgoing calls

Tested by

no test coverage detected