MCPcopy Create free account
hub / github.com/zai-org/CodeGeeX / get_model_parallel_rank

Function get_model_parallel_rank

codegeex/megatron/mpu/initialize.py:284–288  ·  view source on GitHub ↗
()

Source from the content-addressed store, hash-verified

282
283
284def get_model_parallel_rank():
285 assert (
286 get_pipeline_model_parallel_world_size() == 1
287 ), "legacy get_model_parallel_rank is only supported if PP is disabled"
288 return get_tensor_model_parallel_rank()
289
290
291def get_pipeline_model_parallel_rank():

Callers

nothing calls this directly

Tested by

no test coverage detected