MCPcopy Create free account
hub / github.com/zai-org/CodeGeeX / destroy_model_parallel

Function destroy_model_parallel

codegeex/megatron/mpu/initialize.py:396–403  ·  view source on GitHub ↗

Set the groups to none.

()

Source from the content-addressed store, hash-verified

394
395
396def destroy_model_parallel():
397 """Set the groups to none."""
398 global _TENSOR_MODEL_PARALLEL_GROUP
399 _TENSOR_MODEL_PARALLEL_GROUP = None
400 global _PIPELINE_MODEL_PARALLEL_GROUP
401 _PIPELINE_MODEL_PARALLEL_GROUP = None
402 global _DATA_PARALLEL_GROUP
403 _DATA_PARALLEL_GROUP = None

Callers

nothing calls this directly

Calls

no outgoing calls

Tested by

no test coverage detected