MCPcopy
hub / github.com/InternLM/InternLM / sync_model_param

Function sync_model_param

internlm/utils/parallel.py:14–24  ·  view source on GitHub ↗

r"""Make sure data parameters are consistent during Data Parallel Mode. Args: model (:class:`torch.nn.Module`): A pyTorch model on whose parameters you check the consistency. parallel_mode (:class:`internlm.core.context.ParallelMode`): Parallel mode to be checked.

(model, parallel_mode)

Source from the content-addressed store, hash-verified

12
13
14def sync_model_param(model, parallel_mode):
15 r"""Make sure data parameters are consistent during Data Parallel Mode.
16
17 Args:
18 model (:class:`torch.nn.Module`): A pyTorch model on whose parameters you check the consistency.
19 parallel_mode (:class:`internlm.core.context.ParallelMode`): Parallel mode to be checked.
20 """
21 if gpc.is_initialized(parallel_mode) and gpc.get_world_size(parallel_mode) > 1:
22 for param in model.parameters():
23 ranks = gpc.get_ranks_in_group(parallel_mode)
24 dist.broadcast(param, src=ranks[0], group=gpc.get_group(parallel_mode))
25
26
27def sync_model_param_within_tp(model):

Callers 1

initialize_modelFunction · 0.90

Calls 4

is_initializedMethod · 0.80
get_world_sizeMethod · 0.80
get_ranks_in_groupMethod · 0.80
get_groupMethod · 0.80

Tested by

no test coverage detected