MCPcopy
hub / github.com/InternLM/InternLM / is_model_parallel_parameter

Function is_model_parallel_parameter

internlm/utils/parallel.py:10–11  ·  view source on GitHub ↗
(p)

Source from the content-addressed store, hash-verified

8
9
10def is_model_parallel_parameter(p):
11 return hasattr(p, IS_TENSOR_PARALLEL) and getattr(p, IS_TENSOR_PARALLEL)
12
13
14def sync_model_param(model, parallel_mode):

Callers 2

compute_normFunction · 0.90
sync_model_param_within_tpFunction · 0.85

Calls

no outgoing calls

Tested by

no test coverage detected