MCPcopy
hub / github.com/deepspeedai/DeepSpeed / MiCS_CommGroups

Class MiCS_CommGroups

deepspeed/runtime/zero/mics_utils.py:34–45  ·  view source on GitHub ↗

Source from the content-addressed store, hash-verified

32
33@dataclass
34class MiCS_CommGroups:
35 """"""
36 param_shard_group = None
37 param_shard_size = -1
38 param_shard_rank = -1
39
40 param_repli_group = None
41 param_repli_size = -1
42 param_repli_rank = -1
43
44 param_intra_node_group = None
45 param_inter_node_shard_group = None
46
47
48def create_mics_comm_groups(

Callers 1

create_mics_comm_groupsFunction · 0.85

Calls

no outgoing calls

Tested by

no test coverage detected

Used in the wild real call sites across dependent graphs

searching dependent graphs…