MCPcopy Create free account
hub / github.com/deepspeedai/DeepSpeed / __init__

Method __init__

deepspeed/runtime/pipe/module.py:53–64  ·  view source on GitHub ↗
(self, typename, *module_args, **module_kwargs)

Source from the content-addressed store, hash-verified

51 """
52
53 def __init__(self, typename, *module_args, **module_kwargs):
54 self.typename = typename
55 self.module_args = module_args
56 self.module_kwargs = module_kwargs
57
58 if not issubclass(typename, nn.Module):
59 raise RuntimeError('LayerSpec only supports torch.nn.Module types.')
60
61 if dist.is_initialized():
62 self.global_rank = dist.get_rank()
63 else:
64 self.global_rank = -1
65
66 def __repr__(self):
67 return ds_utils.call_to_str(self.typename.__name__, self.module_args, self.module_kwargs)

Callers 2

__init__Method · 0.45
__init__Method · 0.45

Calls 2

is_initializedMethod · 0.45
get_rankMethod · 0.45

Tested by

no test coverage detected