Method get_world_size

deepspeed/comm/torch.py:394–395 · view source on GitHub ↗

(self, group=None)

Source from the content-addressed store, hash-verified

392	return torch.distributed.get_rank(group=group)
393
394	def get_world_size(self, group=None):
395	return torch.distributed.get_world_size(group=group)
396
397	def is_initialized(self):
398	return torch.distributed.is_initialized()

__init__Method · 0.95

_register_paramMethod · 0.80

_expected_view_sumMethod · 0.80

create_deepspeed_argsFunction · 0.80

reduce_boolean_flagsFunction · 0.80

train_cifarFunction · 0.80

test_mesh_device_creationMethod · 0.80

test_FPDT_attention_offloading_output_consistencyMethod · 0.80

gather_tensorFunction · 0.80

test_boundary_microbatch_grad_is_reducedMethod · 0.80

test_1_param_groupMethod · 0.80

test_2_param_groupsMethod · 0.80

no outgoing calls

_register_paramMethod · 0.64

_expected_view_sumMethod · 0.64

test_mesh_device_creationMethod · 0.64

test_FPDT_attention_offloading_output_consistencyMethod · 0.64

gather_tensorFunction · 0.64

test_boundary_microbatch_grad_is_reducedMethod · 0.64

test_1_param_groupMethod · 0.64

test_2_param_groupsMethod · 0.64

__init__Method · 0.64

testMethod · 0.64

_gather_autoep_expert_gradFunction · 0.64