Method autotp_size

deepspeed/runtime/engine.py:1237–1238 · view source on GitHub ↗

(self)

Source from the content-addressed store, hash-verified

1235	return self._config.tensor_parallel_config
1236
1237	def autotp_size(self):
1238	return self._config.tensor_parallel_config.autotp_size
1239
1240	def graph_harvesting(self):
1241	return self._config.graph_harvesting

__init__Method · 0.95

_configure_expert_parallelMethod · 0.95

_configure_tensor_parallel_statesMethod · 0.95

_apply_autotp_partitioningMethod · 0.95

_validate_zero3_moe_compatibilityMethod · 0.95

_consolidated_16bit_state_dictMethod · 0.95

_cpu_folded_runtime_workerFunction · 0.80

test_h100_folded_tp2_ep2_runtimeMethod · 0.80

test_h100_folded_tp2_ep4_runtimeMethod · 0.80

_compare_tp_gradientsMethod · 0.80

test_tp_plan_basic_trainingMethod · 0.80

test_tp_plan_with_zero1Method · 0.80

no outgoing calls

_cpu_folded_runtime_workerFunction · 0.64

test_h100_folded_tp2_ep2_runtimeMethod · 0.64

test_h100_folded_tp2_ep4_runtimeMethod · 0.64

_compare_tp_gradientsMethod · 0.64

test_tp_plan_basic_trainingMethod · 0.64

test_tp_plan_with_zero1Method · 0.64

test_tp_plan_with_zero2Method · 0.64

test_qwen2_tp_plan_with_zero2Method · 0.64

test_custom_model_with_custom_tp_planMethod · 0.64

test_tp_model_init_merges_configMethod · 0.64

test_tp_model_init_autocreates_tp_groupMethod · 0.64