MCPcopy Create free account
hub / github.com/deepspeedai/DeepSpeed / quantize_training

Method quantize_training

deepspeed/runtime/engine.py:1095–1108  ·  view source on GitHub ↗
(self)

Source from the content-addressed store, hash-verified

1093 return self._config.scheduler_params
1094
1095 def quantize_training(self):
1096 return (
1097 self._config.compression_config[WEIGHT_QUANTIZATION][SHARED_PARAMETERS]
1098 [WEIGHT_QUANTIZE_IN_FORWARD_ENABLED],
1099 self._config.compression_config[WEIGHT_QUANTIZATION][SHARED_PARAMETERS][WEIGHT_QUANTIZE_ENABLED],
1100 self._config.compression_config[WEIGHT_QUANTIZATION][SHARED_PARAMETERS][WEIGHT_QUANTIZE_GROUPS],
1101 self._config.compression_config[WEIGHT_QUANTIZATION][SHARED_PARAMETERS]
1102 [WEIGHT_QUANTIZE_FP16_MIXED_QUANTIZE],
1103 self._config.compression_config[WEIGHT_QUANTIZATION][SHARED_PARAMETERS][WEIGHT_QUANTIZE_CHANGE_RATIO],
1104 self._config.compression_config[WEIGHT_QUANTIZATION][SHARED_PARAMETERS][WEIGHT_QUANTIZE_TYPE],
1105 self._config.compression_config[WEIGHT_QUANTIZATION][SHARED_PARAMETERS][WEIGHT_QUANTIZE_ROUNDING],
1106 self._config.compression_config[WEIGHT_QUANTIZATION][SHARED_PARAMETERS][WEIGHT_QUANTIZE_VERBOSE],
1107 self._config.compression_config[WEIGHT_QUANTIZATION][SHARED_PARAMETERS][WEIGHT_QUANTIZE_KERNEL],
1108 )
1109
1110 def zero_optimization(self):
1111 return self._config.zero_enabled

Callers 1

Calls

no outgoing calls

Tested by

no test coverage detected