MCPcopy Create free account
hub / github.com/deepspeedai/DeepSpeed / quantize_training

Method quantize_training

deepspeed/runtime/engine.py:1163–1176  ·  view source on GitHub ↗
(self)

Source from the content-addressed store, hash-verified

1161 return self._config.scheduler_params
1162
1163 def quantize_training(self):
1164 return (
1165 self._config.compression_config[WEIGHT_QUANTIZATION][SHARED_PARAMETERS]
1166 [WEIGHT_QUANTIZE_IN_FORWARD_ENABLED],
1167 self._config.compression_config[WEIGHT_QUANTIZATION][SHARED_PARAMETERS][WEIGHT_QUANTIZE_ENABLED],
1168 self._config.compression_config[WEIGHT_QUANTIZATION][SHARED_PARAMETERS][WEIGHT_QUANTIZE_GROUPS],
1169 self._config.compression_config[WEIGHT_QUANTIZATION][SHARED_PARAMETERS]
1170 [WEIGHT_QUANTIZE_FP16_MIXED_QUANTIZE],
1171 self._config.compression_config[WEIGHT_QUANTIZATION][SHARED_PARAMETERS][WEIGHT_QUANTIZE_CHANGE_RATIO],
1172 self._config.compression_config[WEIGHT_QUANTIZATION][SHARED_PARAMETERS][WEIGHT_QUANTIZE_TYPE],
1173 self._config.compression_config[WEIGHT_QUANTIZATION][SHARED_PARAMETERS][WEIGHT_QUANTIZE_ROUNDING],
1174 self._config.compression_config[WEIGHT_QUANTIZATION][SHARED_PARAMETERS][WEIGHT_QUANTIZE_VERBOSE],
1175 self._config.compression_config[WEIGHT_QUANTIZATION][SHARED_PARAMETERS][WEIGHT_QUANTIZE_KERNEL],
1176 )
1177
1178 def zero_optimization(self):
1179 return self._config.zero_enabled

Callers 1

Calls

no outgoing calls

Tested by

no test coverage detected