MCPcopy Create free account
hub / github.com/deepspeedai/DeepSpeed / quantize_training

Method quantize_training

deepspeed/runtime/engine.py:1149–1162  ·  view source on GitHub ↗
(self)

Source from the content-addressed store, hash-verified

1147 return self._config.scheduler_params
1148
1149 def quantize_training(self):
1150 return (
1151 self._config.compression_config[WEIGHT_QUANTIZATION][SHARED_PARAMETERS]
1152 [WEIGHT_QUANTIZE_IN_FORWARD_ENABLED],
1153 self._config.compression_config[WEIGHT_QUANTIZATION][SHARED_PARAMETERS][WEIGHT_QUANTIZE_ENABLED],
1154 self._config.compression_config[WEIGHT_QUANTIZATION][SHARED_PARAMETERS][WEIGHT_QUANTIZE_GROUPS],
1155 self._config.compression_config[WEIGHT_QUANTIZATION][SHARED_PARAMETERS]
1156 [WEIGHT_QUANTIZE_FP16_MIXED_QUANTIZE],
1157 self._config.compression_config[WEIGHT_QUANTIZATION][SHARED_PARAMETERS][WEIGHT_QUANTIZE_CHANGE_RATIO],
1158 self._config.compression_config[WEIGHT_QUANTIZATION][SHARED_PARAMETERS][WEIGHT_QUANTIZE_TYPE],
1159 self._config.compression_config[WEIGHT_QUANTIZATION][SHARED_PARAMETERS][WEIGHT_QUANTIZE_ROUNDING],
1160 self._config.compression_config[WEIGHT_QUANTIZATION][SHARED_PARAMETERS][WEIGHT_QUANTIZE_VERBOSE],
1161 self._config.compression_config[WEIGHT_QUANTIZATION][SHARED_PARAMETERS][WEIGHT_QUANTIZE_KERNEL],
1162 )
1163
1164 def zero_optimization(self):
1165 return self._config.zero_enabled

Callers 1

Calls

no outgoing calls

Tested by

no test coverage detected