MCPcopy
hub / github.com/deepspeedai/DeepSpeed / run_quantize_ds

Function run_quantize_ds

tests/unit/ops/quantizer/test_quantize.py:18–24  ·  view source on GitHub ↗
(activations, num_groups, q_bits, is_symmetric_quant)

Source from the content-addressed store, hash-verified

16
17
18def run_quantize_ds(activations, num_groups, q_bits, is_symmetric_quant):
19 global inference_module
20 if inference_module is None:
21 inference_module = QuantizerBuilder().load()
22
23 return inference_module.quantize(activations, num_groups, q_bits,
24 inference_module.Symmetric if is_symmetric_quant else inference_module.Asymmetric)
25
26
27def run_dequantize_ds(activations, params, num_groups, q_bits, is_symmetric_quant):

Callers 1

test_float_quantizeFunction · 0.85

Calls 3

QuantizerBuilderClass · 0.90
loadMethod · 0.45
quantizeMethod · 0.45

Tested by

no test coverage detected

Used in the wild real call sites across dependent graphs

searching dependent graphs…