MCPcopy Create free account
hub / github.com/deepspeedai/DeepSpeed / quantize_module

Function quantize_module

deepspeed/module_inject/module_quantize.py:58–60  ·  view source on GitHub ↗
(model, orig_class, quantize_fn)

Source from the content-addressed store, hash-verified

56
57
58def quantize_module(model, orig_class, quantize_fn):
59 policy = {orig_class: quantize_fn}
60 return _quantize_module(model, policy)
61
62
63def _quantize_module(model, policies):

Callers 1

quantize_transformer_layerFunction · 0.85

Calls 1

_quantize_moduleFunction · 0.85

Tested by

no test coverage detected