MCPcopy Create free account
hub / github.com/Aveiro-Lin/GraphiContact / quantize_blockwise

Function quantize_blockwise

src/bitsandbytes/bitsandbytes/functional.py:801–912  ·  view source on GitHub ↗

Quantize tensor A in blocks of size 4096 values. Quantizes tensor A by dividing it into blocks of 4096 values. Then the absolute maximum value within these blocks is calculated for the non-linear quantization. Parameters ---------- A : torch.Tensor The input te

(
    A: Tensor,
    code: Optional[torch.Tensor] = None,
    absmax: Optional[torch.Tensor] = None,
    out: Optional[torch.Tensor] = None,
    blocksize=4096,
    nested=False,
)

Source from the content-addressed store, hash-verified

source not stored for this graph (policy: none)

Callers 1

quantize_4bitFunction · 0.85

Calls 8

create_dynamic_mapFunction · 0.85
pre_callFunction · 0.85
is_on_gpuFunction · 0.85
get_ptrFunction · 0.85
post_callFunction · 0.85
QuantStateClass · 0.85
meanMethod · 0.80
toMethod · 0.45

Tested by

no test coverage detected