MCPcopy Create free account
hub / github.com/Aveiro-Lin/GraphiContact / dequantize_4bit

Function dequantize_4bit

src/bitsandbytes/bitsandbytes/functional.py:1291–1424  ·  view source on GitHub ↗

Dequantizes FP4 blockwise quantized values. Dequantizes the tensor A with maximum absolute values absmax in blocks of size blocksize. Parameters ---------- A : torch.Tensor The input tensor (packed 4-bit values). quant_state : QuantState object with quantis

(
    A: Tensor,
    quant_state: Optional[QuantState] = None,
    absmax: Optional[torch.Tensor] = None,
    out: Optional[torch.Tensor] = None,
    blocksize: int = 64,
    quant_type="fp4",
)

Source from the content-addressed store, hash-verified

source not stored for this graph (policy: none)

Callers 2

dequantize_fp4Function · 0.85
dequantize_nf4Function · 0.85

Calls 7

QuantStateClass · 0.85
dequantize_blockwiseFunction · 0.85
pre_callFunction · 0.85
is_on_gpuFunction · 0.85
get_ptrFunction · 0.85
post_callFunction · 0.85
floatMethod · 0.80

Tested by

no test coverage detected