MCPcopy Create free account
hub / github.com/IST-DASLab/MoE-Quant / gptq_loop_graph

Function gptq_loop_graph

src/gptq_loop.py:108–190  ·  view source on GitHub ↗

CUDA Graph wrapper for GPTQ loops

(
    weight: torch.Tensor,
    hessian_inv: torch.Tensor,
    scale: torch.Tensor,
    qzero: torch.Tensor,
    maxq: torch.Tensor,
    qweight: torch.Tensor = None,
    error_block: torch.Tensor = None,
    dtype: torch.dtype = None,
    gptq_block_size: int = 128,
    direct: bool = True,
)

Source from the content-addressed store, hash-verified

source not stored for this graph (policy: none)

Callers 1

gptq_loopFunction · 0.85

Calls 2

quantize_error_tritonFunction · 0.85
addvv_tritonFunction · 0.85

Tested by

no test coverage detected