MCPcopy Create free account
hub / github.com/bitsandbytes-foundation/bitsandbytes / cgemv_4bit_inference_fp32

Function cgemv_4bit_inference_fp32

csrc/pythonInterface.cpp:690–695  ·  view source on GitHub ↗

Source from the content-addressed store, hash-verified

688}
689
690void cgemv_4bit_inference_fp32(
691 int m, int n, int k, float* A, unsigned char* B, float* absmax, float* datatype, float* out, int lda, int ldb,
692 int ldc, int blocksize, sycl::queue* stream
693) {
694 gemv_4bit_inference_fp32(m, n, k, A, B, absmax, datatype, out, lda, ldb, ldc, blocksize, stream);
695}
696
697// XPU Paged Memory Support using SYCL USM (Unified Shared Memory)
698// Equivalent CUDA APIs -> SYCL/Level Zero APIs:

Callers

nothing calls this directly

Calls 1

gemv_4bit_inference_fp32Function · 0.85

Tested by

no test coverage detected