MCPcopy Create free account
hub / github.com/bitsandbytes-foundation/bitsandbytes / cgemv_4bit_inference_bf16

Function cgemv_4bit_inference_bf16

csrc/pythonInterface.cpp:683–688  ·  view source on GitHub ↗

Source from the content-addressed store, hash-verified

681}
682
683void cgemv_4bit_inference_bf16(
684 int m, int n, int k, sycl::ext::oneapi::bfloat16* A, unsigned char* B, float* absmax, float* datatype,
685 sycl::ext::oneapi::bfloat16* out, int lda, int ldb, int ldc, int blocksize, sycl::queue* stream
686) {
687 gemv_4bit_inference_bf16(m, n, k, A, B, absmax, datatype, out, lda, ldb, ldc, blocksize, stream);
688}
689
690void cgemv_4bit_inference_fp32(
691 int m, int n, int k, float* A, unsigned char* B, float* absmax, float* datatype, float* out, int lda, int ldb,

Callers

nothing calls this directly

Calls 1

gemv_4bit_inference_bf16Function · 0.85

Tested by

no test coverage detected