MCPcopy Create free account
hub / github.com/bitsandbytes-foundation/bitsandbytes / cgemv_4bit_inference_fp16

Function cgemv_4bit_inference_fp16

csrc/pythonInterface.cpp:676–681  ·  view source on GitHub ↗

Source from the content-addressed store, hash-verified

674}
675
676void cgemv_4bit_inference_fp16(
677 int m, int n, int k, sycl::half* A, unsigned char* B, float* absmax, float* datatype, sycl::half* out, int lda,
678 int ldb, int ldc, int blocksize, sycl::queue* stream
679) {
680 gemv_4bit_inference_fp16(m, n, k, A, B, absmax, datatype, out, lda, ldb, ldc, blocksize, stream);
681}
682
683void cgemv_4bit_inference_bf16(
684 int m, int n, int k, sycl::ext::oneapi::bfloat16* A, unsigned char* B, float* absmax, float* datatype,

Callers

nothing calls this directly

Calls 1

gemv_4bit_inference_fp16Function · 0.85

Tested by

no test coverage detected