MCPcopy Create free account
hub / github.com/bitsandbytes-foundation/bitsandbytes / gemv_4bit_inference_bf16

Function gemv_4bit_inference_bf16

csrc/pythonInterface.cpp:312–319  ·  view source on GitHub ↗

Source from the content-addressed store, hash-verified

310}
311
312void gemv_4bit_inference_bf16(
313 int m, int n, int k, sycl::ext::oneapi::bfloat16* A, unsigned char* B, float* absmax, float* datatype,
314 sycl::ext::oneapi::bfloat16* out, int lda, int ldb, int ldc, int blocksize, sycl::queue* stream
315) {
316 gemv_4bit_inference<sycl::ext::oneapi::bfloat16, 16>(
317 m, n, k, A, B, absmax, datatype, out, lda, ldb, ldc, blocksize, stream
318 );
319}
320
321void gemv_4bit_inference_fp32(
322 int m, int n, int k, float* A, unsigned char* B, float* absmax, float* datatype, float* out, int lda, int ldb,

Callers 1

Calls

no outgoing calls

Tested by

no test coverage detected