MCPcopy Create free account
hub / github.com/bitsandbytes-foundation/bitsandbytes / gemv_4bit_inference_fp16

Function gemv_4bit_inference_fp16

csrc/pythonInterface.cpp:305–310  ·  view source on GitHub ↗

Source from the content-addressed store, hash-verified

303}
304
305void gemv_4bit_inference_fp16(
306 int m, int n, int k, sycl::half* A, unsigned char* B, float* absmax, float* datatype, sycl::half* out, int lda,
307 int ldb, int ldc, int blocksize, sycl::queue* stream
308) {
309 gemv_4bit_inference<sycl::half, 16>(m, n, k, A, B, absmax, datatype, out, lda, ldb, ldc, blocksize, stream);
310}
311
312void gemv_4bit_inference_bf16(
313 int m, int n, int k, sycl::ext::oneapi::bfloat16* A, unsigned char* B, float* absmax, float* datatype,

Callers 1

Calls

no outgoing calls

Tested by

no test coverage detected