↓ 1 callersFunction__mllm_blas_matmul_fp32_gemv_nt_nt_decode_small_d_wv_baselineOptimized for decoding. W: [B, H, 1, S] V: [B, H, S, D] D is small in mllm's case(small language model). D=64, 96, 128 ...
mllm/backends/cpu/kernels/arm/mllm_blas/mllm_blas_sgemm.cpp:128
↓ 1 callersFunction_make_jit_kernel_registry_key(
*,
fn: Callable[..., Any],
export_name: str,
template_cpp_args: Tuple[str, ...],
device:
mllm-kernel/mllm_kernel/jit_utils/compile.py:198