* Mixed-precision ("boosted") GGUFs upcast a few layers' routed experts to a * bigger quant (e.g. Q4_K among IQ2 layers). The streaming expert cache is a * single-size-class slab allocator sized from the FIRST routed layer, so those * layers can never be served from it: they must read expert weights through the * mapped-model views instead. A layer is "uniform" iff its per-expert bytes * matc
| 3342 | float amax = 0.0f; |
| 3343 | for (int j = 0; j < QK_K; j++) { |
| 3344 | const float ax = fabsf(x[j]); |
| 3345 | if (ax > amax) { |
| 3346 | amax = ax; |
| 3347 | max = x[j]; |
| 3348 | } |
| 3349 | } |
| 3350 | |
| 3351 | if (amax == 0.0f) { |
| 3352 | y[b].d = 0.0f; |
| 3353 | memset(y[b].qs, 0, sizeof(y[b].qs)); |
| 3354 | memset(y[b].bsums, 0, sizeof(y[b].bsums)); |
| 3355 | x += QK_K; |
| 3356 | continue; |
| 3357 | } |
no test coverage detected