MCPcopy Create free account
hub / github.com/antirez/ds4 / weights_streaming_layer_experts_uniform

Function weights_streaming_layer_experts_uniform

ds4.c:3344–3354  ·  view source on GitHub ↗

* Mixed-precision ("boosted") GGUFs upcast a few layers' routed experts to a * bigger quant (e.g. Q4_K among IQ2 layers). The streaming expert cache is a * single-size-class slab allocator sized from the FIRST routed layer, so those * layers can never be served from it: they must read expert weights through the * mapped-model views instead. A layer is "uniform" iff its per-expert bytes * matc

Source from the content-addressed store, hash-verified

3342 float amax = 0.0f;
3343 for (int j = 0; j < QK_K; j++) {
3344 const float ax = fabsf(x[j]);
3345 if (ax > amax) {
3346 amax = ax;
3347 max = x[j];
3348 }
3349 }
3350
3351 if (amax == 0.0f) {
3352 y[b].d = 0.0f;
3353 memset(y[b].qs, 0, sizeof(y[b].qs));
3354 memset(y[b].bsums, 0, sizeof(y[b].bsums));
3355 x += QK_K;
3356 continue;
3357 }

Callers 2

ds4_engine_openFunction · 0.85

Tested by

no test coverage detected