Build the /props response body. Non-static so unit tests can call it directly (declared in http_server.h).

Select or create a backend for prefix cache snapshot storage. If the compute backend's default buffer type is host-accessible (unified memory — e.g.

Total number of emit_token() calls observed so far. Used in tandem with first_content_token_index() to compute the content-token count without dependi

Public entry. Workaround for a ggml-cuda/HIP defect: the MMQ mul_mat_id kernel illegal-accesses on gfx1151 when the per-layer hot expert stack is REDU

Free the snapshot backend if it was separately allocated. Safe to call with nullptr. Does NOT free the compute backend.

Locate the Qwen3-0.6B residency drafter: the explicit override (DFLASH_KVFLASH_DRAFTER, set from --prefill-drafter), then the well-known locations nex

Attach rollback tensors to an existing prefill cache without touching the base tensors (KV, SSM, conv, target_feat) that prefill already populated. No

Pop an item from the stack, the function returns NULL if there are no * items to pop. */

Send a command and wait for its `ok ...`/`err ...` reply. Returns the reply line, or None if the daemon died or stalled past `timeout

Little-endian I/O helpers.

Allocate per-prefill scratch buffers for the chunk-parallel kernel. Buffers depend on S (sequence length); call once per distinct S.

Build batched routed graph helper for batched prefill.

Zero-based index of the first emit_token() call that produced CONTENT-mode output (i.e., the first token after the model's natural `</think>`). Return

KV reservation bytes per token for a hybrid attention/SSM model. Single source of truth for both qwen35 (dense) and qwen35moe expert-placement budgeti

Pure scoring: pooled_keys[c] = nullptr for chunks without pooled keys (their out[] entry is left at `missing_score`). Non-null entries hold n_layers *

Create a small temp file with known content; returns its path.

Like raxIteratorNextStep() but implements an iteration step moving * to the lexicographically previous element. The 'noup' option has a similar * ef

Allocate a new non compressed node with the specified number of children. * If datafield is true, the allocation is made large enough to hold the *

Helper: read layout_id from the first .dkv file found under base/.