MCPcopy Create free account
hub / github.com/Tiiny-AI/PowerInfer / apply_adapter_cvec

Method apply_adapter_cvec

smallthinker/src/llama-context.cpp:643–652  ·  view source on GitHub ↗

Source from the content-addressed store, hash-verified

641}
642
643bool llama_context::apply_adapter_cvec(
644 const float * data,
645 size_t len,
646 int32_t n_embd,
647 int32_t il_start,
648 int32_t il_end) {
649 LLAMA_LOG_DEBUG("%s: il_start = %d, il_end = %d\n", __func__, il_start, il_end);
650
651 return cvec.apply(model, data, len, n_embd, il_start, il_end);
652}
653
654llm_graph_result_ptr llama_context::process_ubatch(const llama_ubatch & ubatch, llm_graph_type gtype, llama_memory_state_i * mstate, ggml_status & ret) {
655 if (mstate && !mstate->apply()) {

Callers 1

llama_apply_adapter_cvecFunction · 0.80

Calls 1

applyMethod · 0.45

Tested by

no test coverage detected