MCPcopy Create free account
hub / github.com/Tiiny-AI/PowerInfer / reserve

Method reserve

llama.cpp:3040–3042  ·  view source on GitHub ↗

Source from the content-addressed store, hash-verified

3038 }
3039
3040 bool reserve(size_t tensor_bytes) {
3041 return llama_reduce_vram_budget(tensor_bytes);
3042 }
3043
3044 // For GPU tensors, we need to allocate them in VRAM as much as possible,
3045 // and update the tensor data in-place. If the VRAM budget is exceeded,

Callers 15

ggml_cl_h2d_tensor_2dFunction · 0.80
bpe_gpt2_preprocessMethod · 0.80
llama_sample_tokenFunction · 0.80
top_kMethod · 0.80
get_viewMethod · 0.80
cloneMethod · 0.80
string_replace_allFunction · 0.80
preprocess_audioFunction · 0.80

Calls 1

llama_reduce_vram_budgetFunction · 0.85

Tested by 15

TESTFunction · 0.64
TESTFunction · 0.64
StringStreamToStringFunction · 0.64
UrlEncodeMethod · 0.64
InitMethod · 0.64
UnitTestFilterMethod · 0.64
StringStreamToStringFunction · 0.64
UrlEncodeMethod · 0.64
CreateArgvFromArgsFunction · 0.64
mainFunction · 0.64