MCPcopy Create free account
hub / github.com/Tiiny-AI/PowerInfer / load_gpu_split_from_split_file

Function load_gpu_split_from_split_file

llama.cpp:3082–3086  ·  view source on GitHub ↗

Source from the content-addressed store, hash-verified

3080};
3081
3082static bool load_gpu_split_from_split_file(llama_model & model, std::string split_path, size_t vram_budget) {
3083 llama_gpu_split_loader loader(split_path, true);
3084 return loader.check_vram_allocable(vram_budget)
3085 && loader.load_gpu_idx_for_model(&model) == 0;
3086}
3087
3088static bool llm_load_gpu_split_with_budget(llama_model_loader & ml, llama_model & model, size_t vram_allocatable_bytes, bool no_cache) {
3089 std::string cached_split_path = ml.file.fname + ".generated.gpuidx";

Callers 1

llama.cppFile · 0.85

Calls 2

check_vram_allocableMethod · 0.80

Tested by

no test coverage detected