MCPcopy Create free account
hub / github.com/evilsocket/cake / estimate_layer_vram

Method estimate_layer_vram

cake-core/src/utils/mod.rs:96–99  ·  view source on GitHub ↗
(&self, on_disk_bytes: u64, dtype_bytes: u64)

Source from the content-addressed store, hash-verified

94 }
95
96 fn estimate_layer_vram(&self, on_disk_bytes: u64, dtype_bytes: u64) -> u64 {
97 // FP8 is 1 byte per element on disk, expands to dtype_bytes in memory
98 on_disk_bytes * dtype_bytes
99 }
100}
101
102/// GPTQ 4-bit quantization — wraps `gptq::load_gptq_var_builder`.

Callers 1

master_setupFunction · 0.45

Calls

no outgoing calls

Tested by

no test coverage detected