MCPcopy Create free account
hub / github.com/evilsocket/cake / load_var_builder

Method load_var_builder

cake-core/src/utils/mod.rs:67–75  ·  view source on GitHub ↗
(
        &self,
        filenames: &[PathBuf],
        dtype: DType,
        device: &Device,
    )

Source from the content-addressed store, hash-verified

65 }
66
67 unsafe fn load_var_builder<'a>(
68 &self,
69 filenames: &[PathBuf],
70 dtype: DType,
71 device: &Device,
72 ) -> Result<VarBuilder<'a>> {
73 VarBuilder::from_mmaped_safetensors(filenames, dtype, device)
74 .map_err(|e| anyhow!("can't create varbuilder: {e:?}"))
75 }
76}
77
78/// FP8 block-wise quantization — wraps `fp8::load_fp8_var_builder`.

Calls 2

load_fp8_var_builderFunction · 0.85
load_gptq_var_builderFunction · 0.85

Tested by

no test coverage detected