MCPcopy
hub / github.com/ModelTC/LightLLM / get

Method get

lightllm/common/quantization/registry.py:16–22  ·  view source on GitHub ↗
(self, key, *args, **kwargs)

Source from the content-addressed store, hash-verified

14 return decorator
15
16 def get(self, key, *args, **kwargs):
17 if key == "none":
18 return None
19 quant_method_class = self._quant_methods.get(key)
20 if not quant_method_class:
21 raise ValueError(f"QuantMethod '{key}' not supported.")
22 return quant_method_class()
23
24
25QUANTMETHODS = QuantMethodFactory()

Callers 15

init_distributed_envFunction · 0.45
_init_nccl_envFunction · 0.45
get_hidden_sizeFunction · 0.45
health_checkFunction · 0.45
PetrelHelperClass · 0.45
_iter_cpeh_linesMethod · 0.45
load_dataMethod · 0.45
load_pretrainMethod · 0.45
get_streamMethod · 0.45
get_per_kv_cache_sizeFunction · 0.45
log_utils.pyFile · 0.45

Calls

no outgoing calls

Tested by 15

simple_chatMethod · 0.36
stream_chatMethod · 0.36
completionsMethod · 0.36
stream_completionsMethod · 0.36
function_callMethod · 0.36
stream_function_callMethod · 0.36
completions_with_echoMethod · 0.36
completions_with_nMethod · 0.36