MCPcopy Create free account
hub / github.com/abetlen/llama-cpp-python / set_llama_proxy

Function set_llama_proxy

llama_cpp/server/app.py:68–70  ·  view source on GitHub ↗
(model_settings: List[ModelSettings])

Source from the content-addressed store, hash-verified

66
67
68def set_llama_proxy(model_settings: List[ModelSettings]):
69 global _llama_proxy
70 _llama_proxy = LlamaProxy(models=model_settings)
71
72
73async def get_llama_proxy():

Callers 1

create_appFunction · 0.85

Calls 1

LlamaProxyClass · 0.90

Tested by

no test coverage detected

Used in the wild real call sites across dependent graphs

searching dependent graphs…