MCPcopy Create free account
hub / github.com/PaddlePaddle/FastDeploy / _make_llm

Function _make_llm

tests/entrypoints/test_llm.py:85–93  ·  view source on GitHub ↗
(engine)

Source from the content-addressed store, hash-verified

83
84
85def _make_llm(engine):
86 llm = LLM.__new__(LLM)
87 llm.llm_engine = engine
88 llm.default_sampling_params = SamplingParams(max_tokens=2)
89 llm.mutex = threading.Lock()
90 llm.req_output = {}
91 llm.master_node_ip = engine.cfg.master_ip
92 llm.chat_template = "template"
93 return llm
94
95
96def test_init_tool_parser_plugin(monkeypatch):

Calls 2

SamplingParamsClass · 0.90
__new__Method · 0.45

Tested by

no test coverage detected