MCPcopy
hub / github.com/THUDM/LongWriter / vllm_inference.py

File vllm_inference.py

vllm_inference.py:None–None  ·  view source on GitHub ↗

Source from the content-addressed store, hash-verified

1from vllm import LLM, SamplingParams
2
3model = LLM(
4 model= "THUDM/LongWriter-glm4-9b",

Callers

nothing calls this directly

Calls 2

get_commandMethod · 0.80
build_chat_inputMethod · 0.80

Tested by

no test coverage detected