MCPcopy Index your code
hub / github.com/ModelTC/LightLLM / generate

Function generate

lightllm/server/api_http.py:184–192  ·  view source on GitHub ↗
(request: Request)

Source from the content-addressed store, hash-verified

182
183@app.post("/generate")
184async def generate(request: Request) -> Response:
185 try:
186 return await g_objs.g_generate_func(request, g_objs.httpserver_manager)
187 except ServerBusyError as e:
188 logger.error("%s", str(e), exc_info=True)
189 return create_error_response(HTTPStatus.SERVICE_UNAVAILABLE, str(e))
190 except Exception as e:
191 logger.error("An error occurred: %s", str(e), exc_info=True)
192 return create_error_response(HTTPStatus.EXPECTATION_FAILED, str(e))
193
194
195@app.post("/generate_stream")

Callers 1

compat_generateFunction · 0.85

Calls 1

create_error_responseFunction · 0.70

Tested by

no test coverage detected