MCPcopy Create free account
hub / github.com/abetlen/llama-cpp-python / collect_completion_result

Function collect_completion_result

examples/server/server.py:15770–15788  ·  view source on GitHub ↗
(
        formatter: OpenAIFormatter,
        http_request: Request,
        stream: CompletionStream,
        cancel: Callable[[], None],
    )

Source from the content-addressed store, hash-verified

15768 return HTTPException(status_code=400, detail=str(exc))
15769
15770 async def collect_completion_result(
15771 formatter: OpenAIFormatter,
15772 http_request: Request,
15773 stream: CompletionStream,
15774 cancel: Callable[[], None],
15775 ) -> OpenAICompletion | Response:
15776 disconnect_task = asyncio.create_task(
15777 watch_http_disconnect(http_request, cancel)
15778 )
15779 try:
15780 return await asyncio.to_thread(formatter.collect_completion, stream)
15781 except asyncio.CancelledError:
15782 cancel()
15783 raise
15784 except BaseException as exc:
15785 return await disconnected_cancelled_response_or_raise(http_request, exc)
15786 finally:
15787 disconnect_task.cancel()
15788 stream.close()
15789
15790 async def collect_completion_results(
15791 formatter: OpenAIFormatter,

Callers 3

create_completionFunction · 0.85
create_chat_completionFunction · 0.85
create_responseFunction · 0.85

Calls 4

watch_http_disconnectFunction · 0.85
cancelMethod · 0.45
closeMethod · 0.45

Tested by

no test coverage detected

Used in the wild real call sites across dependent graphs

searching dependent graphs…