MCPcopy Index your code
hub / github.com/abetlen/llama-cpp-python / finalize_cancelled

Method finalize_cancelled

examples/server/server.py:15449–15460  ·  view source on GitHub ↗
(self)

Source from the content-addressed store, hash-verified

15447 return "\n".join(lines)
15448
15449 def finalize_cancelled(self) -> bool:
15450 finalized = False
15451 for request in list(self.pending_requests):
15452 if request.cancelled:
15453 self.fail_request(request, CompletionRequestCancelledError("request cancelled"))
15454 finalized = True
15455 for request_id in list(self.active_request_ids):
15456 request = self.requests[request_id]
15457 if request.cancelled:
15458 self.fail_request(request, CompletionRequestCancelledError("request cancelled"))
15459 finalized = True
15460 return finalized
15461
15462
15463class CompletionService:

Callers 1

stepMethod · 0.95

Calls 2

fail_requestMethod · 0.95

Tested by

no test coverage detected