MCPcopy Create free account
hub / github.com/abetlen/llama-cpp-python / admit_request

Method admit_request

examples/server/server.py:13532–13535  ·  view source on GitHub ↗
(self, request: CompletionRequest)

Source from the content-addressed store, hash-verified

13530 return self.memory_policy.can_admit(request)
13531
13532 def admit_request(self, request: CompletionRequest) -> None:
13533 self.memory_policy.admit_request(request)
13534 if request.admitted:
13535 self.metrics.requests_admitted_total += 1
13536
13537 def build_batch(self) -> List[CompletionScheduler.BatchItem]:
13538 prompt_requests = [

Callers 1

admit_waitingMethod · 0.95

Calls 1

admit_requestMethod · 0.45

Tested by

no test coverage detected