MCPcopy Create free account
hub / github.com/abetlen/llama-cpp-python / reclaim_order

Method reclaim_order

examples/server/server.py:12620–12624  ·  view source on GitHub ↗
(self, best_free: Optional[int])

Source from the content-addressed store, hash-verified

12618 self.scheduler = scheduler
12619
12620 def reclaim_order(self, best_free: Optional[int]) -> List[int]:
12621 reclaim_order = [seq_id for seq_id in self.scheduler.free_sequences if seq_id != best_free]
12622 if best_free is not None:
12623 reclaim_order.append(best_free)
12624 return reclaim_order
12625
12626 @staticmethod
12627 def generation_kv_for_request(

Callers 3

can_admitMethod · 0.80
can_admitMethod · 0.80
can_admitMethod · 0.80

Calls 1

appendMethod · 0.80

Tested by

no test coverage detected