MCPcopy
hub / github.com/ModelTC/LightLLM / abort

Method abort

lightllm/server/httpserver/manager.py:606–616  ·  view source on GitHub ↗
(self, group_req_id: int)

Source from the content-addressed store, hash-verified

604 return
605
606 async def abort(self, group_req_id: int):
607 req_status: ReqStatus = self.req_id_to_out_inf.get(group_req_id, None)
608 if req_status is None:
609 logger.warning(f"aborted group_request_id {group_req_id} not exist")
610 return
611
612 group_req_objs: GroupReqObjs = req_status.group_req_objs
613 for req in group_req_objs.shm_req_objs:
614 req.is_aborted = True
615 logger.warning(f"aborted group_request_id {group_req_objs.group_req_id}")
616 return
617
618 async def recycle_resource_loop(self):
619 pre_time_mark = time.time()

Callers 3

generateMethod · 0.95
_pd_handle_taskFunction · 0.45

Calls 1

getMethod · 0.45

Tested by

no test coverage detected