MCPcopy Create free account
hub / github.com/MLSysU/TD-Pipe / run_engine_loop

Method run_engine_loop

TD_Pipe/engine/async_llm_engine.py:354–361  ·  view source on GitHub ↗
(self)

Source from the content-addressed store, hash-verified

352 self.engine.abort_request(request_ids)
353
354 async def run_engine_loop(self):
355 # Initialize the RequestTracker here so it uses the right event loop.
356 has_requests_in_progress = False
357 while True:
358 if not has_requests_in_progress:
359 await self._request_tracker.wait_for_new_requests()
360 has_requests_in_progress = await self.engine_step()
361 await asyncio.sleep(0)
362
363 async def add_request(
364 self,

Callers 1

start_background_loopMethod · 0.95

Calls 2

engine_stepMethod · 0.95
wait_for_new_requestsMethod · 0.80

Tested by

no test coverage detected