MCPcopy Index your code
hub / github.com/ModelTC/LightLLM / timer_log

Function timer_log

lightllm/server/httpserver/pd_loop.py:20–25  ·  view source on GitHub ↗
(manager: HttpServerManager)

Source from the content-addressed store, hash-verified

18
19
20async def timer_log(manager: HttpServerManager):
21 while True:
22 await asyncio.sleep(30)
23 manager.first_time_costs.print_log("mean first cost")
24 manager.per_token_costs.print_log("mean per token cost")
25 return
26
27
28async def pd_handle_loop(manager: HttpServerManager):

Callers 1

pd_handle_loopFunction · 0.85

Calls 1

print_logMethod · 0.80

Tested by

no test coverage detected