MCPcopy
hub / github.com/mudler/LocalAI / run

Method run

backend/python/vllm/test.py:320–321  ·  view source on GitHub ↗
()

Source from the content-addressed store, hash-verified

318 def _collect(servicer, req):
319 import asyncio
320 async def run():
321 return [r async for r in servicer._predict(req, None, streaming=True)]
322 return asyncio.run(run())
323
324 def _new_servicer(self):

Callers 15

backend.pyFile · 0.45
embedMethod · 0.45
backend.pyFile · 0.45
backend.pyFile · 0.45
backend.pyFile · 0.45
backend.pyFile · 0.45
_collectMethod · 0.45
backend.pyFile · 0.45

Calls 1

_predictMethod · 0.45

Tested by

no test coverage detected