MCPcopy
hub / github.com/NVIDIA/TensorRT-LLM / stream_results

Method stream_results

examples/apps/fastapi_server.py:74–76  ·  view source on GitHub ↗
()

Source from the content-addressed store, hash-verified

72 sampling_params=sampling_params)
73
74 async def stream_results() -> AsyncGenerator[bytes, None]:
75 async for output in promise:
76 yield output.outputs[0].text_diff.encode("utf-8")
77
78 if streaming:
79 return StreamingResponse(stream_results())

Callers

nothing calls this directly

Calls 1

encodeMethod · 0.45

Tested by

no test coverage detected