Function
inference_wrapper
(input, url, header, temperature, top_p, tool_string, wf, llm, demos, reformat, reformat_by, dependency_type, log_detail = False)
Source from the content-addressed store, hash-verified
| 137 | sem = asyncio.Semaphore(multiworker) |
| 138 | |
| 139 | async def inference_wrapper(input, url, header, temperature, top_p, tool_string, wf, llm, demos, reformat, reformat_by, dependency_type, log_detail = False): |
| 140 | async with sem: |
| 141 | await inference(input, url, header, temperature, top_p, tool_string, wf, llm, demos, reformat, reformat_by, dependency_type, log_detail) |
| 142 | |
| 143 | if len(inputs) == 0: |
| 144 | logger.info("All Completed!") |
Tested by
no test coverage detected