接受模型的字符串输入，判断是否正确
(response, ground_truth)
| 89 | return response.strip("\n").replace(" ","") |
| 90 | |
| 91 | async def verify(response, ground_truth): |
| 92 | """ |
| 93 | 接受模型的字符串输入，判断是否正确 |
| 94 | """ |
| 95 | if response == ground_truth: |
| 96 | return 1 |
| 97 | else: |
| 98 | return 0 |
| 99 | |
| 100 | async def process_item_async(item, client, model_name, semaphore): |
| 101 | async with semaphore: |
no outgoing calls
no test coverage detected