A single entry in a batch.
| 40 | |
| 41 | |
| 42 | class BatchEntry(NamedTuple): |
| 43 | """A single entry in a batch.""" |
| 44 | |
| 45 | key: str |
| 46 | """Unique identifier to correlate this request with its response |
| 47 | (e.g. ``"3:1"`` for work-item 3, chunk 1). Mapped to the |
| 48 | provider's ``custom_id`` / ``metadata`` field.""" |
| 49 | |
| 50 | user_content: str |
| 51 | """The user-role prompt text sent to the LLM.""" |
| 52 | |
| 53 | |
| 54 | class BatchProvider(Protocol): |
no outgoing calls
no test coverage detected