Extract MCQ letter answer(s) from response using ChemBench's regex. Handles formats like [ANSWER]A[/ANSWER], [ANSWER]A, B[/ANSWER], [ANSWER]C. some text[/ANSWER] (ignores text after the letter). Returns: List of uppercase letter strings, e.g. ["A"] or ["A", "B"]. Empty
(response: str)
| 33 | |
| 34 | |
| 35 | def extract_mcq_answer(response: str) -> list[str]: |
| 36 | """Extract MCQ letter answer(s) from response using ChemBench's regex. |
| 37 | |
| 38 | Handles formats like [ANSWER]A[/ANSWER], [ANSWER]A, B[/ANSWER], |
| 39 | [ANSWER]C. some text[/ANSWER] (ignores text after the letter). |
| 40 | |
| 41 | Returns: |
| 42 | List of uppercase letter strings, e.g. ["A"] or ["A", "B"]. |
| 43 | Empty list if no match. |
| 44 | """ |
| 45 | match = _MCQ_REGEX.search(response) |
| 46 | if match: |
| 47 | letters_str = match.group(1) |
| 48 | return [l.strip() for l in letters_str.split(",")] |
| 49 | return [] |
| 50 | |
| 51 | |
| 52 | def score_answer( |