file.py -> /Users/home/mihail/modern-software-dev-lectures/file.py

file.py -> /Users/home/mihail/modern-software-dev-lectures/file.py

Extract the last fenced Python code block, or any fenced code block, else return text.

Extract the final 'Answer: ...' line from a verbose reasoning trace. - Finds the LAST line that starts with 'Answer:' (case-insensitive) - No

Extract the final 'Answer: ...' line from a verbose reasoning trace. - Finds the LAST line that starts with 'Answer:' (case-insensitive) - No

Parse a single JSON object from the model output.

Return list of (tool_name, args) requested in 'tool: name({...})' lines. The parser expects single-line, compact JSON in parentheses.

Tool: Return a newline-delimited list of "name: return_type" for each top-level function.

Run once: require the model to produce a valid tool call; compare tool output to expected.

Run the prompt NUM_RUNS_TIMES, majority-vote on the extracted 'Answer: ...' lines. Prints "SUCCESS" if the majority answer equals EXPECTED_OUTPUT

Run up to NUM_RUNS_TIMES and return True if any output matches EXPECTED_OUTPUT. Prints "SUCCESS" when a match is found.

Run the prompt up to NUM_RUNS_TIMES and return True if any output matches EXPECTED_OUTPUT. Prints "SUCCESS" when a match is found.

Run up to NUM_RUNS_TIMES and return True if any output matches EXPECTED_OUTPUT.

TODO: Select and return the relevant subset of documents from CORPUS for this task. For example, return [] to simulate missing context, or [corpu

Replaces first occurrence of old_str with new_str in file. If old_str is empty, create/overwrite file with new_str. :param path: The path

Replaces first occurrence of old_str with new_str in file. If old_str is empty, creates/overwrites file with new_str. :param path: The path t