(set_cover_info: Dict[str, List[str]])
| 130 | |
| 131 | |
| 132 | def compute_avg_test(set_cover_info: Dict[str, List[str]]) -> float: |
| 133 | sum_tests = sum( |
| 134 | len(problems[task_id]["base_input"]) + len(set_cover_info[task_id]) |
| 135 | for task_id in task_ids |
| 136 | ) |
| 137 | return sum_tests / problem_count |
| 138 | |
| 139 | |
| 140 | def gen_report(set_cover_info: Dict[str, List[str]], sample_eval_dir: str, model: str): |
no outgoing calls
no test coverage detected
searching dependent graphs…