File pick_batch.py

eval/pick_batch.py:None–None · view source on GitHub ↗

Source from the content-addressed store, hash-verified

1	"""Pick the next batch of unseen SWE-bench instances for a cumulative eval run.
2
3	Given a dataset and a predictions file, emit the next N instance IDs that
4	haven't been predicted yet. Two picking modes:

nothing calls this directly

mainFunction · 0.70

exitMethod · 0.45

no test coverage detected