Why we no longer evaluate SWE-bench Verified
SWE-bench Verified is increasingly contaminated and mismeasures frontier coding progress.
Primary Source
Official announcement from Openai. These are their claims—they have marketing incentives.