Why we no longer evaluate SWE-bench Verified
核心要点速览
SWE-bench Verified is increasingly contaminated and mismeasures frontier coding progress. Our analysis shows flawed tests and training leakage. We recommend SWE-bench Pro.
查看完整报道与分享
完整图文、背景资料与讨论归原始发布平台 OpenAI News 所有。