Skip to main content
institutional access

You are connecting from
Lake Geneva Public Library,
please login or register to take advantage of your institution's Ground News Plan.

Published loading...Updated

OpenAI Reports that "Approximately 30% of SWE-Bench Pro Is Broken," Highlighting Numerous Flaws in the Benchmark Used to Measure AI Coding Capabilities.

Summary by GIGAZINE
On July 8, 2026, OpenAI reported that a detailed investigation of its AI coding capability benchmark, "SWE-Bench Pro," revealed that approximately 30% of the tasks had problems that prevented them from being evaluated properly. Read more...
DisclaimerThis story is only covered by news sources that have yet to be evaluated by the independent media monitoring agencies we use to assess the quality and reliability of news outlets on our platform. Learn more here.

1 Articles

On July 8, 2026, OpenAI reported that a detailed investigation of its AI coding capability benchmark, "SWE-Bench Pro," revealed that approximately 30% of the tasks had problems that prevented them from being evaluated properly. Read more...

Read Full Article
Think freely.Subscribe and get full access to Ground NewsSubscriptions start at $9.99/yearSubscribe

Bias Distribution

  • There is no tracked Bias information for the sources covering this story.

Factuality Info Icon

To view factuality data please Upgrade to Premium

Ownership

Info Icon

To view ownership data please Upgrade to Vantage

GIGAZINE broke the news on Thursday, July 9, 2026.
Too Big Arrow Icon
Sources are mostly out of (0)
News
Feed Dots Icon
For You
Search Icon
Search
Blindspot LogoBlindspotLocal