Skip to main content
The homepageThe VergeThe Verge logo.
The homepageThe VergeThe Verge logo.

From ChatGPT to Gemini: how AI is rewriting the internet

See all Stories

Posted
H
Hayden Field
Apple’s new research paper says AI reasoning isn’t all it’s cracked up to be.

Right before WWDC 2025, Apple researchers published a paper called The Illusion of Thinking (PDF) that made waves. The researchers wrote that popular and buzzy AI models “face a complete accuracy collapse beyond certain complexities,” especially with things they’ve never seen before.

They presented models from OpenAI, Anthropic, and DeepSeek with new and complex puzzle games and found their reasoning ability “increases with problem complexity up to a point, then declines.”

Recent generations of frontier language models have introduced Large Reasoning Models (LRMs) that generate detailed thinking processes before providing answers. While these models demonstrate improved performance on reasoning benchmarks, their fundamental capabilities, scaling properties, and limitations remain insufficiently understood. Current evaluations primarily focus on established mathematical and coding benchmarks, emphasizing final answer accuracy. However, this evaluation paradigm often suffers from data contamination and does not provide insights into the reasoning traces’ structure and quality. In this work, we systematically investigate these gaps with the help of controllable puzzle environments that allow precise manipulation of compositional complexity while maintaining consistent logical structures.
Image: Apple
Follow topics and authors from this story to see more like this in your personalized homepage feed and to receive email updates.

Most Popular

Most Popular
  1. Epic just won its Google lawsuit again, and Android may never be the same
  2. Nintendo Switch prices are going up after this weekend
  3. Google’s Pixel Tablet is $190 off for a limited time
  4. Google has just two weeks to begin cracking open Android, it admits in emergency filing
  5. Samsung TVs are coming back online after apps stopped working

More in AI

Anthropic studied what gives an AI system its ‘personality’ — and what makes it ‘evil’Anthropic studied what gives an AI system its ‘personality’ — and what makes it ‘evil’
Bing made Google dance and then stole some search trafficBing made Google dance and then stole some search traffic
Tim Cook says Apple is ‘open to’ AI acquisitionsTim Cook says Apple is ‘open to’ AI acquisitions
Microsoft becomes the second $4 trillion companyMicrosoft becomes the second $4 trillion company
Why AI researchers are getting paid like NBA All-StarsWhy AI researchers are getting paid like NBA All-Stars
Oakley Meta HSTN Limited Edition review: a polarizing choiceOakley Meta HSTN Limited Edition review: a polarizing choice

Top Stories