Skip to content

Research

466 articles found

No Evidence of 'Pelicanmaxxing': AI Labs Not Secretly Optimizing for Famous SVG Benchmark, Study Finds

No Evidence of 'Pelicanmaxxing': AI Labs Not Secretly Optimizing for Famous SVG Benchmark, Study Finds

Jul 23, 2026
Dylan Castillo

A new study testing 1,008 AI-generated SVGs across 48 animal-vehicle combinations finds no evidence that AI labs are secretly 'pelicanmaxxing' — gaming Simon Willison's famous pelican-on-a-bicycle SVG benchmark — with pelicans ranking 6th out of 8 animals in drawing quality, suggesting broad SVG optimization rather than targeted benchmark manipulation.

Researcher Slashes AI Agent Usage by 45% After Burning Through Claude's Token Limit in 30 Minutes

Researcher Slashes AI Agent Usage by 45% After Burning Through Claude's Token Limit in 30 Minutes

Jul 20, 2026
Quesma

A researcher burns through his entire Claude Max token limit in just 30 minutes after launching 111 AI agents, then redesigns his pipeline by assigning cheaper models to basic tasks, reserving frontier models for planning only, and enforcing strict verification rules — cutting agent usage by 45% and extending research runtime from 30 minutes to several hours.

Google Cloud Exposes Fatal Flaws in AI Benchmarks: A Single Word Change Can Crash Agent Performance to Zero

Google Cloud Exposes Fatal Flaws in AI Benchmarks: A Single Word Change Can Crash Agent Performance to Zero

Jul 13, 2026
Google Cloud Blog

Google Cloud's new Discovery Bench framework exposes alarming flaws in AI benchmarking, revealing that a single vague word can crash an agent's performance score from perfect to zero, while also uncovering broken ground truth and mislabeled data in widely trusted benchmarks — raising urgent questions about whether the AI industry has been measuring intelligence correctly all along.

Research Agents
Previous
Page 10 of 47
Next
Showing 91 - 100 of 466 articles