Story · arXiv
WebFovea: When the Model Is Right but the Click Is Wrong: Reliable Round Trips for Vision-Based Web Agents on Live Websites (arXiv)
paper · Story page
WebFovea placed 2nd in the WebRetriever Challenge 2026 with 57.0 out of 100, then published where it lost the points. A coordinate-space mismatch landed every click at 3/4 of its intended position, dropdowns, iframes and text boxes failed silently, and many of those failures sat in the harness rather than in the model's reasoning.
In plain words
- Researchers found that software operating websites failed even when the artificial intelligence chose the right action.
- The software linking it to the browser measured positions differently, so every click landed in the wrong place.
- Some menu choices and attempts to enter text failed without reporting an error.
- For developers, these failures show why improving artificial intelligence alone may not make software that operates websites reliable.
Appeared in
- Branch steering breaks the Dual-LLM guarantee for computer-use agents
Oct 06, 2026 · in the sections
Subscribe
Get the brief in your inbox
Pick daily, weekly, or both. Nothing is gated either way: every issue is on the site and in the feeds.
- Weekdays at 8:45am IST, one lead story and 6 to 9 items.
- Sundays, an argued synthesis rather than a recap.
- One click to leave, and quiet days say so in the subject line.