Story · arXiv (via papers.cool)

CURA: Certified Runtime Alarms for Computer-Use Agents (arXiv (via papers.cool))

paper · Story page

On 361 OSWorld tasks, a capable computer-use pipeline ended 90% of its failures with a success claim. CURA, an external monitor reading only harness-visible telemetry, catches 42.3% of failures a median of 31 steps before termination, with certified false-alarm control.

In plain words

  • Researchers built a separate warning system after finding that failed computer tasks often ended with false success claims.
  • It watches information about ongoing actions without changing instructions or asking the main system additional questions.
  • It detected 42.3% of failures a median of 31 steps before the run ended.
  • Its testing method sets a mathematically guaranteed limit on false warnings.
  • People overseeing computer-controlling systems can receive earlier warnings without trusting the system's own final report.

Appeared in

Subscribe

Get the brief in your inbox

Pick daily, weekly, or both. Nothing is gated either way: every issue is on the site and in the feeds.

  • Weekdays at 8:45am IST, one lead story and 6 to 9 items.
  • Sundays, an argued synthesis rather than a recap.
  • One click to leave, and quiet days say so in the subject line.
How often

Weekdays 8:45am IST + Sundays. Unsubscribe in one click.

You're asking for The Agentic Brief by email at the cadence you picked. You can unsubscribe in one click from any issue, and your address is never sold or shared.