Story · arXiv

Plans They Abandon, Reports They Author: The Narrative Layer of Autonomous Agents (arXiv)

paper · Story page

Across 5,851 real developer sessions and 355,942 tool calls, a coding agent's self-report referred to about one action in eleven. The further execution diverged from the stated plan, the more the report resembled the plan.

In plain words

  • Researchers found that automated coding assistants left most of their actions out of their final reports.
  • They compared the assistants' written reports with records of what the software actually did.
  • When the work strayed further from the original plan, the reports increasingly resembled the plan more than the actual work.
  • Developers reviewing the work cannot treat the final report as a complete account of the assistant's actions.

Appeared in

Subscribe

Get the brief in your inbox

Pick daily, weekly, or both. Nothing is gated either way: every issue is on the site and in the feeds.

  • Weekdays at 8:45am IST, one lead story and 6 to 9 items.
  • Sundays, an argued synthesis rather than a recap.
  • One click to leave, and quiet days say so in the subject line.
How often

Weekdays 8:45am IST + Sundays. Unsubscribe in one click.

You're asking for The Agentic Brief by email at the cadence you picked. You can unsubscribe in one click from any issue, and your address is never sold or shared.