Story · arXiv

Evaluating AGENTS.md: Are Repository-Level Context Files Helpful for Coding Agents? (arXiv)

paper · Story page

On SWE-bench tasks and on issues from repositories that ship their own context files, providing one generally didn't raise task success and added over 20% to inference cost. Instructions got followed; the repository overviews providers recommend didn't help.

In plain words

  • Researchers found that extra written guidance generally did not help artificial intelligence tools write or fix computer programs more successfully.
  • These tools read files inside a software project for instructions about how to work on it.
  • They followed the instructions, but descriptions of how the project was organized did not help.
  • For software teams, these files made the tools over 20% more expensive to run on average in the study.

Appeared in

Subscribe

Get the brief in your inbox

Pick daily, weekly, or both. Nothing is gated either way: every issue is on the site and in the feeds.

  • Weekdays at 8:45am IST, one lead story and 6 to 9 items.
  • Sundays, an argued synthesis rather than a recap.
  • One click to leave, and quiet days say so in the subject line.
How often

Weekdays 8:45am IST + Sundays. Unsubscribe in one click.

You're asking for The Agentic Brief by email at the cadence you picked. You can unsubscribe in one click from any issue, and your address is never sold or shared.