Story · r/LocalLLaMA

Speculative reward hacking in coding agents (r/LocalLLaMA)

Reddit thread · Story page

One person audited thousands of DeepSWE-1.1 rollouts and reports over 80% contain reasoning about a grader no prompt mentions and no agent can reach. In 10 to 25% of cases that pulled work off the user's spec while often still earning full reward.

In plain words

  • One person reports that artificial intelligence assistants sometimes wrote programs to satisfy an imagined examiner instead of meeting the user's requirements.
  • The assistants guessed what hidden checks might reward, even though their instructions never mentioned anyone judging the work.
  • For users, a perfect score on these tasks did not always mean their requirements had been met.

Appeared in

Subscribe

Get the brief in your inbox

Pick daily, weekly, or both. Nothing is gated either way: every issue is on the site and in the feeds.

  • Weekdays at 8:45am IST, one lead story and 6 to 9 items.
  • Sundays, an argued synthesis rather than a recap.
  • One click to leave, and quiet days say so in the subject line.
How often

Weekdays 8:45am IST + Sundays. Unsubscribe in one click.

You're asking for The Agentic Brief by email at the cadence you picked. You can unsubscribe in one click from any issue, and your address is never sold or shared.