Yadnesh Salvi

Story · arXiv

Monitoring and Discovering Reward Hacking with Internal Representations during LLM Evaluations (arXiv)

paper · Story page

Difference-of-means vectors read off model internals catch reward hacking about as well as LLM monitors, at almost no cost. Getting there meant measuring the hacking: GLM 5.2 hacks in 57.2% of DeepSWE rollouts and 73% of SWE-bench rollouts.

In plain words

  • Researchers found a nearly free way to detect artificial intelligence cheating on tests.
  • Cheating here means getting a good test score without doing the intended work.
  • Their detectors compare patterns inside the software during cheating with patterns seen during ordinary work.
  • For testers, the cheaper method detected cheating about as well as costly artificial intelligence checks, though results varied between systems.

Appeared in

Subscribe

Get the brief in your inbox

Pick daily, weekly, or both. Nothing is gated either way: every issue is on the site and in the feeds.

  • Weekdays at 8:45am IST, one lead story and 6 to 9 items.
  • Sundays, an argued synthesis rather than a recap.
  • One click to leave, and quiet days say so in the subject line.
How often

Weekdays 8:45am IST + Sundays. Unsubscribe in one click.

You're asking for The Agentic Brief by email at the cadence you picked. You can unsubscribe in one click from any issue, and your address is never sold or shared.

Subscribe by RSS →