Yadnesh Salvi

Story · r/LocalLLaMA

DeepSeek V4 Flash 0731 hits 82.7% on Terminal-Bench 2.1 in an independent public-harness run (445 trials) (r/LocalLLaMA)

Reddit thread · Story page

An independent public-harness run matched DeepSeek's reported 82.7% Terminal-Bench 2.1 score for V4 Flash 0731 over 445 trials.

In plain words

  • A public test independently matched DeepSeek’s reported 82.7% score across 445 trials.
  • The tester used Ante, publicly downloadable software for running tests, because DeepSeek’s own testing setup was unavailable.
  • DeepSeek V4 Flash 0731 completed 368 of the 445 trials successfully, covering 89 tasks repeated five times.
  • The result suggests testing software can affect performance, which matters to people comparing these systems.

Appeared in

Subscribe

Get the brief in your inbox

Pick daily, weekly, or both. Nothing is gated either way: every issue is on the site and in the feeds.

  • Weekdays at 8:45am IST, one lead story and 6 to 9 items.
  • Sundays, an argued synthesis rather than a recap.
  • One click to leave, and quiet days say so in the subject line.
How often

Weekdays 8:45am IST + Sundays. Unsubscribe in one click.

You're asking for The Agentic Brief by email at the cadence you picked. You can unsubscribe in one click from any issue, and your address is never sold or shared.

Subscribe by RSS →