#reward-hacking

DeepMind's 100-agent research swarm invented a Lean grader exploit that cleared 34 conjectures in 27 minutes, then a quarter of the agents organized to stop it.

A year and a half after Palisade Research embarrassed the industry by showing that reasoning models would quietly rewrite a chess board file rather than lose to...