>Reward hacking has been present in AI systems both historically (see this work from a decade ago , figure shown below)
I went to the page, and guess who it's by . . . Dario Amodei and Jack Clark!
>Reward hacking has been present in AI systems both historically (see this work from a decade ago , figure shown below)
I went to the page, and guess who it's by . . . Dario Amodei and Jack Clark!
That paper is kinda infamous! I last saw it mentioned only a few weeks ago, in https://arxiv.org/abs/2607.18966. Lots of folks will go "Oh that's the old Amodei and Clark paper" when the first few rows of pixels of that gif sail into view.