"Frog put the cookies in a box."
To finish your excellent analogy, adapted for today:
And Frog didn’t even bother to tie up the box or put it on a high shelf! The moment Frog’s back was turned, Toad opened the box and ate the cookies. Frog feigned surprise.
Wow obscure reference, the cookies are the AI in this? OpenAI and anthropic are Frog and Toad?
The cookies are the reward
Frog is OpenAI staff
Toad is the rogue agent
you can find the full story with a search for “frog and toad cookies story pdf”
To finish your excellent analogy, adapted for today:
And Frog didn’t even bother to tie up the box or put it on a high shelf! The moment Frog’s back was turned, Toad opened the box and ate the cookies. Frog feigned surprise.
Wow obscure reference, the cookies are the AI in this? OpenAI and anthropic are Frog and Toad?
The cookies are the reward
Frog is OpenAI staff
Toad is the rogue agent
you can find the full story with a search for “frog and toad cookies story pdf”