Surely "how to draw a SVG pelican on a bike" has made it into the training data by now ...
If that was the case in a non-trivial way you'd see mode collapse, but you don't, they come out differently.
It's because all the frequent comment that this pelican is in the trainings set now also got into the trainings set and models adapt. /joking (I hope)
Surely this comment is literally on every new model release post.
It's part of the pelican tradition at this point.
I eagerly await the models replying with that: "I'd be happy to create a pelican riding a bicycle, but just a note that this might already be in my training data. Simon."
Someone told me that a model said "oh, the classic" when they asked for this recently. I think that was Opus 4.8.
And yet... only one is any good.
If that was the case in a non-trivial way you'd see mode collapse, but you don't, they come out differently.
It's because all the frequent comment that this pelican is in the trainings set now also got into the trainings set and models adapt. /joking (I hope)
Surely this comment is literally on every new model release post.
It's part of the pelican tradition at this point.
I eagerly await the models replying with that: "I'd be happy to create a pelican riding a bicycle, but just a note that this might already be in my training data. Simon."
Someone told me that a model said "oh, the classic" when they asked for this recently. I think that was Opus 4.8.
And yet... only one is any good.