They're struggling, it seems; AI can generate anything, but that includes stuff that goes against laws and morals, so they spend a lot of time to lock it down to avoid that, but people's creativity with prompts and escaping the safeguards knows no bounds. It's basically like the fight against spam, an endless game of whack-a-mole where usefulness fights with decency.
Anything that is vaguely present in their training data (see, a wine glass filled to the brim [1][2]), that is.
https://medium.com/@joe.richardson.iii/the-curious-case-of-t... https://medium.com/@joe.richardson.iii/openai-slaps-a-band-a...