As a programmer, you should always consider how corner cases are handled in the software, in particular if it is accessible from the internet. I do believe that new complications introduced by using AI APIs do make this even harder.
Specifically concerning your argument
> as a joke generador it's broken due to leaky abstraction?
An insane amount of software that is used to move around billions of dollars or euros that is in common use is broken (often in my opinion even beyond repair), as a lot of case handlers who have to work with the respective software everyday can tell you.
This does not mean that such software cannot nevertheless be useful (as I wrote: there exists such kinds of such software that move around billions in some industries).