For me the LLMs are failing laughably to be able to generate some examples of any actively developing library, even for simple stuff. They invent non-existing APIs, use years old functions that are long deprecated, et cetera.