Exactly. There's no benefit to using LLMs as they exist today, because it winds up being the same amount of work (if not more!) to ensure that they are giving you code which actually works. That isn't a useful tool.