Why? The vast majority of software doesn't need to be written by AI and moves at the speed of the humans making the decisions, not the speed of writing the code.

They make a shit ton of money because of this. If you're working at a place where the code matters more than the decisions that went into it, you're basically working at a sweatshop for people who are desperate for a win and will throw away you and all your code once the MVP stage is over, and that's the only way this "works".

Generative probabilistic AI is not equivalent to a compiler and never will be until we can do this kind of thing completely deterministically. No matter how much you reduce the error in the "model", it's still more error than the error rate of the logic gates. It's completely futile considering the sheer depth of indirection at play, and that indirection is the whole point of software.