I went exactly through the same process. And that's why I developed agent-squad: https://github.com/gzurl/agent-squad

My conclusion was I had to elevate myself and make sure another agent reviews and tests the code (QA) under the supervision of a third agent (CTO) that defends my vision.