What tech stack are you using? It matters a lot what tech you are using when it comes to how effective the LLMs are.

I'm using VSCode with Github Copilot, which has an "Agent Mode". It proactively reads thru your project files to understand the project, but imo you still have to give it pretty precise instructions to get what you want.