YUP! This is why I've settled on Aider and it's "IDE integration" (watches all files for comments that end in "AI!", which then invokes the AI). I can then use it with whatever editor I prefer. I view the vscode mono-culture as a bad thing. I also like I can use any AI backend I like, which is really how it should be: Vendor lock-in tools are bad, remember?

I guess you lose tab-completion suggestions, but I am not a fan of those compared to 'normal' tab-complete (if backed by an lang server). If I want AI, I'll write a short comment and invoke the tool explicitly.

EDIT: Of course, it really depends an your usecase. I maintain/upgrade C code libs and utils; I really cannot speak to what works best for your env! Webdev is truly a different world.

EDIT2: Can't leave this alone for some reason, the backend thing is a big deal. Switching between Claude/Gemini/Deekseek and even rando models like Qwen or Kimi is awesome, they can fill in each other's holes or unblock a model which is 'stuck'.