Yes, I was assuming they'd use external tools. Using only the raw LLM doesn't sound like a good strategy.

Considering that agents are not a new concept, why isn't this a solved problem by now?

Agents are a very new concept.

We've got the early LLM-based AI agents in 2023, and it only became a popular, mainstream thing in 2025 - with Claude Code.