I agree. I think a lot of people here are assuming that the full HTML retrieved has to go into the LLM eating up tokens. But why wouldn't the agent try to clean up first and remove bloat and convert to markdown itself, before feeding into LLM. Semantic HTML would make that easier.
> But why wouldn't the agent try to clean up first and remove bloat and convert to markdown itself, before feeding into LLM.
There's no "agent". It's a few wrappers around API calls in a trenchcoat.