Don’t forget that the main issue isn’t the initial data scrape but rather the fact that prompting an llm agent like claude code can amplify into 10 requests as it tries to answer your question.