You should consider using something like Exa or Firecrawl.