Sounds good! its just I used up most of my API key limits in development, and I'm keeping some so I can run improvement pipelines or fix errors, so il batch the YC companies day by day, there's 5000 companies, so il do about 800 each day for 5-6 days.
Wait, why would you use (tokens?) on a routine scrape job? Just make a generic parser (vibe-coded or by hand, I don’t think it'll be that hard), then run it across the company list.
Or are you talking about some other API?
no scraping the yc startups is easy, I've already done that, its just writing and researching the actual profiles uses an internal tool (built into the website,I can trigger it from an admin dashboard) which uses tokens.
Create placeholder pages and backfill any extended LLM generated stuff. Either after first request of a page or simply queued.