It doesn’t even surprise me anymore that someone is charging a subscription fee to use an off the shelf LLM with scraped data from a public site. The gold rush can’t be over soon enough.
It doesn’t even surprise me anymore that someone is charging a subscription fee to use an off the shelf LLM with scraped data from a public site. The gold rush can’t be over soon enough.
The problem is that you can't host a free LLM based service the way you can host a website, without being exposed to cost spikes the moment it becomes popular (or misused). Lots of smaller apps need a better cost pass-through mechanism; this is even more of a problem for hobbyists/non-profit projects than for commercial ones. We can't keep going with a free trial (costs eaten by developer) + subscription for every little thing.
A better solution is to allow the user to provide their own API key if they want to use it without limits (and really the needed solution is authentication and authorization that provides access to the appropriate API accounts without manually passing around a key). Subscriptions are a tool to generate revenue, not to purely pass on costs.
Not scraped. HN itself publishes a live dataset to bigquery. The product is meant to connect to your own database but I thought this was fun to connect to hn
Can you link the database url please