It would be great if we could use our own openAI/claude accounts and pay a smaller subscription...this may be cool, but it's too expensive, I'd just like to play around...
It doesn’t even surprise me anymore that someone is charging a subscription fee to use an off the shelf LLM with scraped data from a public site. The gold rush can’t be over soon enough.
The problem is that you can't host a free LLM based service the way you can host a website, without being exposed to cost spikes the moment it becomes popular (or misused). Lots of smaller apps need a better cost pass-through mechanism; this is even more of a problem for hobbyists/non-profit projects than for commercial ones. We can't keep going with a free trial (costs eaten by developer) + subscription for every little thing.
Not scraped. HN itself publishes a live dataset to bigquery. The product is meant to connect to your own database but I thought this was fun to connect to hn
mathgeek|9 months ago
waldrews|9 months ago
vercantez|9 months ago
mentos|9 months ago