top | item 45154367

(no title)

realz | 5 months ago

If developers and enterprises can host their own OSS/fine-tuned models, why will they pay Anthropic or OpenAI?

discuss

order

simonw|5 months ago

Because hosting a really GOOD model requires hardware that costs tens of thousands of dollars.

It's much cheaper to timeshare that hardware with other users than to buy and run it yourself.

realz|5 months ago

That may be true for independent devs or startups. Larger companies have enough demand to justify a few A/H100s.