If revenue doesn't catch up with the cost of developing and running these huge LLMs then the only way to avoid an AI winter is to find a way to make them way cheaper to develop.
I keep seeing everyone guessing what the margin is on inference. You say that it's largely break even. We have this person in the thread claim 80% margin (https://news.ycombinator.com/item?id=45462442).
infecto|4 months ago
You could turn off the switch today though and most of your leading models could keep the lights on.
algorithmmonkey|4 months ago
These numbers are complete make believe.