(no title)
Drakim
|
13 days ago
That is simply not true, token price is largely determined by the token price of their rival services (even before their own operational costs). If everybody else charges about $1 per millions of tokens, then they will also charge about $1 per millions of tokens (or slightly above/below) regardless of how many answers per token they can provide.
YetAnotherNick|12 days ago
Gemini increased the same Flash's price by something like 5x IIRC when it got better.
shafyy|12 days ago
sixtyj|12 days ago
Now companies are fighting for the attention of a finite number of customers, so they keep their prices in line with those around them.
I remember when Google started with PPC - because few companies were using it, it cost a fraction of recent prices.
And the other issue to solve is future lack of electricity for land data centers. If everyone wants to use LLM… but data centers capacity is finite due to available power -> token prices can go up. But IMHO devs will find an innovative approach for tokens, less energy demanding… so token prices will probably stay low.
Aerroon|12 days ago