Price based on value. Pricing is hard, something as simple as per-token is alluring because it doesn’t require any thought but it’s leaving a lot of money on the table. There’s nothing unique about LLMs when it comes to pricing, all common pricing wisdom applies.
agotterer|1 year ago
How do you price based on value without a corollary to tokens? If you charged $40 for this service then maybe you don’t provide enough value for the casual user who does the occasional school report. On the other hand you may be unprofitable for the doctor that decides to dictate all of her interactions every day or the author who dictates an entire book.
samatman|1 year ago
A customer sees "word count", they understand what's going on perfectly, right away. Tokens? More than half of them will think "what, like, game tokens? do I have to buy them in advance?"
Generously, 10% of potential customers are going to have even an approximate idea of what a token means in this context, maybe 1% could tell you that words and tokens aren't quite the same thing.