[bigwavedave]

> well 0.02 cents for 1000 tokens for davinci is already high I am not sure how affordable the new model may be

Is it? I guess it depends on use case. Their site claims that a token is (on average) 4 characters, or roughly .75 words*. Let's say that's generous, and that a token is more like an average of .5 words.

The "Way of Kings" (according to reddit**, at least) is 383,181 words. So, roughly 766,362 tokens. $.02 gets you 1000 tokens, which comes to $15.33.

I dunno what you use it for, and maybe this isn't feasible for your use cases so take this with a grain of salt, but I personally would happily pay $15.33 to be able to send half a "Way of Kings" worth of words to ChatGPT and get half a "Way of Kings" worth of words in response. I mean, I'm certainly not typing half or even a third of the "Way of Kings" in a month to ChatGPT now, even though it's still free. *shrug*

Am I missing something?

* https://openai.com/api/pricing/#faq-token

** https://www.reddit.com/r/brandonsanderson/comments/cncrea/wo...

[tluyben2]

But usually it doesn’t really work like that, at least not for the cases I use it for. And chatgpt is even worse: it’s a conversational AI, so I burn 1000s of tokens fine tuning a response which will be slightly different than the previous response. With gpt3 I have the same issue: my products send a slightly improved prompt, based on the previous result to gpt3 and the new result improves. If you want automated quality, it’s rapidly becoming an impossible business model where humans or custom written software tools are simply (much) cheaper. And your clients know this because your competitors will offer them. It needs to become 0.001/1000 or less. It will do in a few years. It does, like you say, depend on your case. Many cases don’t need this much and there it is cheap, but those cases will turn out to be more demanding when the competition flares up with better results. You can easily burn a million tokens just playing around on an automated system connected to gpt3. Not many people want to pay $20 for just playing and testing things out.

The same happens with stable diffusion by the way; you need to generate many slightly different (improved) images from the same seed, maybe with inpainting to get to the final piece. That costs many tokens. High token prices as they are lead to (much) worse quality of the end result in sd and gpt.

[bigwavedave]

All valid points- fair enough! :)