top | item 45497284

(no title)

WanderPanda | 4 months ago

Did they still not release "Bring your own subscription" "login with ChatGPT" and letting people apply their subscription/quota to other apps/services? There are so many use-cases where someone builds a usefull scaffold (e.g. even static website) that could benefit from integration with LLMs but rolling the authentication, having API-keys, free budgets etc. is scary. It would be much better if that could be outsourced to the LLM provider of the user.

It would bear a good lock-in effect for OAI as well

discuss

order

kingstnap|4 months ago

Thats like the opposite of what Open AI would really want though.

They want people walking up saying "we commit to spending $100k monthly for the next year let's discuss bulk discounts."

Terretta|4 months ago

Neither Anthropic or OpenAI want to enable their fully self-service, automated, and scalable enterprise feature flags for only, say, 50 seats each burning $3k a month.

It's particularly annoying to see these feature flags exist in the UI; the features are automated, yet they won't let you select a plan above their "Team" level plans to use them.

(Over on the API side, they're more usage based, and easy to hit the highest tier from zero within about 10 weeks, but certain "talk with support because we probably have to edit a config file we don't let the riffraff see there's a setting for" features, like flipping off a safety flag so the LLM won't refuse to analyze a contract, are similarly gated. That seems more reasonable than gating infosec.)

On the end-user app side, table stakes data security features, some of which used to be included for lower level accounts then just got toggled off, are gated behind somewhere on the order of 150 seats at greater than Max usage instead of 25 or 50 seats.

qiller|4 months ago

Would be great if they provided at least some guidance how to keep this thing on topic. Even the official demo https://chatkit.world/ is not restricted, it happily chats about whatever.

ch4s3|4 months ago

Oh man this thing tells me my iPhone 13 mini isn’t wide enough to use it, that’s rough.

paxys|4 months ago

OpenAI wants all these services to pay per request. That is their entire business model. There is no incentive for them to fold everything into the same $20/mo subscription (which they are most definitely selling at a loss).

m11a|4 months ago

It might meaningfully change the business model of LLM businesses. Becomes seemingly much harder to universally charge $30/mo subscriptions when the user is bringing their own API key.