top | item 37674063

(no title)

anoy8888 | 2 years ago

OpenAI whisper api has 50 request per min rate limit . It means that I can’t have more than 50 concurrent users . If you are building a consumer app, this seems like a no go. I believe gpt4 has similar rate limits. How do you work wine that rate limit to server tens of thousands of users

discuss

order

hhh|2 years ago

You ask OpenAI for higher limits.

robertkoss|2 years ago

GPT-4 has a default limit of 200 RPM and you can request an increase.