top | item 46554835

(no title)

billyjobob | 1 month ago

If you send the full 200k tokens on every request you will get very few requests before you hit the token limit. Caching reduces the number sent but I don't know how much they can cache?

discuss

order

No comments yet.