top | item 46554835 (no title) billyjobob | 1 month ago If you send the full 200k tokens on every request you will get very few requests before you hit the token limit. Caching reduces the number sent but I don't know how much they can cache? discuss order hn newest No comments yet.
No comments yet.