top | item 46552486 (no title) abhijat | 1 month ago Isn't the context window the same for all plans, 200k? You would hit usage limits? discuss order hn newest billyjobob|1 month ago If you send the full 200k tokens on every request you will get very few requests before you hit the token limit. Caching reduces the number sent but I don't know how much they can cache?
billyjobob|1 month ago If you send the full 200k tokens on every request you will get very few requests before you hit the token limit. Caching reduces the number sent but I don't know how much they can cache?
billyjobob|1 month ago