top | item 46712086

(no title)

StevenWaterman | 1 month ago

Cached tokens are cheaper (90% discount ish) but not free

discuss

order

moyix|1 month ago

Also, unlike OpenAI, Anthropic's prompt caching is explicit (you set up to 4 cache "breakpoints"), meaning if you don't implement caching then you don't benefit from it.

netcraft|1 month ago

thats a very generous way of putting it. Anthropic's prompt caching is actively hostile and very difficult to implement properly.