top | item 41785526

(no title)

037 | 1 year ago

> Yes, it is possible to use Prompt Caching with your Batches API requests. However, because asynchronous batch requests can be processed concurrently and in any order, we cannot guarantee that requests in a batch will benefit from caching.

https://docs.anthropic.com/en/docs/build-with-claude/prompt-...

discuss

order

No comments yet.