[tomgs]

Neat! What’s the use case exactly? Kinda hard to figure from skimming

[funerr]

When you have LLM requests you don't mind waiting for (up to 24h) then you can save 50% in costs. Great for document processing, image classification at scale, anything that you don't need an immediate result from the LLM provider and costs play a role.

[tomgs]

Concrete use cases where 50 percent is actually a thing?