[cwoolfe]

What's the most cost-effective way to run open source models using cloud infrastructure? AWS? Digital Ocean? salad.com? Lambda.ai? Vast.ai? Use case is infrequent and small usage, but needs to be able to scale to match increasing demand.

[ipnon]

Modal is great for infrequent batches.

[latchkey]

ssh admin.hotaisle.app