top | item 45775637

(no title)

timeflex | 4 months ago

S3 might be relatively cheap for storing files, but with bandwidth you could easily be paying $230/mo. If you make it public facing & want to try to use their cloud reporting, metrics, etc. to prevent people for running up your bandwidth, your "really cheap" static hosting could easily cost you more than $500/mo.

discuss

order

theultdev|4 months ago

R2 is S3 compatible with no egress fees.

Cloudflare actually has built in iceberg support for R2 buckets. It's quite nice.

Combine that with their pipelines it's a simple http request to ingest, then just point duckdb to the iceberg enabled R2 bucket to analyze.

8organicbits|4 months ago

> R2 is S3 compatible with no egress fees.

There's no egress data transfer fees, but you still pay for the GET request operations. Lots of little range requests can add up quick.

greatNespresso|4 months ago

Was about to jump in to say the same thing. R2 is a much cheaper alternative to S3 that just works and I have used it with DuckDB, works smoothly

7952|4 months ago

I think this approach makes sense for services with a small number of users relative to the data they are searching. That just isn't a good fit for a lot of hosted services. Think how much that TB's of data would cost on Algolia or similar services.

You have to store the data somehow anyway, and you have to retrieve some of it to service a query. If egress costs too much you could always change later to put the browser code on a server. Also it would presumably be possible to quantify the trade-off between processing the data client side and on the server.

simonw|4 months ago

Stick it behind Cloudflare and it should be effectively free.

bigiain|4 months ago

Until it isn't.