top | item 36572230

(no title)

bencevans | 2 years ago

Looking forward to GPU support for workers. Cloudflare announced they were working on it in 2021 [1], but it doesn't seem generally available yet; they still have a signup page for notification [2].

I know other companies have struggled with demand, so maybe they're doing it on an invite basis.

[1]: https://blog.cloudflare.com/workers-ai/ [2]: https://www.cloudflare.com/nvidia-workers/

discuss

order

jgrahamc|2 years ago

Good things come to those who wait :-)

NicoJuicy|2 years ago

I was under the assumption that, because of how cloudflare works, it has to be globally available.

That would mean support in every dc and a easily to expand capacity.

They can't just make it available in one region and then see how it goes.

I like how cloudflare works, but this use-case for them ( on the edge) seems more difficult to plan. It's not just the tech, it's the infrastructure in this case.

Just my 2 cents

ushakov|2 years ago

They probably just want to see how many people would sign up if they had it. Before they start building something nobody wants to pay for.

babelfish|2 years ago

Agreed, but this is a blocker for anyone seriously considering using the product. CPU-only inference simply isn’t good enough for anything besides toy workloads. If they’re waiting for people to use Constellation before investing in GPU support, nobody will use constellation because it doesn’t have it, so they’ll never end up investing in it, and so on…