top | item 31197547

(no title)

pqn | 3 years ago

SWE at Exafunction here! We're not ready to be self-serve, so the contact process is the most straightforward for us to work with companies right now. But we respond fast :)

As to the tech, we have APIs closely resembling common deep learning frameworks, so once you add our Python/C++ client locally, you can change a small amount of code to start remotely using GPUs. We also have the ability to handle arbitrary stateful CUDA code for more complex use cases. On the server side, you can deploy our work scheduler inside your own VPC, so we take over orchestration for you as well.

Our customers are currently confidential, but safe to say we've seen a 5-10x decrease in cloud costs (or equivalently, the ability to fit 5-10x larger workloads given a GPU quota). It really depends on the utilization of your current workload.

discuss

order

nharada|3 years ago

Makes sense. I think it's less about speed of response and more that for many SWEs, we don't necessarily have the authority to reach out and create relationships between our companies and another vendor. I certainly am not going to bother trying to get that process started unless I can do a little legwork before involving other parties at my company.

pqn|3 years ago

That's a great point. We've been mostly outbound so far, but this will be a bigger issue for us moving forward. We're thinking about how to lower the barrier to entry for this -- for instance, we can try to publicly release some docs and let anyone try out the system in a local container.