I have a question - how can you afford to run this? I looked at the server costs on google compute and runpod.io, and the ones with GPUs powerful enough to run SD are pretty expensive. I'm guessing you don't have a lot of paying users at the beginning, so I don't think you have enough revenue to cover the costs (at least when you're just getting started).
Do you just spend a lot of money to fund this, and hope that once you have enough users it will pay for itself? Or did you find some affordable way to run a server? If yes, and if it's not a secret - where are you renting the server, what are its specs, and how much does it cost?
On AWS, a g5 instance costs $1/hr. I can generate roughly 10 images per minute (should be able to get this down with some optimization), so 600 images per hour, so the cost per image is 1/6 of a cent, before adding overhead (idle time, start up/shut down).
I also offer dreambooth model training for around $2-$4 / model as well as inference on custom dreambooth models. Inference on custom models is where things get a little tricky because if users are using different models and you're loading up new models all the time just to generate 6 images, then that quickly becomes the majority of the work load, drastically pushing up the inference cost. I haven't solved this problem yet. If you have any great ideas, feel free to email me (email in profile)!
At the beginning it was just burning money, but it stars to turn into profit.
The only secret to making it affordable is to autoscale based on a current image generation traffic. It runs on a mix of Tesla V100 and RTX 3090 from runpod.io vast.ai and Lambda Labs.
I actually went through a couple of iterations with it, starting as completely free service, then offering one time payments for image credits and now settled on subscriptions as I see there is a demand for the product. Especially AI Editor[1] which I think offers a unique value to the users.
Stable diffusion only needs 4GB of VRAM to run on the low end so you can rent low-end consumer GPUs (nvidia RTX for example) for around $0.10 an hour to do the renders.
It's a measure to prevent multi accounts. Some people really overuse free offering. Either your domain/IP is on a spam list or your email server may be misconfigured.
Came here to point out that my personal email is wrongfully listed as a disposable email address. It must be that it's a three letter url with a .nl TLD.
Saying that it requires login before someone spends time to think up a description for an image would have been nice (because I won't sign-in to try something anyways).
Edit: rephrased to remove overly negative language.
I don't see this as baiting. The link to a tool page was shared. It's transparent on the homepage and in the header. The text to image page just shows how it works without the need to create an account.
FWIW, you're not the only one. On our product, we experimented adding login when the user tries to use any of our tools and something like ~60-70% of users dropped off. So essentially, whoever implements that is killing their user funnel at the very beginning which I'm guessing will have larger effects down the road (fewer users experience "magical moments" which leads to less word-of-mouth, etc).
On the flip side though, I'm sure it may help metrics in the short term especially since it's expensive to offer a service like this (which requires expensive GPU servers).
lumenwrites|3 years ago
I have a question - how can you afford to run this? I looked at the server costs on google compute and runpod.io, and the ones with GPUs powerful enough to run SD are pretty expensive. I'm guessing you don't have a lot of paying users at the beginning, so I don't think you have enough revenue to cover the costs (at least when you're just getting started).
Do you just spend a lot of money to fund this, and hope that once you have enough users it will pay for itself? Or did you find some affordable way to run a server? If yes, and if it's not a secret - where are you renting the server, what are its specs, and how much does it cost?
synapticpaint|3 years ago
Source: I run a similar project: https://synapticpaint.com/
I also offer dreambooth model training for around $2-$4 / model as well as inference on custom dreambooth models. Inference on custom models is where things get a little tricky because if users are using different models and you're loading up new models all the time just to generate 6 images, then that quickly becomes the majority of the work load, drastically pushing up the inference cost. I haven't solved this problem yet. If you have any great ideas, feel free to email me (email in profile)!
jkbl|3 years ago
The only secret to making it affordable is to autoscale based on a current image generation traffic. It runs on a mix of Tesla V100 and RTX 3090 from runpod.io vast.ai and Lambda Labs.
I actually went through a couple of iterations with it, starting as completely free service, then offering one time payments for image credits and now settled on subscriptions as I see there is a demand for the product. Especially AI Editor[1] which I think offers a unique value to the users.
[1] https://getimg.ai/editor
nacs|3 years ago
raymond_goo|3 years ago
permanent|3 years ago
tuhins|3 years ago
you can also check out our demo for Stable Diffusion v2. it's free to use, with no email sign-in required and no credit system.
https://app.baseten.co/apps/VBlnMVP/operator_views/nBrd8zP
mechanical_bear|3 years ago
russellbeattie|3 years ago
Hoefner|3 years ago
jkbl|3 years ago
IceHegel|3 years ago
kyleyeats|3 years ago
frobolo|3 years ago
thundergolfer|3 years ago
---
To OP, I reckon you should allow 1 generation before hitting us with the login prompt. May lift conversion.
LegitShady|3 years ago
joe_the_user|3 years ago
NVQXE23I|3 years ago
Maybe take a look at your mail checking API?
_Microft|3 years ago
Saying that it requires login before someone spends time to think up a description for an image would have been nice (because I won't sign-in to try something anyways).
Edit: rephrased to remove overly negative language.
unknown|3 years ago
[deleted]
jkbl|3 years ago
davidkunz|3 years ago
Posted by @davely today.
unknown|3 years ago
[deleted]
kburman|3 years ago
ftufek|3 years ago
On the flip side though, I'm sure it may help metrics in the short term especially since it's expensive to offer a service like this (which requires expensive GPU servers).
unknown|3 years ago
[deleted]
ShamelessC|3 years ago
unknown|3 years ago
[deleted]
devxpy|3 years ago
https://app.gooey.ai/CompareText2Img/?example_id=1uONp1IBt0Y
mrkeen|3 years ago
Traubenfuchs|3 years ago
unknown|3 years ago
[deleted]
88stacks|3 years ago
unknown|3 years ago
[deleted]
mlu509|3 years ago