top | item 34894286 (no title) julien_c | 3 years ago quite cool! haven't tried it yet, but what's the latency on hot-loading a model? (for instance, loading `stabilityai/stable-diffusion-2-1` for the first API call) discuss order hn newest nikola_borisof|3 years ago Because this is popular model and many people use it, you will not experience the cold-start latency most likely. But in general it is <10s.
nikola_borisof|3 years ago Because this is popular model and many people use it, you will not experience the cold-start latency most likely. But in general it is <10s.
nikola_borisof|3 years ago