top | item 44490656

(no title)

asaddhamani | 7 months ago

The pricing is a little on the higher side. Working on a performance-sensitive application, I tried Mercury and Groq (Llama 3.1 8b, Llama 4 Scout) and the performance was neck-and-neck but the pricing was way better for Groq.

But I'll be following diffusion models closely, and I hope we get some good open source ones soon. Excited about their potential.

discuss

order

tripplyons|7 months ago

Good to know. I didn't realize how good the pricing is on Groq!

tlack|7 months ago

If your application is pricing sensitive, check out DeepInfra.com - they have a variety of models in the pennies-per-mil range. Not quite as fast as Mercury, Groq or Samba Nova though.

(I have no affiliation with this company aside from being a happy customer the last few years)

sexeriy237|7 months ago

You're getting the savings by shifting the pollution of the datacenter onto a largely black community and choking them out.