As the sibling comment mentions, you're not getting anything production grade for less than $7 per million and that's on input and output.
Nebius is single digit TPS. 31 seconds to reply to "What's 1+1".
Hopefully Deepseek will make it out of their current situation because in a very ironic way, the thing the entire market lost its mind over is not actually usable at the pricing that drove the hype: https://openrouter.ai/deepseek/deepseek-r1
BoorishBears|1 year ago
Nebius is single digit TPS. 31 seconds to reply to "What's 1+1".
Hopefully Deepseek will make it out of their current situation because in a very ironic way, the thing the entire market lost its mind over is not actually usable at the pricing that drove the hype: https://openrouter.ai/deepseek/deepseek-r1