top | item 41370207 (no title) smsx | 1 year ago The numbers are pretty incredible. Will the competition be able to match them? discuss order hn newest shwaj|1 year ago Groq is claiming 284 tokens/second on Llama 3.1 70b, so they’re in the same ballpark.https://groq.com/12-hours-later-groq-is-running-llama-3-inst... wmf|1 year ago If Groq 2 is 2x faster it will match Cerebras WSE-3.
shwaj|1 year ago Groq is claiming 284 tokens/second on Llama 3.1 70b, so they’re in the same ballpark.https://groq.com/12-hours-later-groq-is-running-llama-3-inst...
shwaj|1 year ago
https://groq.com/12-hours-later-groq-is-running-llama-3-inst...
wmf|1 year ago