top | item 46778028 (no title) bertili | 1 month ago People are running the previous Kimi K2 on 2 Mac Studios at 21tokens/s or 4 Macs at 30tokens/s. Its still premature, but not a completely crazy proposition for the near future, giving the rate of progress. discuss order hn newest NitpickLawyer|1 month ago > 2 Mac Studios at 21tokens/s or 4 Macs at 30tokens/sKeep in mind that most people posting speed benchmarks try them with basically 0 context. Those speeds will not hold at 32/64/128k context length.
NitpickLawyer|1 month ago > 2 Mac Studios at 21tokens/s or 4 Macs at 30tokens/sKeep in mind that most people posting speed benchmarks try them with basically 0 context. Those speeds will not hold at 32/64/128k context length.
NitpickLawyer|1 month ago
Keep in mind that most people posting speed benchmarks try them with basically 0 context. Those speeds will not hold at 32/64/128k context length.