yobanate | 2 years ago | on: Many options for running Mistral models in your terminal using LLM
Can confirm.
My M3 Max gets about 22t/s, putting the bottleneck BKAC.
yobanate's comments
yobanate | 2 years ago | on: MLX: An array framework for Apple Silicon
Nailed it.
I think more than partially. What happens in this repo will spread to the other major frameworks and over time, clever ideas that spawn on other projects will be reimplemented with Apple's adjustments back into the repo. It's a brilliant and efficient way to interact with the community, that can likely be measured in more sales of their hardware over time.
page 1