[giancarlostoro]

I have a 24GB Macbook Pro. I will note, do get the 'Pro' models, the Mac Mini and the Macbook Air do not have internal fans. The Macbook Pro has an internal fan, and the Mac Studio (bigger Mac Mini) has a fan. If you get a Mini, you might want to get one of those docks that cools the Mini. Your hardware will get very hot very quickly.

Also, because Apple in their infinite wisdom despite giving you a fan, very lazily turn it on (I swear it has to hit 100c before it comes on) and they give you zero control over fan settings, you may want to snag something like TG Pro for the Mac. I wound up buying a license for it, this lets you define at which temperature you want to run your fans and even gives you manual control.

On my 24G RAM Macbook Pro I have about 16GB of Inference. I use Zed with LM Studio as the back-end. I primarily just use Claude Code, but as you note, I'm sure if I used a beefier Mac with more RAM I could probably handle way more.

There's a few models that are interesting on the Mac with LM Studio that let you call tooling, so it can read your local files and write and such:

mistralai/mistralai-3-3b this one's 4.49GB - So I can increase my context window for it, not sure if it auto-compacts or not, have only just started testing it

zai-org/glm-4.6v-flash - This one is 7.09GB, same thing, only just started testing it.

mistralai/mistral-3-14b-reasoning - This one is 15.2GB just shy of the max, so not a TON of wiggle room, but usable.

If you're Apple or a company that builds things for Macs or other devices, please build something to help with airflow / cooling for the MBP / Mac Mini, it feels ridiculous that it becomes a 100c device I'm not so sure its great for device health if you want to use inference for longer than the norm.

I will probably buy a new Mac whenever the inference speeds increase at a dramatic enough rate. I sure hope Apple is considering serious options for increasing inference speed.

[duskwuff]

The Mac Mini does have a fan. It's very quiet, but it's there.

[giancarlostoro]

So is it just like the Pro? Do I need to buy the fan software for my wife's mini too? Ridiculous...

[hypercube33]

How are the Ryzen 395 with 128gb for running models these days?

[mikae1]

Also interested.

[gambiting]

>> I will note, do get the 'Pro' models, the Mac Mini and the Macbook Air do not have internal fans

I have a base model M4 Mac Mini and it absolutely does have a fan inside it.

[giancarlostoro]

I must have assumed it did not, since my wife's Mini never sounded off the fan, it was hot beyond the norm to the touch, I stopped using it for inference. If the standard model Minis do have fans, I might reconsider instead of a Studio.