[axoltl]

There's MLX versions of the model, so yes. LM Studio hasn't updated their mlx-lm runtime yet though, you'll get an exception.

But if you're OK running it without a UI wrapper, mlx_lm==0.30.0 will serve you fine.

[anon373839]

Looks like LM Studio just updated the MLX runtime, so there's compatibility now.

[axoltl]

Yep! 60t/s on the 8 bit MLX on an M4 Pro with 64GB of RAM.