[anonymous_llama]

This looks pretty cool! Does it support the new Deepseek model as well?

[dadmobile]

Yes! The easiest way to run this locally is to use one of the distilled models (you download one from the Model Zoo or enter any huggingface ID at the bottom of the page). If you are on a mac, the MLX versions work great, and of course GGUF if you want a quantized model or don't have a GPU.