[wint3rmute]

Ollama was the easiest way to set up local LLMs for me.

https://ollama.com/

[solarkraft]

With llama3.2:1b, llama3.2:3b and llama 3.1:8b being the main ones I tried and found impressive.