[ecurtin]

@cge you have this right, the main python script has no dependancies, it just uses python3 stdlib stuff. So if you have a python3 executable on your system you are good to go. All the stuff with dependancies runs in a container. On macOS, using no containers works well also, as we basically just install brew llama.cpp

There's really no major python dependancy problems people have been running this on many Linux distros, macOS, etc.

We deliberately don't use python libraries because of the packaging problems.