top | item 42887699

(no title)

bestcoder69 | 1 year ago

Llamafile: https://github.com/Mozilla-Ocho/llamafile

discuss

order

lolinder|1 year ago

Llamafile is great but solves a slightly different problem very well: how do I easily download and run a single model without having any infrastructure in place first?

Ollama solves the problem of how I run many models without having to deal with many instances of infrastructure.

romperstomper|1 year ago

You don't need any infrastructure for llamafiles, you just download and run them (everywhere).

homebrewer|1 year ago

It's actually more difficult to use on linux (compared to ollama) because of the weird binfmt contortions you have to go through.

yjftsjthsd-h|1 year ago

What contortions? None of my machines needed more than `chmod +x` for llamafile to run.