top | item 41237644

(no title)

ValleZ | 1 year ago

Private AI app in play store wraps llama.cpp

discuss

order

katzinsky|1 year ago

Heh I guess that's a good point. All I have is a ten year old iPhone just to run Cisco DUO for work and there seems to be no way to run llama.cpp on it even with a very small model.

Occasionally I'll use i.sh to ssh into a decent computer but it would be nice to be able to just run normal software on it.

ValleZ|1 year ago

It will probably run 2B models, there are many more options for iOS, try it out.