top | item 40134021

Phi-3 Technical a Highly Capable Language Model Locally on Your Phone

7 points| EveryPizza | 1 year ago |huggingface.co | reply

7 comments

order
[+] pogue|1 year ago|reply
Anyone made or working on a UI for this for Android (or iPhone)?
[+] sottol|1 year ago|reply
I've been trying this app but haven't had any luck getting it to actually generate text yet:

https://github.com/Mobile-Artificial-Intelligence/maid

The UI looks nice and includes a native compilation of llama.cpp.

My main phone's screen broke so I'm on an old Pixel 4 until it's repaired but I've had no luck getting 2-3GB models to run so far.