Hey HN, created an app to run https://huggingface.co/stabilityai/stablelm-zephyr-3b from your iPhone. It works for iPhones with 6GB RAM (every iPhone 12 pro and up and every regular iPhone 14 and up). It's pretty nice to have something that runs without needing to connect to an API, but the size of the app is 2GB mostly from the model size. Would love to hear suggestions or feedback for improvement, thanks!
No comments yet.