Show HN: Private AI Mac assistant for non-tech people [Llama 3]

[privacyisimp]

Hi! I've built the private AI assistant that is easy to use by people who don't know what LLM is. Powered by Llama 3 8B.

  - It's 100% private/offline. None of your conversations leave your Mac.
  - Smart, Llama 3 8B is very capable. No dependencies required.
  - Voice recognition support using Whisper LLM. Again 100% private, offline.
  - Easy to install - just download, drag to /Applications and wait until it downloads its brain.
  - Spotlight-like integration - press `⌃ Space` and use it instantly without interrupting your workflow.
  - It's safe - sandboxed, hardened, notarized by Apple and does not need admin password or special privileges.
  - This is beta and it's free :)
  - Oh and it's a native app written in Swift.

It requires Apple Silicon (for now) and 9GB of free space.

[jbaczuk]

I like the general idea. Does it require/use apple silicon? How does performance differ between non-apple vs apple silicon?

The claim that it is 100% on your device is the only reason I would choose to use this over cloud based models. However, with the announcement of “Apple AI” your claim is basically the same only you’re asking users to trust you over Apple.

[privacyisimp]

Yes, Apple Silicon only for now (it's well suited for this job).

Are you sure AppleAI is not cloud based when it comes to sophisticated chatbot capabilities? I think they're using openAI for anything more complex.