[jbaczuk]

I like the general idea. Does it require/use apple silicon? How does performance differ between non-apple vs apple silicon?

The claim that it is 100% on your device is the only reason I would choose to use this over cloud based models. However, with the announcement of “Apple AI” your claim is basically the same only you’re asking users to trust you over Apple.

[privacyisimp]

Yes, Apple Silicon only for now (it's well suited for this job).

Are you sure AppleAI is not cloud based when it comes to sophisticated chatbot capabilities? I think they're using openAI for anything more complex.