Apple Releases Open Source AI Models That Run On-Device

[JKCalhoun]

An LLM in my pocket is truly a mind-blowing concept, I have to say. More than anything else — phone, camera, internet. The feels like a really big deal.

And with regard to LLMs (AI?) in general, I don't think right now we have any idea what we will all be using them for in ten years. But it just feels like a fundamental change is coming from all this.

[gnabgib]

Discussion: [0] (33 points, 18 hours ago, 7 comments)

[0]: https://news.ycombinator.com/item?id=40140675

[solarkraft]

I'm not knowledgeable enough to parse much out of the Readme.

How "good" are the models approximately? What hardware do I need to run them? How fast are they?

[ChrisArchitect]

[dupe]

Some more discussion: https://news.ycombinator.com/item?id=40140675

[simonw]

Has anyone seen a working, clearly explained recipe for running this using the Python MLX library on macOS yet?

[ein0p]

What’s there to explain? There’s a readme in the repo that shows how to do it.

[mritchie712]

guessing it'll be available thru ollama soon

https://huggingface.co/apple/OpenELM/discussions/5

[sp332]

Why is the 3B model worse than the 450M model on MMLU and TruthfulQA?

[Bloating]

Now we can give credit to Apple for invented AI!

[Turing_Machine]

Apple rarely invents the first X.

However, they often invent the first X that doesn't suck.

Turns out that the second one is actually more important.

[thebruce87m]

I never see apple claiming to invent something. I frequently see comments like yours however.