[Nokinside]

The first SoC including Neural Engine was the A11 Bionic, used in iPhone 8, 8 Plus and iPhone X, introduced in 2017. Since then, every Apple A-series SoC has included a Neural Engine.

[aurareturn]

The Neural Engine is its own block. Neural Engine is not used for local LLMs on Macs. Neural Engine is optimized for power efficiency while running small models. It's not good for LARGE language models.

This change is strictly adding matmul acceleration into each GPU core where it is being used for LLMs.

[runjake]

The matmul stuff is part of the Neural Accelerator marketing, which is distinct from the Neural Engine you're talking about.

I don't blame you. It's confusing.

[Nokinside]

It's remaining and rearrangement of the same stuff. Not a new feature.