What we know about the Apple Neural Engine

geohot&#x27;s findings:<p><a href="https:&#x2F;&#x2F;github.com&#x2F;geohot&#x2F;tinygrad&#x2F;tree&#x2F;master&#x2F;accel&#x2F;ane">https:&#x2F;&#x2F;github.com&#x2F;geohot&#x2F;tinygrad&#x2F;tree&#x2F;master&#x2F;accel&#x2F;ane</a>

There&#x27;s also basic ANE support for Asahi now:<p><a href="https:&#x2F;&#x2F;github.com&#x2F;eiln&#x2F;ane">https:&#x2F;&#x2F;github.com&#x2F;eiln&#x2F;ane</a><p><a href="https:&#x2F;&#x2F;github.com&#x2F;eiln&#x2F;anecc">https:&#x2F;&#x2F;github.com&#x2F;eiln&#x2F;anecc</a><p><a href="https:&#x2F;&#x2F;github.com&#x2F;AsahiLinux&#x2F;m1n1&#x2F;pull&#x2F;296&#x2F;files">https:&#x2F;&#x2F;github.com&#x2F;AsahiLinux&#x2F;m1n1&#x2F;pull&#x2F;296&#x2F;files</a>

So my phone and my laptop both have the capability to perform 15 trillion operations per second, just in the neural engine?<p>What kind of things are taking advantage of this right now? It&#x27;s gotta be more than just Face ID right?<p>What&#x27;s my laptop likely to be doing with that?

Anyone done any work on using a model for transcription on the local device using the ANE? I&#x27;ve heard it kills the battery. Having to transcribe voice in the cloud is a serious impediment to end to end encryption for certain applications.

Do we think Apple are going to provide more info and maybe a public API over time?<p>Or they are keeping it obscure for commercial reasons?<p>Or just not very competent&#x2F;don&#x27;t care?<p>Seems weird having these amazing chips and only blunt tools

Can this really be everything publically known about the ANE? Sounds hard to believe, I would have thought someone would have reverse engineered <i>something</i> about it by now.

Does anyone know if the neural engine on the new M1&#x2F;M2 Max is directly hooked up to the unified memory the way the GPU is?

Would be interesting to compare its performance to similar AI cores in other SoCs, such as Qualcomm&#x27;s Snapdragon or Google&#x27;s Tensor.

Can LLM run in it?

Siri is still pants tho

Âne means donkey in French.<p>Just sayin&#x27;.

Yes of cour

It&#x27;s really terrible that Apple markets this as the next big thing but forgets to include detailed documentation so people have to experiment and figure out what works...