PowerInfer-2: Fast Large Language Model Inference on a Smartphone

Arxiv Paper: <a href="https:&#x2F;&#x2F;arxiv.org&#x2F;abs&#x2F;2406.06282" rel="nofollow">https:&#x2F;&#x2F;arxiv.org&#x2F;abs&#x2F;2406.06282</a><p>Previous submission (paper link submitted): <a href="https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=40646450">https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=40646450</a>