An LLM in my pocket is truly a mind-blowing concept, I have to say. More than anything else — phone, camera, internet. The feels like a really big deal.<p>And with regard to LLMs (AI?) in general, I don't think right now we have any idea what we will all be using them for in ten years. But it just feels like a fundamental change is coming from all this.
I'm not knowledgeable enough to parse much out of the Readme.<p>How "good" are the models approximately? What hardware do I need to run them? How fast are they?
[dupe]<p>Some more discussion: <a href="https://news.ycombinator.com/item?id=40140675">https://news.ycombinator.com/item?id=40140675</a>