Hi HN, after five months of hard work since Tabby's previous Show HN (<a href="https://news.ycombinator.com/item?id=35470915">https://news.ycombinator.com/item?id=35470915</a>), I'm thrilled to share you the release of Tabby v0.1.1.<p>Previously, Tabby ran exclusively on CUDA devices, posing a significant barrier for developers looking to effectively utilize LLMs in their day-to-day coding.<p>The Tabby team made a significant contribution by enhancing support for the StarCoder series models (1B/3B/7B) in llama.cpp. This enhancement allows these models to run on Metal, providing comparable performance to that of an NVIDIA GPU.<p>I eagerly look forward to receiving feedback from the community and witnessing the enhanced on-edge deployment experience!<p>References:<p>[1] Apple Installation Instructions: <a href="https://tabby.tabbyml.com/docs/installation/apple/" rel="nofollow noreferrer">https://tabby.tabbyml.com/docs/installation/apple/</a><p>[2] Launch blog: <a href="https://tabby.tabbyml.com/blog/2023/09/18/release-0-1-1-metal/" rel="nofollow noreferrer">https://tabby.tabbyml.com/blog/2023/09/18/release-0-1-1-meta...</a>