TE
科技回声
首页24小时热榜最新最佳问答展示工作
GitHubTwitter
首页

科技回声

基于 Next.js 构建的科技新闻平台,提供全球科技新闻和讨论内容。

GitHubTwitter

首页

首页最新最佳问答展示工作

资源链接

HackerNews API原版 HackerNewsNext.js

© 2025 科技回声. 版权所有。

Tabby v0.1.1: Metal inference and StarCoder supports

4 点作者 wsxiaoys超过 1 年前

1 comment

wsxiaoys超过 1 年前
Previously, Tabby ran exclusively on CUDA devices, posing a significant barrier for developers looking to effectively utilize LLMs in their day-to-day coding.<p>The Tabby team made a significant contribution by enhancing support for the StarCoder series models (1B&#x2F;3B&#x2F;7B) in llama.cpp. This enhancement allows these models to run on Metal, providing comparable performance to that of an NVIDIA GPU.