TE
科技回声
首页24小时热榜最新最佳问答展示工作
GitHubTwitter
首页

科技回声

基于 Next.js 构建的科技新闻平台,提供全球科技新闻和讨论内容。

GitHubTwitter

首页

首页最新最佳问答展示工作

资源链接

HackerNews API原版 HackerNewsNext.js

© 2025 科技回声. 版权所有。

Show HN: Llama.go – port of llama.cpp to pure Go

25 点作者 Ambix大约 2 年前
It&#x27;s April 12 - The First Man in Space* Day - and I&#x27;m releasing #ML framework I&#x27;ve been building for the last month :)<p>It&#x27;s written in #Go and allows #LLaMA #GPT inference having just regular PC - so no monster GPU cluster is needed to start experiment with:<p><a href="https:&#x2F;&#x2F;github.com&#x2F;gotzmann&#x2F;llama.go">https:&#x2F;&#x2F;github.com&#x2F;gotzmann&#x2F;llama.go</a><p>The V1 is using FP32 math only, but will work with AVX2 data types and INT8 quantisation soon.<p>* The first man in space was Yuri Gagarin from USSR

3 条评论

ipaddr大约 2 年前
Do we have a php version yet
smcleod大约 2 年前
&quot;Pure Go&quot; ... looks at repo - 16.9% python.
评论 #35554882 未加载
评论 #35578832 未加载
tough大约 2 年前
very cool, waiting for llama.rust any day now