TE
科技回声
首页24小时热榜最新最佳问答展示工作
GitHubTwitter
首页

科技回声

基于 Next.js 构建的科技新闻平台,提供全球科技新闻和讨论内容。

GitHubTwitter

首页

首页最新最佳问答展示工作

资源链接

HackerNews API原版 HackerNewsNext.js

© 2025 科技回声. 版权所有。

SambaNova chip for LLMs nearly as fast as Groq

28 点作者 stolsvik12 个月前

5 条评论

screye12 个月前
If the crypto wave was any indication, llm asics will gain popularity as general purpose devices like Nvidia gpus get phased out.<p>I&#x27;m hoping the rise of Asics leads to hardware agnostic representations of ML models, or at least seamless conversion from Cuda to other target hardware.<p>With LLMs standardizing around known instructions, I&#x27;m bullish about this family of hardware. Now, they may just get acquired given the infinite money Nvidia has. But, I see their IP being valuable by itself.<p>I&#x27;ve used Groq, and it&#x27;s been one of my few &#x27;oh wow&#x27; moments of the recent llm cycle.
cry-oscillator12 个月前
This offers no insight into the architecture of either system or the chips they developed. Also, why would I want to access their stack and have them use my queries as training data?<p>I see nothing from either Groq or SambaNova that says that they will distribute dedicated inference chips in any other form than full data centers. If I can&#x27;t slot it into my machine, is it real? How exactly are these companies envisioning the future of inference? As a walled corporate garden where we pay them with our thoughts code low complexity tasks and small change so they can cement their hold on our material lives and make themselves indispensable as they imperceptibly shape our outcomes? At least Tenstorrent is selling something I could slot, although I don&#x27;t think they are at the point where it makes sense to do so
评论 #40615493 未加载
anon29112 个月前
When you&#x27;re competing with NVIDIA, &#x27;nearly as fast&#x27; as the next best competitor is not going to cut it. I wonder what part of the market they&#x27;re looking for here.
评论 #40514628 未加载
评论 #40512286 未加载
Havoc12 个月前
Never got my verification link. Maybe it’s because I used + notation
nextworddev12 个月前
Can this be mass produced?