TE
科技回声
首页24小时热榜最新最佳问答展示工作
GitHubTwitter
首页

科技回声

基于 Next.js 构建的科技新闻平台,提供全球科技新闻和讨论内容。

GitHubTwitter

首页

首页最新最佳问答展示工作

资源链接

HackerNews API原版 HackerNewsNext.js

© 2025 科技回声. 版权所有。

Show HN: AI Infra for non-Nvidia GPUs

2 点作者 shadowfax9210 个月前
Hey! We are building open-source AI infra (on top of XLA) to make it easier to run AI workloads on non-NVIDIA GPUs (AMD, Google TPU, AWS Trainium, Intel Gaudi). We believe that with some effort, it is possible to achieve similar or better performance per watt compared to NVIDIA GPUs, while also enabling hardware diversity and reducing costs.<p>For the first step in this milestone, we released Felafax RoadRunnerX on Github (pun intended ), which includes a set of notebooks and deployment scripts for fine-tuning LlaMa3 on Google TPUs!<p>What do you all think? Would love to get your feedback!<p>Felafax RoadRunnerX repo - <a href="https:&#x2F;&#x2F;github.com&#x2F;felafax&#x2F;RoadrunnerX">https:&#x2F;&#x2F;github.com&#x2F;felafax&#x2F;RoadrunnerX</a>

1 comment

shadowfax9210 个月前
We also built a cloud UI to make it easy to spin-up large clusters of TPUs and run multi-GPU fine-tuning on them! Check that out here - <a href="https:&#x2F;&#x2F;felafax.ai&#x2F;">https:&#x2F;&#x2F;felafax.ai&#x2F;</a>