TE
科技回声
首页24小时热榜最新最佳问答展示工作
GitHubTwitter
首页

科技回声

基于 Next.js 构建的科技新闻平台,提供全球科技新闻和讨论内容。

GitHubTwitter

首页

首页最新最佳问答展示工作

资源链接

HackerNews API原版 HackerNewsNext.js

© 2025 科技回声. 版权所有。

Why is the storage cluster used to train Llama 3 so slow?

2 点作者 1a1a11a10 个月前

1 comment

1a1a11a10 个月前
&quot;Tectonic (Pan et al., 2021), Meta’s general-purpose distributed file system, is used to build a storage fabric (Battey and Gupta, 2024) for Llama 3 pre-training. It offers 240 PB of storage out of 7,500 servers equipped with SSDs, and supports a sustainable throughput of 2 TB&#x2F;s and a peak throughput of 7 TB&#x2F;s&quot;<p>I would expect at least 10s if not 100s TB&#x2F;s from a cluster of 7500 servers with SSDs, what is the bottleneck?