TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Run Deepseek from fast NVMe drives

5 pointsby ironbound3 months ago

1 comment

ironbound3 months ago
Testing extreme NVME offload (4 x Gen5x4) for DeepSeek R1Because PCI-E 5x16 (~60GB&#x2F;s) is close to dual channel DDR5 bandwidth, this is the cheapest method to run huge models. Code: <a href="https:&#x2F;&#x2F;github.com&#x2F;BlinkDL&#x2F;fast.c">https:&#x2F;&#x2F;github.com&#x2F;BlinkDL&#x2F;fast.c</a>
评论 #42987829 未加载
评论 #42987844 未加载