Ask HN: Deepseek v3 how can I check on local computer?

4 点作者 lavren19745 个月前

deepseek v3 how can I check on my local computer and is my hardware capable of running this model (64 GB RAM, and 4080 video card)

4 条评论

talldayo5 个月前

Your computer can run it, but you have to layer the model across CPU and GPU memory. Your bottleneck will be PCIe speed, which probably won't be a huge issue for a 4080 on smaller quants.

评论 #42532424 未加载

dtnewman5 个月前

Check out exo labs blog. <a href="https://blog.exolabs.net/day-2/" rel="nofollow">https://blog.exolabs.net/day-2/</a>

dcreater5 个月前

Short answer: You cant run it locally. Its 670B parameters..<p>Long(er) answer: check the reddit thread on r/LocalLLaMa

lavren19745 个月前

Ollama doesn't have this model yet.