Ask HN: Deepseek v3 how can I check on local computer?

4 pointsby lavren19745 months ago

deepseek v3 how can I check on my local computer and is my hardware capable of running this model (64 GB RAM, and 4080 video card)

4 comments

talldayo5 months ago

Your computer can run it, but you have to layer the model across CPU and GPU memory. Your bottleneck will be PCIe speed, which probably won't be a huge issue for a 4080 on smaller quants.

评论 #42532424 未加载

dtnewman5 months ago

Check out exo labs blog. <a href="https://blog.exolabs.net/day-2/" rel="nofollow">https://blog.exolabs.net/day-2/</a>

dcreater5 months ago

Short answer: You cant run it locally. Its 670B parameters..<p>Long(er) answer: check the reddit thread on r/LocalLLaMa

lavren19745 months ago

Ollama doesn't have this model yet.