TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Ask HN: LLM Use/Research Hardware Tiers

4 pointsby truekonradsabout 1 year ago
It seems there are tiers of hardware required for LLM use: both interacting&#x2F;asking questions and also training, but I don&#x27;t understand them. There&#x27;s seemingly two ends: a )it runs on my Mac or b) it needs 8xH100 Nvidia cards at USD250k+.<p>What are some other tiers? What could be done with 10k, 50k, 100k investments into compute?

2 comments

user_7832about 1 year ago
At least for use you can get pretty far with 2k ish consumer hardware. Check out r&#x2F;localllama if you want to learn more in general.
speedgooseabout 1 year ago
If you do research, you may have access to descent HPCs.
评论 #39755042 未加载