TE
科技回声
首页24小时热榜最新最佳问答展示工作
GitHubTwitter
首页

科技回声

基于 Next.js 构建的科技新闻平台,提供全球科技新闻和讨论内容。

GitHubTwitter

首页

首页最新最佳问答展示工作

资源链接

HackerNews API原版 HackerNewsNext.js

© 2025 科技回声. 版权所有。

Can I run this LLM? Check if LLM will work on your hardware

1 点作者 AJRF4 个月前

1 comment

AJRF4 个月前
Hey HN,<p>I&#x27;ve recently started running local LLMs, and one problem I encountered was inconsistent information on whether a model will run within a certain amount of VRAM.<p>I created a simple calculator that helps determine if a model can run on your hardware. It will also tell you how much VRAM you need at different quantization levels.<p>It doesn’t work with all models yet, but I’m working on building a more stable dataset to pull from.<p>Feedback is appreciated!