MiniLLM: A minimal system for running LLMs on consumer-grade Nvidia GPUs

31 点作者 volodia大约 2 年前

2 条评论

22c大约 2 年前

GitHub link: <a href="https://github.com/kuleshov/minillm">https://github.com/kuleshov/minillm</a>

noonething大约 2 年前

good luck with this, looks good so far