Ask HN: Has anyone used llama.cpp in production?

3 点作者 Nevin1901超过 1 年前

I’ve found ggerganovs work on llama.cpp to be amazing, and I’ve loved playing around with it. However, has anyone used it in production? I’m sure there are some really cool use cases, but I haven’t seen any yet.

2 条评论

runjake超过 1 年前

Some people are.<p><a href="https://old.reddit.com/r/localllama" rel="nofollow noreferrer">https://old.reddit.com/r/localllama</a>

linusg789超过 1 年前

4chan /g/ has a small community of people playing around with local LLMs, maybe check there.