Selfhost LLMs like Mixtral 8x7B on the Edge & across devices.

1 点作者 3Sophons超过 1 年前

1 comment

3Sophons超过 1 年前

Fully portable inference app only 2MB. Try it on your Mac with one single command: <a href="https://www.secondstate.io/run-llm/" rel="nofollow">https://www.secondstate.io/run-llm/</a>