首页

2 条评论

gdiamos4 个月前
Some interesting notes about the project if folks want to dig deeper:<p>There is a dev mode that runs on a laptop:<p><pre><code> - https:&#x2F;&#x2F;docs.cray-lm.com&#x2F;deployment&#x2F;laptop </code></pre> There is a unified dockerfile for building vLLM and the training stacks on four targets [ROCm, CUDA, ARM, x86]<p><pre><code> - https:&#x2F;&#x2F;github.com&#x2F;cray-lm&#x2F;cray-lm&#x2F;blob&#x2F;main&#x2F;Dockerfile</code></pre>
gdiamos4 个月前
Some of the authors are available to discuss the current code or the roadmap.