Demo: Use WebAssembly to Run LLMs on Your Own Device with WasmEdge

Super cool idea, I&#x27;ve been hoping for such a thing!<p>However, terrible interface!<p>Firstly I hate blindly running shell scripts from third part URLs.<p>Secondly yours is awful!<p>It does too much. It would be better to instruct how to set up the wasm environment and download the LLM separately from running the dang thing.<p>I&#x27;m laboriously separating these parts now to manually troubleshoot those that are failing.<p>Thanks for your efforts however.<p>If I get tinyllamma working I&#x27;ll be piping it through piper for some speech output!

LlamaEdge revolutionizes AI&#x2F;LLM runtime with lightweight (&lt;5MB), portable, and secure applications for diverse CPUs&#x2F;GPUs across different OSes, simplifying development and deployment from local to edge and cloud. <a href="https:&#x2F;&#x2F;www.secondstate.io&#x2F;LlamaEdge&#x2F;" rel="nofollow">https:&#x2F;&#x2F;www.secondstate.io&#x2F;LlamaEdge&#x2F;</a>