TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Demo: Use WebAssembly to Run LLMs on Your Own Device with WasmEdge

2 pointsby 3Sophonsover 1 year ago

2 comments

illuminantover 1 year ago
Super cool idea, I&#x27;ve been hoping for such a thing!<p>However, terrible interface!<p>Firstly I hate blindly running shell scripts from third part URLs.<p>Secondly yours is awful!<p>It does too much. It would be better to instruct how to set up the wasm environment and download the LLM separately from running the dang thing.<p>I&#x27;m laboriously separating these parts now to manually troubleshoot those that are failing.<p>Thanks for your efforts however.<p>If I get tinyllamma working I&#x27;ll be piping it through piper for some speech output!
评论 #39117880 未加载
评论 #39092033 未加载
3Sophonsover 1 year ago
LlamaEdge revolutionizes AI&#x2F;LLM runtime with lightweight (&lt;5MB), portable, and secure applications for diverse CPUs&#x2F;GPUs across different OSes, simplifying development and deployment from local to edge and cloud. <a href="https:&#x2F;&#x2F;www.secondstate.io&#x2F;LlamaEdge&#x2F;" rel="nofollow">https:&#x2F;&#x2F;www.secondstate.io&#x2F;LlamaEdge&#x2F;</a>