Submissions by 3Sophons

LlamaEdge 0.4.0 Released: Multimodal LLM support, RAG assistant API and more

Demo: Run LLava multimodal LLM with a 2M Rust app portable across GPU/CPU

Run Alicloud's Qwen LLM with a 2MB cross GPU/CPU rust app

Self-Host Across GPU/CPUs Google's Gemma LLMs with a 2MB App

Free Linux Foundation Training/ Certification for New Open Source Contributors

Complete tutorial: Run Qwen LLM across your local machines without Python/C++

Launched! WebAssembly System Interface WASI Preview 2 Discussion

Develop+Deploy RAG Bots with LlamaEdge: Across OSes, NPUs, GPUs Using Vector DB

Self-host any GUFF LLMs on Hugging Face and run across devices

Run the leaked Mistral Medium, miqu-1-70B across GPUs CPUs and OSes

Self-host StableLM-2-Zephyr-1.6B. Portable across GPUs CPUs OSes

LFX Mentorship 2024 Spring LLM Projects: Build Open Source AI Inference Infra

LlamaEdge 0.2.9 released. Now works with Hugging Face's 3000 GGUF models

Rust boosts LLM app development: Make a serverless Japanese Learning bot in mins

Demo: Run LLM on your own devices. portable across GPUs/CPUs/OSes

Demo: Use WebAssembly to Run LLMs on Your Own Device with WasmEdge