16 pointsby CharlieRuan11 months ago

4 comments

crowwork11 months ago

Comes with ability to do full structured generation with json schema<p>also a in-browser demo <a href="https://chat.webllm.ai/" rel="nofollow">https://chat.webllm.ai/</a>

leshenj1511 months ago

So cool. No more privacy concerns!

ruihangl11 months ago

It's good to see that it contains the standard OpenAI API interface in JavaScript which looks very convenient.

cyx611 months ago

AMAZING!

In-browser LLM inference engine with WebGPU and OpenAI API

4 comments

In-browser LLM inference engine with WebGPU and OpenAI API

4 comments