TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Best Open source LLM and embeddings

1 pointsby battybro0034almost 2 years ago
Hi, I have been asked to create a &quot;chat with your documents&quot; kind of product, but using open source LLM&#x27;s, locally stored on a users desktop. Kind of like privategpt.io.<p>Embeddings have also to be created&#x2F;queried on a user&#x27;s desktop.<p>Is there any LLM and embeddings comparable to Open AI&#x27;s products? My use case is for lawyers, so cant use Open AI, as they cant upload their documents on any server at all, everything has to be in house.<p>Is privategpt good enough, or is it just garbage, full of hallucinations? Will there be something for my use case available in a few months?

no comments

no comments