Ask HN: How can I RAG privately?

I really want to "talk" to my local and cloud based documents. However, given some privacy constraints, I really can't do that. Short of building my own locally running LLM and db, is there a solution to do that yet?