TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Show HN: RAG App Example with Self-hosted Embedding and LLM Services

5 pointsby mkandler9 months ago

1 comment

mkandler9 months ago
This is an example of how to build a RAG app on FastAPI with vector embeddings and LLM inference broken out as separate services. Using Runhouse, those services can be hosted on your own infra (A10 GPU on your own AWS, for example).<p>Hoping that this is helpful for anyone considering ways to scale out components of a more complex RAG application.