As a platform engineer whose expertise is Kubernetes and Cloud, I am looking for AI tools/projects to learn/try. What projects are on your radar?<p>I guess many companies will need to run their own LLMs on their k8s clusters and we will see many projects in this area. I want to be early adopter and looking for new projects.
Have a look at Graphlit (<a href="https://www.graphlit.com" rel="nofollow noreferrer">https://www.graphlit.com</a>). Managed cloud-native platform for knowledge ingestion and retrieval. Simple GraphQL API, and serverless backend to handle all the data ingestion, embeddings, and RAG LLM patterns. Free tier to try out without CC. (Disclaimer: I'm the founder)
We're working on an open source chat gpt that runs on kubernetes. <a href="https://github.com/bionic-gpt/bionic-gpt">https://github.com/bionic-gpt/bionic-gpt</a><p>And you're right many companies are looking at running LLMs in house.