Reading this was very valuable. I really appreciate the Vespa mention and introduction to their Multi-Vector HNSW Indexing - I’ve recently thought a lot about how difficult chunking is and this seems like a promising avenue.
RAG is as valuable as the data you can retrieve.<p>If the amount of data is small you don't need the flexibility of RAG. And if it is irrelevant it will stay irrelevant after found.