I wonder how far you can push RAG and it's comparison to methods like LoRA<p><a href="https://github.com/microsoft/LoRA">https://github.com/microsoft/LoRA</a><p>It seems like you can only get so far with a sophisticated prompt engineering framework like RAG. but I dunno, I haven't tested them against each other.