Speaking of LoRA, what happened with ZipLoRA? It's supposed to be a better way of merging multiple LoRAs, and the results look good in their examples. Is it being used anywhere?<p><a href="https://ziplora.github.io/" rel="nofollow">https://ziplora.github.io/</a>
This is a bit of a misleading title. Why not use the original?<p>"Improving LoRA: Implementing Weight-Decomposed Low-Rank Adaptation (DoRA) from Scratch"<p>(If it's too long, just drop the "Improving LoRA: " part)