Hey! I worked on this and it's great to see it being shared. Check out the blog post explaining more about the project <a href="https://predibase.com/blog/lorax-the-open-source-framework-for-serving-100s-of-fine-tuned-llms-in" rel="nofollow noreferrer">https://predibase.com/blog/lorax-the-open-source-framework-f...</a>