Just finished the first draft of my weekend project. Sadly my industry is far away from all the exciting machine learning developments happening right now, so I wrote this project as my first exploration into the world of LLMs. It's not perfect, but I'm excited to see where the project goes from here!<p><a href="https://github.com/clarkmcc/chitchat">https://github.com/clarkmcc/chitchat</a><p>My main motivations were:<p>- Easy-of-use: Many models are supported out-of-the-box so users don't have to figure out how to download, where to save, etc.<p>- Intuitive: A clean interface<p>- Cross platform: The project is written in Rust and cross-compiled to other platforms. You don't have to have Python or the C++ toolchain installed to use.<p>- Chat-based experience: Model sessions are persisted so the model is contextually aware of your conversation.