Hi HN! OP here - this is our first open source project and we are really looking for your feedback about this direction, because we haven't seen something like aiconfig in generative AI developer tools yet.<p>Our basic premise is that AI application development should be config-based, so you can track the prompts, models and model parameters being used more rigorously. Having this AI artifact then lets you iterate on it separately from your application code, and also set up evals that provide "test coverage" for the gen AI parts of your application.<p>We were also inspired by the ipynb format for Jupyter notebooks, and you'll see parallels to that in the aiconfig format.<p>Please ask any questions, and share your thoughts on config vs. code.
I published <a href="https://www.prefab.cloud/blog/dynamic-config-for-openai-python/" rel="nofollow noreferrer">https://www.prefab.cloud/blog/dynamic-config-for-openai-pyth...</a> a few weeks ago as a way to do config of AI params like temperature, etc. But I've had a few people start using it for prompts as well and I really curious to see where it goes.<p>In particular for
1. teams that have complex slow deploys, but want to change prompt now
2. when there are data analyst types doing the prompts and people don't want them to be able to "break things".
3. being able to alpha test / rollout / target new prompts easily.<p>Definitely an interesting question whether prompts is code or configuration.
Well done. Now that I've seen your getting started video (<a href="https://aiconfig.lastmileai.dev/docs/getting-started" rel="nofollow noreferrer">https://aiconfig.lastmileai.dev/docs/getting-started</a>) this seems obvious. I feel really silly that I copy & paste from the browser back into a file just so I can save different prompts and results to see what I liked best. Thanks for sharing and for open sourcing!
I love this! Been working on something similar that uses containers and Jinja2 templates: <a href="https://github.com/kordless/SlothAI">https://github.com/kordless/SlothAI</a>. A demo is running at <a href="https://mitta.ai" rel="nofollow noreferrer">https://mitta.ai</a>. No docs yet and the auth system is getting an upgrade.