科技回声

Hey yall,Very early release but wanted to get the idea out there.Waffie is built for developers looking to operationalize LLM APIs into their solutions.The first thing I'm tackling is automated testing of LLMs in the context of unstructured to structured data interpretation. For example, sentiment analysis.Specify what you want in a YAML file and a test.csv and run waffie against your test cases.Looking to bridge the gaps between software development and machine learning engineering.

One thing that could help:Add to the top of the readme something that basically shows "put in this / do this" and "get this"Kind of like a before and after.Basically, I'd recommend exposing 2-3 of the examples on the readme, otherwise the readme just shows how to run it, which doesn't show what it does / what it's for.

Show HN: Waffie, an LLM API automated testing tool

1 comment

Show HN: Waffie, an LLM API automated testing tool

1 comment