Hi Hacker News!<p>We are researchers at Carnegie Mellon studying how data scientists evaluate their AI/ML systems.
For this study, we are interviewing data scientists at small companies/consultancies/non-profits to understand the major challenges and ideal solutions for better evaluating AI systems, especially beyond aggregate metrics like accuracy and F1 score.<p>The study will take up to an hour over Zoom and be compensated with a $20 Amazon gift card. If you're interested in participating please fill out this short form!<p>https://forms.gle/38ChADjgMoVpNi3V8