Medical Question-Answer AI Model Evaluation Framework

I've worked with a few medical LLMs, and their depth of knowledge and holistic interactions (knowledge breadth) are absolutely incredible. My gut instinct is that this will help fill in the massive shortage of GP physicians (other examples: NPs, PAs), and perhaps heavily assist or replace pharmacologists.

This GitHub repo presents a framework to evaluate the accuracy performance of any medical-related AI models on a large scale.