"Can AI meaningfully help with bioweapons creation? On our new Virology Capabilities Test (VCT), frontier LLMs display the expert-level tacit knowledge needed to troubleshoot wet lab protocols."<p>OpenAI’s o3 now outperforms 94% of expert virologists."
-- thread by a co-author, <a href="https://x.com/DanHendrycks/status/1914696657813561799" rel="nofollow">https://x.com/DanHendrycks/status/1914696657813561799</a><p>Paper: Virology Capabilities Test (VCT): A Multimodal Virology Q&A Benchmark<p><a href="https://www.virologytest.ai/vct_paper.pdf" rel="nofollow">https://www.virologytest.ai/vct_paper.pdf</a>