With the pandemic acting as an accelerant, the healthcare industry is embracing AI enthusiastically. According to a 2020 survey by Optum, 80% of healthcare organizations have an AI strategy in place, while another 15% are planning to launch one.
Vendors — including Big Tech companies — are rising to meet the demand. Google recently unveiled Med-PaLM 2, an AI model designed to answer medical questions and find insights in medical texts. Elsewhere, startups like Hippocratic and OpenEvidence are developing models to offer actionable advice to clinicians in the field.
But as more models tuned to medical use cases come to market, it’s becoming increasingly challenging to know which models — if any — perform as advertised. Because medical models ar...