ResearchPUBMEDApr 3
Systematic benchmarking demonstrates large language models have not reached the diagnostic accuracy of traditional rare-disease decision support tools.
Researchers tested whether artificial intelligence chatbots like ChatGPT could diagnose rare genetic diseases by comparing them to a traditional diagnostic tool called Exomiser. They tested seven different AI models on over 5,000 real patient cases. The study found that even the best AI chatbots were not as accurate as the existing diagnostic tool at identifying the correct disease.
WHY IT MATTERSIf you're waiting for a diagnosis for a rare genetic disease, this research shows that AI chatbots alone shouldn't replace traditional diagnostic tools—your doctor should continue using proven methods alongside any new technology.
ℹ Good to knowRead →