{"id":238601,"date":"2026-05-03T12:01:00","date_gmt":"2026-05-03T16:01:00","guid":{"rendered":"https:\/\/news-you-need.com\/index.php\/2026\/05\/03\/as-ai-shows-off-diagnostic-chops-scientists-reckon-with-the-way-forward\/"},"modified":"2026-05-03T12:30:07","modified_gmt":"2026-05-03T16:30:07","slug":"as-ai-shows-off-diagnostic-chops-scientists-reckon-with-the-way-forward","status":"publish","type":"post","link":"https:\/\/news-you-need.com\/index.php\/2026\/05\/03\/as-ai-shows-off-diagnostic-chops-scientists-reckon-with-the-way-forward\/","title":{"rendered":"As AI shows off diagnostic chops, scientists reckon with the way forward"},"content":{"rendered":"<p><a href=\"https:\/\/www.bostonglobe.com\/2026\/05\/03\/business\/ai-diagnosis-emergency-department-patients-hospital\/\">As AI shows off diagnostic chops, scientists reckon with the way forward<\/a><\/p>\n<p><a href=\"https:\/\/www.bostonglobe.com\/2026\/05\/03\/business\/ai-diagnosis-emergency-department-patients-hospital\/\">https:\/\/www.bostonglobe.com\/2026\/05\/03\/business\/ai-diagnosis-emergency-department-patients-hospital\/<\/a><\/p>\n<p>Publish Date: <a href=\"publish_date]\">2026-05-03 12:01:00<\/a><\/p>\n<p>Source Domain: <a href=\"www.bostonglobe.com\">www.bostonglobe.com<\/a><\/p>\n<p class=\"paragraph | gutter_20_0\"><span class=\"html-render\">But as generative AI tools like chatbots are heavily marketed \u2014 both to patients and clinicians \u2014 it makes him worried that the science experiments, all based on simulated and historical cases, will be misconstrued as proof of AI\u2019s safety and efficacy when used to treat real patients. <\/span><\/p>\n<p class=\"paragraph | gutter_20_0\"><span class=\"html-render\">\u201cI worry that my research agenda \u2014 which is not to replace doctors, not to get people to stop seeing their doctors and talk to their chatbots; my research agenda is to use a new type of technology to improve medical care \u2014 is going to get used by companies that are heavily financed and are looking to skip some of these essential safe pieces of medicine,\u201d said Rodman, an assistant professor of medicine at Beth Israel Deaconess Medical Center and visiting researcher at Google. \u201cYou can understand why I\u2019m reticent.\u201d That concern is mirrored by other clinical AI researchers who view the experiments\u2019 results with more skepticism.<\/span><\/p>\n<p class=\"paragraph | gutter_20_0\"><span class=\"html-render\">Since consumer-facing LLMs burst onto the scene in 2022, researchers have been chucking a variety of diagnostic tests their way. Multiple-choice medical licensing exams. Tricky case studies published in the New England Journal of Medicine. Models appeared to do well on most of them, but often without comparing their performance to large groups of physicians, said co-senior author Arjun Manrai. Their experiments, detailed in the Science paper, aimed to fill that gap by testing OpenAI\u2019s 2024 o1-preview, one of a new generation of so-called \u201creasoning\u201d models. <\/span><\/p>\n<p class=\"paragraph | gutter_20_0\"><span class=\"html-render\">\u201cWe were really trying to throw everything that we could at the model,\u201d said Manrai, an assistant professor of biomedical informatics at Harvard Medical School. They replicated a number of tests, some previously conducted on GPT-4, that measure an aspect of clinical reasoning against a baseline of performance from dozens of physicians.<\/span><\/p>\n<p class=\"paragraph | gutter_20_0\"><span class=\"html-render\">Most of those experiments spoon-fed structured, curated case studies to the LLM. But in a novel approach, the group \u2014 which includes some of&#8230;<\/span><\/p>\n<p><a href=\"https:\/\/www.bostonglobe.com\/2026\/05\/03\/business\/ai-diagnosis-emergency-department-patients-hospital\/\">Source<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>As AI shows off diagnostic chops, scientists reckon with the way forward https:\/\/www.bostonglobe.com\/2026\/05\/03\/business\/ai-diagnosis-emergency-department-patients-hospital\/ Publish Date:&#8230;<\/p>\n","protected":false},"author":1,"featured_media":238602,"comment_status":"closed","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"fifu_image_url":"https:\/\/bostonglobe-prod.cdn.arcpublishing.com\/resizer\/v2\/KKYQGLYNWO4ZLJBJ7N4CSBNGMM.jpg?auth=b5079d0813b6543405e530aca3909602d52c2ac3b4863369d1b56f8ad31681c2&width=1440","fifu_image_alt":"","footnotes":""},"categories":[14],"tags":[19,17],"class_list":["post-238601","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-artificial-intelligence","tag-generative-ai","tag-llm"],"_links":{"self":[{"href":"https:\/\/news-you-need.com\/index.php\/wp-json\/wp\/v2\/posts\/238601"}],"collection":[{"href":"https:\/\/news-you-need.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/news-you-need.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/news-you-need.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/news-you-need.com\/index.php\/wp-json\/wp\/v2\/comments?post=238601"}],"version-history":[{"count":1,"href":"https:\/\/news-you-need.com\/index.php\/wp-json\/wp\/v2\/posts\/238601\/revisions"}],"predecessor-version":[{"id":238603,"href":"https:\/\/news-you-need.com\/index.php\/wp-json\/wp\/v2\/posts\/238601\/revisions\/238603"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/news-you-need.com\/index.php\/wp-json\/wp\/v2\/media\/238602"}],"wp:attachment":[{"href":"https:\/\/news-you-need.com\/index.php\/wp-json\/wp\/v2\/media?parent=238601"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/news-you-need.com\/index.php\/wp-json\/wp\/v2\/categories?post=238601"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/news-you-need.com\/index.php\/wp-json\/wp\/v2\/tags?post=238601"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}