{"id":229258,"date":"2026-03-30T12:00:00","date_gmt":"2026-03-30T16:00:00","guid":{"rendered":"https:\/\/news-you-need.com\/index.php\/2026\/03\/30\/there-are-more-ai-health-tools-than-ever-but-how-well-do-they-work\/"},"modified":"2026-03-30T13:10:22","modified_gmt":"2026-03-30T17:10:22","slug":"there-are-more-ai-health-tools-than-ever-but-how-well-do-they-work","status":"publish","type":"post","link":"https:\/\/news-you-need.com\/index.php\/2026\/03\/30\/there-are-more-ai-health-tools-than-ever-but-how-well-do-they-work\/","title":{"rendered":"There are more AI health tools than ever\u2014but how well do they work?"},"content":{"rendered":"

There are more AI health tools than ever\u2014but how well do they work?<\/a><\/p>\n

https:\/\/www.technologyreview.com\/2026\/03\/30\/1134795\/there-are-more-ai-health-tools-than-ever-but-how-well-do-they-work\/<\/a><\/p>\n

Publish Date: 2026-03-30 12:00:00<\/a><\/p>\n

Source Domain: www.technologyreview.com<\/a><\/p>\n

Singhal, the OpenAI health lead, notes that the company\u2019s current GPT-5 series of models, which had not yet been released when the original HealthBench study was conducted, do a much better job of soliciting additional information than their predecessors. However, OpenAI has reported that GPT-5.4, the current flagship, is actually worse at seeking context than GPT-5.2, an earlier version.<\/p>\n

Ideally, Bean says, health chatbots would be subjected to controlled tests with human users, as they were in his study, before being released to the public. That might be a heavy lift, particularly given how fast the AI world moves and how long human studies can take. Bean\u2019s own study used GPT-4o, which came out almost a year ago and is now outdated.\u00a0<\/p>\n

Earlier this month, Google released a study that meets Bean\u2019s standards. In the study, patients discussed medical concerns with the company\u2019s Articulate Medical Intelligence Explorer (AMIE), a medical LLM chatbot that is not yet available to the public, before meeting with a human physician. Overall, AMIE\u2019s diagnoses were just as accurate as physicians\u2019, and none of the conversations raised major safety concerns for researchers.\u00a0<\/p>\n

Despite the encouraging results, Google isn\u2019t planning to release AMIE anytime soon. \u201cWhile the research has advanced, there are significant limitations that must be addressed before real-world translation of systems for diagnosis and treatment, including further research into equity, fairness, and safety testing,\u201d wrote Alan Karthikesalingam, a research scientist at Google DeepMind, in an email. Google did recently reveal that Health100, a health platform it is building in partnership with CVS, will include an AI assistant powered by its flagship Gemini models, though that tool will presumably not be intended for diagnosis or treatment.<\/p>\n

Rodman, who led the AMIE study with Karthikesalingam, doesn\u2019t think such extensive, multiyear studies are necessarily the right approach for…<\/p>\n

Source<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"

There are more AI health tools than ever\u2014but how well do they work? https:\/\/www.technologyreview.com\/2026\/03\/30\/1134795\/there-are-more-ai-health-tools-than-ever-but-how-well-do-they-work\/ Publish…<\/p>\n","protected":false},"author":1,"featured_media":229259,"comment_status":"closed","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"fifu_image_url":"https:\/\/wp.technologyreview.com\/wp-content\/uploads\/2026\/03\/260326_AI_healthcare2.jpg?resize=1200,600","fifu_image_alt":"","footnotes":""},"categories":[14],"tags":[17],"class_list":["post-229258","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-artificial-intelligence","tag-llm"],"_links":{"self":[{"href":"https:\/\/news-you-need.com\/index.php\/wp-json\/wp\/v2\/posts\/229258"}],"collection":[{"href":"https:\/\/news-you-need.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/news-you-need.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/news-you-need.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/news-you-need.com\/index.php\/wp-json\/wp\/v2\/comments?post=229258"}],"version-history":[{"count":1,"href":"https:\/\/news-you-need.com\/index.php\/wp-json\/wp\/v2\/posts\/229258\/revisions"}],"predecessor-version":[{"id":229260,"href":"https:\/\/news-you-need.com\/index.php\/wp-json\/wp\/v2\/posts\/229258\/revisions\/229260"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/news-you-need.com\/index.php\/wp-json\/wp\/v2\/media\/229259"}],"wp:attachment":[{"href":"https:\/\/news-you-need.com\/index.php\/wp-json\/wp\/v2\/media?parent=229258"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/news-you-need.com\/index.php\/wp-json\/wp\/v2\/categories?post=229258"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/news-you-need.com\/index.php\/wp-json\/wp\/v2\/tags?post=229258"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}