Artificial intelligence (AI) systems may outperform doctors at diagnosing patients. In a recent\u00a0series of experiments<\/a>\u00a0led by researchers at the Beth Israel Deaconess Medical Center and Harvard Medical School, a preview of the OpenAI large language model (LLM) known as o1 bested human physicians in multiple tests of clinical and diagnostic reasoning.<\/p>\n

“We tested the AI model against virtually every benchmark, and it eclipsed both prior models and our physician baselines,”\u00a0said<\/a>\u00a0Harvard Medical School professor Arjun K. Manrai, one of the study’s senior authors. Using case studies,\u00a0<\/em>the researchers had o1\u2014an older model since usurped by o3\u2014generate a list of possible diagnoses. It included the right diagnosis 78 percent of the time, while physicians were successful about 30 percent of the time.<\/p>\n

In another test, o1 was given five “clinical vignettes” drawn from real cases and asked about next steps. Two physicians judged its responses. The average score for o1 was 89 percent, compared to 34 percent for human doctors given the same test.<\/p>\n

The researchers also looked at o1’s abilities to diagnose emergency room cases, where clinical data might be lacking. “Overall, o1 outperformed both [an earlier LLM] and two expert attending physicians, as assessed by two other attending physicians who both were blinded to the source of the differential diagnosis,” notes the study, which was published on April 30 in\u00a0Science<\/em>. The LLM especially outperformed human doctors when it came to diagnosis at the initial, triage stage, identifying “the exact or very close diagnosis….in 67.1% of cases,” while the two human doctors did so in only 55.3 percent and 50 percent of cases, respectively.<\/p>\n

These results track with other recent research. AI-assisted mammograms could be better at detecting breast cancer, per a Swedish\u00a0study<\/a>\u00a0published by\u00a0The Lancet<\/em>\u00a0in January.<\/p>\n

Using abdominal C.T. scans from patients who were eventually diagnosed with pancreatic cancer, an AI model developed by the Mayo Clinic\u00a0detected<\/a>\u00a0this deadly disease an average of 475 days and up to three years earlier than clinicians did. “Attaining such early detection would substantially augment the probability of cure and improved survival,” researchers led by the Mayo Clinic’s Sovanlal Mukherjee\u00a0note<\/a>d in the medical journal\u00a0Gut<\/em>.<\/p>\n

Robo-docs are not likely to take over healthcare anytime soon. And “humans should be the ultimate baseline,” as Peter Brodeur, one of the authors of the Harvard study,\u00a0put it<\/a>\u00a0in a press release. But experiments like these suggest that AI models could competently assist in a variety of diagnostic and medical management contexts, and perhaps even produce better patient outcomes\u2014if we let them.<\/p>\n

Nevada now\u00a0bans<\/a>\u00a0AI systems from saying anything that “implicitly indicates” they are “capable of providing professional mental or behavioral health care” and from providing any service “that would constitute the practice of professional mental or behavioral health care.” An\u00a0Illinois law<\/a>\u00a0passed last year says AI cannot provide therapy services and therapists cannot use AI to “make independent therapeutic decisions” or “detect emotions or mental states.” Several states\u2014including\u00a0Ohio<\/a>,\u00a0California<\/a>,\u00a0Minnesota<\/a>, and\u00a0Kentucky<\/a>\u2014are considering similar laws. (At the same time, some state bills<\/a>\u00a0would<\/a>\u00a0mandate<\/a>\u00a0that AI chatbots be capable of detecting and responding to mental health issues.)<\/p>\n

Measures like these could hamper AI’s potential to diagnose diseases with more accuracy than human doctors alone can.<\/p>\n

The post AI Is Already Beating Human Doctors in Medical Tests<\/a> appeared first on Reason.com<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"

Robo-docs are not likely to take over healthcare anytime soon, but they could do more to assist human doctors\u2014if we let them. …<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"tdm_status":"","tdm_grid_status":"","footnotes":""},"categories":[15,19,9,161],"tags":[],"class_list":{"0":"post-129881","1":"post","2":"type-post","3":"status-publish","4":"format-standard","6":"category-health","7":"category-policy","8":"category-politics","9":"category-technology"},"_links":{"self":[{"href":"http:\/\/3rdcitynews.com\/news\/wp-json\/wp\/v2\/posts\/129881","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/3rdcitynews.com\/news\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/3rdcitynews.com\/news\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/3rdcitynews.com\/news\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/3rdcitynews.com\/news\/wp-json\/wp\/v2\/comments?post=129881"}],"version-history":[{"count":0,"href":"http:\/\/3rdcitynews.com\/news\/wp-json\/wp\/v2\/posts\/129881\/revisions"}],"wp:attachment":[{"href":"http:\/\/3rdcitynews.com\/news\/wp-json\/wp\/v2\/media?parent=129881"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/3rdcitynews.com\/news\/wp-json\/wp\/v2\/categories?post=129881"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/3rdcitynews.com\/news\/wp-json\/wp\/v2\/tags?post=129881"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}