OpenAI's ChatGPT is backpage sex videosno closer to replacing your family physicians, as the increasingly advanced chatbot failed to accurately diagnose the vast majority of hypothetical pediatric cases.
The findings were part of a new study published in JAMA Pediatrics on Jan. 2, conducted by researchers from Cohen Children's Medical Center in New York. The researchers analyzed the bot's responses to requests for medical diagnosis of child illnesses and found that the bot had an 83 percent error rate across tests.
SEE ALSO: 5 ways AI changed the internet in 2023The study used what are known as pediatric case challenges, or medical cases originally posted to groups of physicians as learning opportunities (or diagnostic challenges) involving unusual or limited information. Researchers sampled 100 challenges published on JAMA Pediatrics and NEJM between the years 2013 and 2023.
ChatGPT provided incorrect diagnoses for 72 out of 100 of the experimental cases provided, and generated 11 answers that were deemed "clinically related" to the correct diagnosis but considered too broad to be correct.
This Tweet is currently unavailable. It might be loading or has been removed.
The researchers attribute part of this failure to the generative AI's inability to recognize relationships between certain conditions and external or preexisting circumstances, often used to help diagnose patients in a clinical setting. For example, ChatGPT did not connect "neuropsychiatric conditions" (such as autism) to commonly seen cases of vitamin deficiency and other restrictive-diet-based conditions.
The study concludes that ChatGPT needs continued training and involvement of medical professionals that feeds the AI not with an internet-generated well of information, which can often cycle in misinformation, but on vetted medical literature and expertise.
AI-based chatbots relying on Large Language Models (LLMs) have been previously studied for their efficacy in diagnosing medical cases and in accomplishing the daily tasks of physicians. Last year, researchers tested generative AI's ability to pass the three-part United States Medical Licensing Exam — It passed.
But while it's still highly criticized for its training limits and potential to exacerbate medical bias, many medical groups, including the American Medical Association, don't view the advancement of AI in the field just as a threat of replacement. Instead, better trained AI's are considered ripe for their administrative and communicative potential, like generating patient-side text, explaining diagnoses in common terms, or in generating instructions. Clinical uses, like diagnostics, remain a controversial, and hard to research, topic.
To that extent, the new report represents the first analysis of a chatbot's diagnostic potential in a purely pediatric setting — acknowledging the specialized medical training undertaken by medical professionals. Its current limitations show that even the most advanced chatbot on the public market can't yet compete with the full range of human expertise.
Topics Artificial Intelligence Social Good
Eddie Wu continues to lead Alibaba’s Cloud division in the recent adjustment · TechNodeByteDance to reduce stock in eZombie fires in the Arctic and the vicious cycle of climate changeTrash the PollsNothing to LearnHeytea removes coOpenAI nonprofit will retain control of the AI companyXpeng Motors initiates wide release of assisted driving software in 20+ cities · TechNodeHow to watch SpaceX launch its rescheduled crewed mission into spaceFoxconn and Pegatron halt iPhone production in southern India amid heavy rains · TechNode James Franco has a YouTube channel about philosophy because of course he does A wealthy human just purchased Trump's drawing of, uh, whatever that thing is Everyone is tweeting the Boy Scouts values after Trump turns jamboree into full In three tweets, Trump bans trans people from military service Send help. An 'unusually aggressive squirrel' is terrorizing Brooklyn. British politicians' official portraits get the inevitable caption treatment Donald Trump hovers over Melania during a speech as only Trump can Musician claps back at Ed Sheeran trolls, promises to play 'Shape of You' twice Vagina highlighter is yet another product to make women feel bad about their bodies Man's brand new Ferrari goes up in flames within an hour of purchasing it
0.4738s , 8444.6171875 kb
Copyright © 2025 Powered by 【backpage sex videos】ChatGPT is terrible at diagnosing child medical cases, according to new study,Feature Flash