"Serious Risks If Trusted"... Google's 'AI Overview' Gives Incorrect Health Advice

Inaccurate Information Displayed at the Top of Search Results
Google: "Continuously Improving Quality"

There have been reports that Google's artificial intelligence (AI) summary feature could provide incorrect health information, potentially putting people at risk.

On January 2 (local time), the British daily The Guardian reported that Google's 'AI Overview,' which appears at the top of search results, has been found to provide inaccurate health information, thereby threatening people's health. Google has emphasized that the 'AI Overview' feature, which uses generative AI to briefly present key information on specific topics or questions, is useful and reliable.

However, The Guardian's investigation found this was not the case. For example, Google advised pancreatic cancer patients to avoid high-fat foods. Experts pointed out that this is the exact opposite of what is recommended and could actually increase the risk of death. Anna Jewell, Head of Research and Support at the pancreatic cancer charity Pancreatic Cancer UK, explained, "If patients follow these search results as they are, it will be difficult for them to consume enough calories or gain weight," adding, "In such cases, they may not be able to withstand chemotherapy or life-saving surgery."

In addition, when searching for the normal range of liver blood tests, incorrect information was provided that could lead people with liver disease to mistakenly believe they are healthy. The results simply listed numerous figures with almost no explanation of the basis, and did not account for differences based on the patient's nationality, gender, race, or age. Pamela Healy, CEO of the liver disease charity British Liver Trust, noted, "It is dangerous because people with serious liver disease might think their test results are normal and may not seek follow-up care."

The Guardian reported that after several health organizations and medical experts raised concerns about inaccurate health information, it investigated Google's 'AI Overview' and confirmed many such cases. Sophie Randall, Director of the Patient Information Forum, which provides health information, stressed, "This case shows that Google's 'AI Overview' can place inaccurate health information at the top of online search results, potentially putting people's health at risk."

Google stated that most of the information provided by 'AI Overview' is fact-based and useful, and that it is continuously working to improve the quality of the feature.

A Google spokesperson explained that many of the cited examples were "incomplete screenshots," and added, "(AI Overview) is linked to well-known and reliable sources and encourages users to seek expert advice."