Google’s “AI Overview” can give false, misleading, and dangerous answers

Protect and strengthen democratic society today and for the future. Invest in AllSides
Protect and strengthen democratic society today and for the future. Invest in AllSides
Protect and strengthen democratic society today and for the future. Invest in AllSides

See How AllSides Rates Other Media Outlets

We have rated the bias of nearly 600 outlets and writers!
See some of the most popular below:

Want to see more?
Check out the AllSides Media Bias Chart, or go to our Media Bias Ratings page to see everything.

See How AllSides Rates Other Media Outlets

We have rated the bias of nearly 600 outlets and writers!
See some of the most popular below:

Want to see more?
Check out the AllSides Media Bias Chart, or go to our Media Bias Ratings page to see everything.

See How AllSides Rates Other Media Outlets

We have rated the bias of nearly 600 outlets and writers!
See some of the most popular below:

Want to see more?
Check out the AllSides Media Bias Chart, or go to our Media Bias Ratings page to see everything.

Invest in

Invest in

Invest in

What America Do We Want to Be?

Join Living Room Conversations, our civil dialogue partner, and America Indivisible for a nationwide conversation on April 13, Thomas Jefferson’s 276th birthday. "Reckoning with Jefferson: A Nationwide Conversation on Race, Religion, and the America We Want to Be" will be held via in-person and online video discussions. Sign up today!

What America Do We Want to Be?

Join Living Room Conversations, our civil dialogue partner, and America Indivisible for a nationwide conversation on April 13, Thomas Jefferson’s 276th birthday. "Reckoning with Jefferson: A Nationwide Conversation on Race, Religion, and the America We Want to Be" will be held via in-person and online video discussions. Sign up today!

What America Do We Want to Be?

Join Living Room Conversations, our civil dialogue partner, and America Indivisible for a nationwide conversation on April 13, Thomas Jefferson’s 276th birthday. "Reckoning with Jefferson: A Nationwide Conversation on Race, Religion, and the America We Want to Be" will be held via in-person and online video discussions. Sign up today!

Practical, engaging webinars designed to transform how you approach current events and facilitate productive classroom discussions.

The Art of Discussion - Civic Learning Week

Wednesday March 12, 2025 | 6:00 PM Eastern Time

Learn how to facilitate respectful dialogue across political and social divides using Mismatch, our platform for connecting students with diverse viewpoints.

Register for the webinar PD Benefits Page
 

Practical, engaging webinars designed to transform how you approach current events and facilitate productive classroom discussions.

The Art of Discussion - Civic Learning Week

Wednesday March 12, 2025 | 6:00 PM Eastern Time

Learn how to facilitate respectful dialogue across political and social divides using Mismatch, our platform for connecting students with diverse viewpoints.

Register for the webinar PD Benefits Page
 

Practical, engaging webinars designed to transform how you approach current events and facilitate productive classroom discussions.

The Art of Discussion - Civic Learning Week

Wednesday March 12, 2025 | 6:00 PM Eastern Time

Learn how to facilitate respectful dialogue across political and social divides using Mismatch, our platform for connecting students with diverse viewpoints.

Register for the webinar PD Benefits Page
 

See How AllSides Rates Other Media Outlets

We have rated the bias of nearly 600 outlets and writers!

See some of the most popular below:

Want to see more?

Check out the AllSides Media Bias Chart, or go to our Media Bias Ratings page to see everything.

See How AllSides Rates Other Media Outlets

We have rated the bias of nearly 600 outlets and writers!

See some of the most popular below:

Want to see more?

Check out the AllSides Media Bias Chart, or go to our Media Bias Ratings page to see everything.

See How AllSides Rates Other Media Outlets

We have rated the bias of nearly 600 outlets and writers!

See some of the most popular below:

Want to see more?

Check out the AllSides Media Bias Chart, or go to our Media Bias Ratings page to see everything.

 

 

 

Support AllSides

Please consider becoming a sustaining member or making a one-time donation to help keep AllSides online.

Become a Sustaining Member

Make a one-time donation.

Support AllSides

Please consider becoming a sustaining member or making a one-time donation to help keep AllSides online.

Become a Sustaining Member

Make a one-time donation.

Support AllSides

Please consider becoming a sustaining member or making a one-time donation to help keep AllSides online.

Become a Sustaining Member

Make a one-time donation.

https://arstechnica.com/information-technology/2024/05/googles-ai-overview-can-…
Headline Roundup
Type of Content
Approved Story
1
Format
Region
News Item Format
Standard
Image Caption
Getty Images
Autocurated
0

If you use Google regularly, you may have noticed the company's new AI Overviews providing summarized answers to some of your questions in recent days. If you use social media regularly, you may have come across many examples of those AI Overviews being hilariously or even dangerously wrong.

Factual errors can pop up in existing LLM chatbots as well, of course. But the potential damage that can be caused by AI inaccuracy gets multiplied when those errors appear atop the ultra-valuable web real estate of the Google search results page.

"The examples we've seen are generally very uncommon queries and aren’t representative of most people’s experiences," a Google spokesperson told Ars. "The vast majority of AI Overviews provide high quality information, with links to dig deeper on the web."

After looking through dozens of examples of Google AI Overview mistakes (and replicating many ourselves for the galleries below), we've noticed a few broad categories of errors that seemed to show up again and again. Consider this a crash course in some of the current weak points of Google's AI Overviews and a look at areas of concern for the company to improve as the system continues to roll out.