Forum Moderators: Robert Charlton & goodroi

Message Too Old, No Replies

Google Explains what Went Wrong With its AI Wacky Answers

         

engine

7:23 am on May 31, 2024 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



Google decided to post an explanation over the most recent strange answers from it AI.

AI Overviews work very differently than chatbots and other LLM products that people may have tried out. They’re not simply generating an output based on training data. While AI Overviews are powered by a customized language model, the model is integrated with our core web ranking systems and designed to carry out traditional “search” tasks, like identifying relevant, high-quality results from our index. That’s why AI Overviews don’t just provide text output, but include relevant links so people can explore further. Because accuracy is paramount in Search, AI Overviews are built to only show information that is backed up by top web results.

This means that AI Overviews generally don't “hallucinate” or make things up in the ways that other LLM products might. When AI Overviews get it wrong, it’s usually for other reasons: misinterpreting queries, misinterpreting a nuance of language on the web, or not having a lot of great information available. (These are challenges that occur with other Search features too.)


[blog.google...]

superclown2

7:50 am on May 31, 2024 (gmt 0)



Yeah right. Absolutely.

I'll still ask Bob at the pub though.

aristotle

1:22 pm on May 31, 2024 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



or not having a lot of great information available.

If "a lot of great information" isn't available, then AI Overviews shouldn't be shown at all. Or maybe google's algorithm often can't distinguish between great information and poor information, or even dis-information.

This reflects a major problem with google's algorithm in that poor information on an "authority" site frequently ranks above good information on a small site.

superclown2

3:53 pm on May 31, 2024 (gmt 0)



Or maybe google's algorithm often can't distinguish between great information and poor information, or even dis-information.


It seems it can't. I've read reports of how there are lists of 'Things to do' then another list headed 'Things not to do' or some such, and G has treated then both the same.

Whoever called it 'Artificial Intelligence' was guilty of a certain terminological inexactitude. It would be funny if it wasn't so potentially catastrophic.

Whitey

12:43 am on Jun 1, 2024 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



I see that Google is claiming nonsensical queries will be filtered out:
Google addresses AI overview criticism and aims to improve accuracy.
Nonsensical queries will no longer trigger AI overviews.
Google still claims most users are satisfied with the feature.

[searchenginejournal.com...]