Providing tens of millions of incorrect answers per hour, the accuracy of Google's search "AI overview" based on Gemini 3 is only 91%.

robot
Abstract generation in progress

BlockBeats News, May 5, according to a report by The New York Times, AI startup Oumi analyzed Google’s “AI Overview” feature. The feature’s accuracy is roughly 90%, and since Google processes more than 5 trillion searches every year, this means it provides tens of millions of wrong answers every hour (or hundreds of thousands of inaccurate pieces of information every minute).

Oumi used the SimpleQA benchmark to analyze the results of Google’s “AI Overview.” The analysis showed that with Gemini 2, 85% of the results are accurate; with Gemini 3, that figure rises to 91%.

During the analysis, among the 5,380 sources cited by Google’s AI Overview, Oumi found that Facebook and Reddit are the second and fourth most frequently referenced sources, respectively. When Google’s AI Overview is accurate, Facebook is cited in 5% of cases; when it is inaccurate, Facebook is cited in 7% of cases.

View Original
This page may contain third-party content, which is provided for information purposes only (not representations/warranties) and should not be considered as an endorsement of its views by Gate, nor as financial or professional advice. See Disclaimer for details.
  • Reward
  • Comment
  • Repost
  • Share
Comment
Add a comment
Add a comment
No comments
  • Pin