Google’s AI Overviews and AI Mode and OpenAI’s ChatGPT usually give shoppers completely different model suggestions – a possible warning signal for entrepreneurs chasing AI visibility – in keeping with a brand new BrightEdge evaluation.
The massive image. ChatGPT and Google’s AI Mode and AI Overviews disagreed on model suggestions almost two-thirds of the time (61.9%), in keeping with BrightEdge’s evaluation of tens of hundreds of similar prompts.
By the numbers. Simply 33.5% of queries included manufacturers throughout all three platforms, and solely 4.6% had no manufacturers talked about wherever. Different key findings:
Google AI Overviews dominate: Google’s AI Overviews surfaced manufacturers in 36.8% of queries, whereas ChatGPT led in simply 3.9%.
Model density: Google AI Overviews averaged 6.02 manufacturers per question, greater than 2.5x greater than ChatGPT’s 2.37 and much forward of AI Mode’s 1.59.
Silence charges: ChatGPT supplied no model mentions in 43.4% of queries. Google AI Mode stayed silent 46.8% of the time, in comparison with simply 9.1% for AIO.
The quotation paradox. The examine additionally uncovered stark variations in quotation conduct:
ChatGPT mentions greater than it cites, with 3.2x extra model mentions (2.37) than citations (0.73).
Google AI Overviews cites way over it mentions (14.30 citations vs. 6.02 mentions).
Google AI Mode exhibits a fair greater hole — 6x extra citations than mentions (9.49 vs. 1.59).
This information might recommend that ChatGPT’s responses lean closely on its coaching patterns, whereas Google emphasizes seen supply attribution.
The place platforms align. The uncommon moments of brand name alignment trusted question intent:
Evaluate queries: 80% same-brand settlement.
Purchase queries: 62%.
The place queries: 38%.
Finest queries: 23%.
Trade breakdown. Disagreement charges additionally various by sector:
Healthcare: 68.5%
Schooling: 62.1%
B2B Tech: 61.7%
Finance: 57.9%
Ecommerce: 57.1% (lowest)
Why we care. For manufacturers, these findings spotlight a unstable AI panorama the place visibility is much from assured – and sometimes inconsistent. As BrightEdge notes, the fragmentation creates “huge untapped visibility alternatives” for firms optimizing for generative search.
The report. ChatGPT vs Google AI: 62% Model Advice Disagreement
Search Engine Land is owned by Semrush. We stay dedicated to offering high-quality protection of selling matters. Until in any other case famous, this web page’s content material was written by both an worker or a paid contractor of Semrush Inc.
Danny Goodwin is Editorial Director of Search Engine Land & Search Advertising and marketing Expo – SMX. He joined Search Engine Land in 2022 as Senior Editor. Along with reporting on the newest search advertising and marketing information, he manages Search Engine Land’s SME (Topic Matter Skilled) program. He additionally helps program U.S. SMX occasions. Goodwin has been enhancing and writing in regards to the newest developments and tendencies in search and digital advertising and marketing since 2007. He beforehand was Govt Editor of Search Engine Journal (from 2017 to 2022), managing editor of Momentology (from 2014-2016) and editor of Search Engine Watch (from 2007 to 2014). He has spoken at many main search conferences and digital occasions, and has been sourced for his experience by a variety of publications and podcasts.