Visibility Is Not Truth
Why an LLM told a car dealer how to find honest experts, then admitted it lied — and what it means for every dealer betting on GEO and AEO.
Circular Sourcing
The model used an agency's own marketing claims as the reason to recommend that agency. Sales copy treated as evidence. No dealer would accept that from a vendor in person.
Credibility Theater
The model cited DealerRefresh forum posts, BBB ratings, and DealerRater pages as supporting evidence. When pressed, it admitted forum posts can be biased, anonymous, or planted. BBB is pay-to-play accreditation. DealerRater is a consumer car-buying review site with zero relevance to evaluating a marketing vendor. The model's own words: those sources "added credibility theater more than substance."
The Admission
After three follow-ups, the model said what it should have said first: "I don't have a verified, reliable way to answer your original question." It could not audit campaign results, confirm testimonials, or validate any of the credentials it had just presented as fact.
The honest answer took six messages to arrive. It was one sentence: call dealer principals you trust in non-competing markets and ask who runs their paid search.
The Consumer Problem
If this is how the model answered a dealer with 30 years of experience, how is it answering the consumer searching for "trustworthy dealership near me"?
The same way. Fragments assembled into something that reads like a recommendation. The consumer doesn't have the experience to push back. They take the answer.
The UGC Laundromat
How AI takes weak user-generated content and washes it into recommendations that sound authoritative.
UGC can be useful, but it is not an audit. It can be fake, bought, coached, planted by competitors, or outdated by years. AI makes it dangerous because a messy pile of reviews and vendor claims goes through the model and comes out as a clean recommendation. The model does not improve the evidence. It improves the packaging.
What the Machine Said About Itself
When I asked whether any formula drives its recommendations, the model said no. It listed factors it believed mattered and factors it believed didn't. Those are self-reported descriptions from a system that had already proven it will produce confident answers from weak foundations. Nobody outside the companies that built these systems can verify any of it.
When an expert says "AI systems prioritize schema markup," ask where that claim comes from. If the answer is "we prompted the model and observed the output," that is observation, not proof.
The Experts and the Pond
They stuck their fishing pole in the same stocked trout pond as the customer and think they caught a different fish. The pond was stocked with trout. What makes anyone think the trout on their line is something else?
"We are seeing that AI systems seem to favor clear entity information and crawlable content." That is a useful observation.
"This is how AI decides who to trust." That is a different claim entirely.
The first is about visibility. The second is about truth.
What a Dealer Should Do
This is not a reason to do nothing. The customer discovery layer is changing.
Make sure the public record reflects the real business. Inventory should be readable by machines. Reviews should be earned, not scripted. Data should be consistent everywhere. Do that work. It probably matters. But "probably matters" is the current state of knowledge. Anyone selling guarantees is outrunning their headlights.
When a vendor tells you they know how to win in AI search, ask how they know. Can you prove it? Can you repeat it? Can you show the method? Can you admit what you don't know?
The car business has always had people selling shortcuts. AI did not create that. It just gave the shortcuts better language.
A dealer who understands this has a chance to use the new tools without being used by them. A dealer who does not may end up paying someone to explain the pond while both of them are holding a trout, but the vendor insists his is a bass.