Research · Car dealerships
We tested 2,915 dealership websites. The problem is not robots.txt, it is bot protection.
By Cloute · Published October 1, 2026
The short answer
Cloute tested 2,915 car dealership websites across 58 US metros in October 2026. Only 0.3% block AI search crawlers such as OAI-SearchBot or PerplexityBot in robots.txt, and only 2.3% send a near-empty homepage to clients that do not run JavaScript. The bigger risk is bot protection: 29.5% of dealership sites (860) answered a plain automated request with a block or a bot challenge, which is how AI fetchers can be turned away before they read a single page.
of dealer sites refused or challenged an automated request
block AI search crawlers in robots.txt
send a near-empty homepage without JavaScript
Key findings
- Robots.txt is rarely the problem. 0.3% of dealer sites block any AI search or live-fetch crawler (OAI-SearchBot, ChatGPT-User, Claude-SearchBot, Claude-User, PerplexityBot, Perplexity-User) from the homepage. 2.2% block a training crawler such as GPTBot, ClaudeBot, Google-Extended or CCBot.
- Most dealer platforms render readable HTML. The median dealer homepage carried about 6,433 characters of readable text in the HTML the server sends. 2.3% sent fewer than 500 characters, which looks close to empty to a crawler that does not run JavaScript.
- Bot protection is the real risk. 860 of 2,915 sites (29.5%) answered our plain, script-free request with an HTTP 403 or 429 or a bot-challenge page. AI fetchers are also script-free clients. Whether they get through depends on how each site's firewall treats verified AI crawlers, a setting most dealers have never looked at.
- Dealer.com, Dealer Inspire and DealerOn sites that we could reach almost all served readable HTML: under 1% sent a near-empty homepage.
Results by website platform
| Platform | Sites reached | Near-empty homepage | Median readable text |
|---|---|---|---|
| Dealer.com | 702 | 0.6% | 6,751 characters |
| Dealer Inspire | 280 | 0% | 11,311 characters |
| DealerOn | 180 | 0% | 8,675 characters |
| WordPress | 125 | 1.6% | 5,222 characters |
| Team Velocity | 80 | 0% | 6,323 characters |
| Overfuel | 46 | 2.2% | 4,157 characters |
What a dealership should check
- Ask your website provider whether its bot protection or firewall allows verified AI crawlers: OAI-SearchBot and ChatGPT-User (OpenAI), Claude-SearchBot and Claude-User (Anthropic), PerplexityBot and Perplexity-User (Perplexity).
- Look at your robots.txt. If it disallows those crawlers, ChatGPT, Claude and Perplexity cannot use your pages in their answers.
- Open your server logs, or ask your provider for them, and search for ChatGPT-User. If it never appears, ChatGPT is not reading your site when buyers ask about you.
- Check that inventory, service and hours appear in the page source, not only after scripts run.
Why it matters
AI engines name the businesses they read. Across 64,441 AI answers about local businesses, a business was named 84% of the time when the engine had opened one of its own pages while answering, and 16% when it had not. A dealership whose site turns the engine away gives up that advantage to whichever competitor lets it in.
How the study was done
- Dealership websites were collected from Google Maps listings for new-car dealerships in 58 US metros, one site per unique domain: 2,915 sites.
- For each site we read robots.txt and evaluated whether the homepage is disallowed for each AI crawler token, using the most specific matching group.
- We requested each homepage once, identifying as an ordinary web browser, without running JavaScript, and measured the readable text in the HTML returned.
- We never sent requests pretending to be an AI crawler. Results for bot protection therefore describe how sites treat automated clients in general.
Limitations
- Some firewalls let verified AI crawlers through while blocking other automated traffic, so a refused request is a risk signal, not proof that a given AI engine is blocked.
- Only the homepage was tested. Inventory and service pages can behave differently.
- Google Maps results favour larger and better-reviewed dealerships in each metro.
Read next
AI visibility for car dealerships AI visibility statistics for car dealerships Should a business block AI crawlers?Questions people ask
Can ChatGPT read car dealership websites?
Usually the content is readable: only 2.3% of 2,915 dealer homepages were near-empty without JavaScript, and 0.3% block AI search crawlers in robots.txt. The larger risk is bot protection, which refused or challenged a plain automated request on 29.5% of dealer sites.
Do dealerships block AI crawlers?
Rarely on purpose. 0.3% block AI search crawlers in robots.txt and 2.2% block a training crawler. Blocking more often happens by accident, through firewall and bot-protection settings.
Which dealer website platform is best for AI visibility?
In this study, almost every reachable site on Dealer.com, Dealer Inspire and DealerOn served readable HTML (under 1% near-empty). Being readable is the starting point; whether AI recommends the store depends on what the engines read about it.
How to cite this research
Cloute (October 2026). Can AI read dealership websites? 2,915 dealer sites tested. https://cloute.ai/research/can-ai-read-dealership-websites
The underlying data is open under CC BY 4.0: github.com/luked9/cloute-ai-visibility-research.
About Cloute. Cloute is an AI visibility company for local businesses. It measures how often ChatGPT, Gemini, Claude, Perplexity and Google AI Overviews recommend a business against its local competitors, and works every month to move it to the top.