bobjohnsonimports.com — AI Site Grade

Analysis

The site is entirely invisible to the open web and most major AI crawlers, yet selectively readable by three specific OpenAI and Perplexity bots — a bifurcated access pattern that creates a narrow, privileged AI-knowledge pipeline while locking out Google, Claude, and all human visitors.

Crawler Access

The homepage at bobjohnsonimports.com returns HTTP 403 for every standard browser and for GPTBot, ClaudeBot, Google-Extended, PerplexityBot, and Applebot-Extended. All are served a Cloudflare "blocked" page with noindex, nofollow. The robots.txt and llms.txt endpoints also 403. However, ChatGPT-User, OAI-SearchBot, and Perplexity-User each receive HTTP 200 with ~200KB of full HTML content — the site is a multi-brand auto dealership in Rochester, NY selling Alfa Romeo, INFINITI, Kia, Lexus, Maserati, MINI, Nissan, Toyota, and Volkswagen. This selective whitelisting means only OpenAI's and Perplexity's user-facing assistant bots see the real site; their crawler counterparts (GPTBot, PerplexityBot) are blocked. The site runs on Cloudflare with DNS pointing to Cloudflare IPs and no MX or TXT records.

Cold-Knowledge Gap

The LLM queried cold on "Bob Johnson Imports" returned zero verifiable information — no industry, no location, no products, no reputation signals. The model described it as "a small-to-medium import business" and could not identify it as a car dealership. This is a complete knowledge vacuum despite the site being a large multi-franchise dealer with nine brands. The gap between what the site actually is (a major Rochester-area auto group) and what AI models know about it (nothing) is total.

Content and Schema Posture

The homepage title and meta description list nine automotive brands and position the dealer near Rochester and Buffalo. The page is served via dealereprocess.org infrastructure (visible in the Cloudflare error page's subheadline), indicating a third-party dealer management platform. No JSON-LD schema of any kind was detected on the homepage — no AutoDealer, LocalBusiness, Product, or Review markup. The page carries no FAQ, comparison tables, or structured answer signals. The meta keywords tag is present but bloated with generic terms.

External Signals

No external mentions exist anywhere in the open web. Searches for the brand name, domain, and location returned zero results across all queries. No reviews, no Reddit threads, no press coverage, no Google Maps listings surfaced. The site has no Wayback Machine snapshots. The domain is effectively air-gapped from the public internet — only the three whitelisted AI bots can see it, and no human or search engine can reach it to create off-domain signals. The brand has no digital footprint beyond its own walled-off homepage.

Findings

1. Complete web invisibility: no external mentions, no search results, no backlinks High

   The brand has zero digital footprint beyond its own homepage. Searches for the domain, brand name, and location returned no results across all queries. No reviews, no press, no Google Maps listings, no Wayback Machine snapshots exist.

   What to change: Build an off-site presence through local SEO, Google Business Profile, social media, and press releases. Encourage customer reviews on third-party platforms.

2. Bifurcated crawler access: only ChatGPT-User, OAI-SearchBot, and Perplexity-User allowed High

   The homepage returns HTTP 403 for all standard browsers and most AI crawlers (GPTBot, ClaudeBot, Google-Extended, PerplexityBot, Applebot-Extended), but returns HTTP 200 with full HTML for ChatGPT-User, OAI-SearchBot, and Perplexity-User. This selective whitelisting creates a narrow AI-knowledge pipeline.

   What to change: Remove the Cloudflare WAF rules that block standard browsers and most AI crawlers. Allow GPTBot, Google-Extended, ClaudeBot, and other major crawlers to access the site.

3. Robots.txt and llms.txt endpoints return 403 High

   The robots.txt and llms.txt files are inaccessible, returning HTTP 403. This prevents crawlers from discovering allowed paths and AI-specific instructions.

   What to change: Serve a valid robots.txt that allows major crawlers and an llms.txt that describes the site's AI-relevant content.

4. No JSON-LD schema on homepage High

   The homepage lacks any structured data markup, including AutoDealer, LocalBusiness, Product, or Review schema. This prevents AI models from understanding the site's business type, inventory, and location.

   What to change: Add JSON-LD structured data for AutoDealer, LocalBusiness, and Product (for each vehicle brand). Include schema for inventory, reviews, and location.

5. Cold knowledge vacuum: LLM has zero verifiable information about the brand High

   When queried cold, the LLM returned no verifiable information about Bob Johnson Imports, describing it as 'a small-to-medium import business' and failing to identify it as a multi-brand car dealership. This is a complete knowledge gap despite the site being a large dealer group.

   What to change: Improve AI visibility by allowing crawlers, adding schema, and building external signals. Consider submitting the site to AI knowledge bases.

6. Sitemap returns 403, no URLs discoverable High

   The sitemap endpoint returns HTTP 403, preventing crawlers from discovering the site's pages. No URLs were found via sitemap or other discovery methods.

   What to change: Serve a valid sitemap.xml listing all important pages, and ensure it is accessible to crawlers.

7. No external mentions anywhere on the open web High

   Searches for the brand name, domain, and location returned zero results across all queries. No reviews, Reddit threads, press coverage, or Google Maps listings were found.

   What to change: Create a Google Business Profile, encourage customer reviews, and engage in local SEO to generate off-domain signals.

8. Cloudflare blocks all human visitors with 403 High

   Standard browser requests to the homepage return HTTP 403 with a Cloudflare 'Attention Required!' page. This means no human can access the site, and search engine crawlers (except the three whitelisted bots) are also blocked.

   What to change: Remove the Cloudflare WAF rules that block standard browsers. Allow all legitimate traffic.

9. No Wayback Machine snapshots exist Medium

   The domain has no historical snapshots in the Wayback Machine, indicating it has never been publicly accessible or archived.

   What to change: Ensure the site is publicly accessible so that it can be archived by the Wayback Machine and other services.

10. Bloated meta keywords tag with generic terms Low

    The homepage includes a meta keywords tag filled with generic terms, which is not useful for AI understanding and may be seen as spammy.

    What to change: Remove the meta keywords tag or replace it with a concise set of relevant terms.

What's working

• Selective AI bot access allows three key bots to see full content — ChatGPT-User, OAI-SearchBot, and Perplexity-User receive HTTP 200 with full HTML content, enabling OpenAI and Perplexity assistant models to access the site's information.
• Homepage title and meta description list nine automotive brands — The homepage clearly communicates that the dealership sells Alfa Romeo, INFINITI, Kia, Lexus, Maserati, MINI, Nissan, Toyota, and Volkswagen, providing useful context for AI models that can access the page.
• Cloudflare DDoS protection in place — The site uses Cloudflare for security, which helps protect against DDoS attacks and other threats.