rosenthalauto.com — AI Site Grade

Analysis

Akamai Firewall Blocks All AI Crawlers and Human Visitors Alike

Every AI crawler tested — GPTBot, ClaudeBot, PerplexityBot, Google-Extended, ChatGPT-User, OAI-SearchBot, Applebot-Extended, Bytespider, and anthropic-ai — receives a 403 Access Denied from AkamaiGHost on the homepage of rosenthalauto.com. No bot reaches any page content. No bot even reaches robots.txt. The entire domain is a black box to the AI ecosystem.

Crawler Access

The site sits behind Akamai's WAF (edgesuite.net), returning 403 for every user-agent tested, including a standard browser. The robots.txt file is inaccessible — it also returns 403. A historical Wayback snapshot from July 2024 shows the robots.txt explicitly blocked GPTBot with Disallow: /, but allowed Googlebot and other major crawlers with selective disallows. The current Akamai configuration has escalated that blocking to total denial of all HTTP traffic, making the robots.txt rules moot. No llms.txt exists. The sitemap at https://www.rosenthalauto.com/sitemap.xml also returns 403.

Cold-Knowledge Gap

LLM knowledge about Rosenthal Automotive Group is moderately detailed but entirely sourced from off-domain signals — the model describes a privately held dealership chain founded in 1954 by Robert M. Rosenthal, selling BMW, Audi, Honda, Mazda, and other brands across Virginia, Maryland, and D.C., with a philanthropic foundation and some BBB/Yelp complaints. This information comes from external directories, review sites, and news articles, not from the site itself. The site's actual content (visible only via Wayback snapshots) reveals a much larger operation than the LLM knows: the group sells 15+ brands including Acura, Porsche, Jaguar, Land Rover, Genesis, Hyundai, and Mazda across 10+ physical locations. The LLM also incorrectly lists Mercedes-Benz as a brand the group sells — it does not appear on the site.

Schema Posture

The Wayback snapshot of the homepage contains zero JSON-LD schema of any kind. No AutoDealer, Organization, LocalBusiness, or Product schema is present. The page uses a flat HTML structure with hundreds of H3 headings listing vehicle model names (e.g., "A5", "M4", "Civic", "Range Rover") but no structured data to tell AI crawlers these are inventory items. The meta description and title tag are present and descriptive, but without schema, AI models cannot reliably extract dealership locations, brand affiliations, or inventory details.

External Signals

Web search returns zero indexed results for "rosenthalauto.com" or "Rosenthal Automotive Group" across multiple queries. The site appears to have been deindexed from search engines entirely — a plausible consequence of the Akamai firewall blocking all crawlers. The Wayback Machine shows the site was live and returning 200 as recently as April 2025, meaning the Akamai lockdown is a recent and total blackout. The LLM's knowledge of customer complaints on BBB and Yelp suggests off-domain reputation signals persist, but the site itself contributes nothing to AI-generated brand descriptions.

Findings

1. Akamai WAF blocks all AI crawlers and human browsers High

   Every AI crawler tested receives a 403 Access Denied from AkamaiGHost. No bot reaches any page content, robots.txt, or sitemap. The entire domain is inaccessible to the AI ecosystem.

   What to change: Reconfigure the Akamai WAF to allow AI crawler user-agents (e.g., GPTBot, ClaudeBot, Google-Extended) and serve content to legitimate bots while maintaining security for other traffic.

2. Robots.txt is inaccessible and returns 403 High

   The robots.txt file at https://www.rosenthalauto.com/robots.txt returns a 403 error, making it impossible for crawlers to read crawl directives. A historical snapshot from July 2024 showed GPTBot was disallowed, but current configuration blocks all access.

   What to change: Make robots.txt publicly accessible and update it to allow AI crawlers that should index the site.

3. Sitemap returns 403 and is not discoverable High

   The sitemap at https://www.rosenthalauto.com/sitemap.xml returns a 403 error, preventing crawlers from discovering site structure and URLs.

   What to change: Make the sitemap publicly accessible and ensure it is listed in robots.txt.

4. No llms.txt file exists Medium

   The site does not provide an llms.txt file, which is a recommended way to guide AI crawlers to important content.

   What to change: Create an llms.txt file listing key pages for AI crawlers.

5. Homepage has zero JSON-LD structured data High

   The Wayback snapshot of the homepage contains no JSON-LD schema for AutoDealer, Organization, LocalBusiness, or Product. Without structured data, AI models cannot reliably extract dealership locations, brand affiliations, or inventory details.

   What to change: Add JSON-LD structured data for AutoDealer, Organization, LocalBusiness, and Product schema to all relevant pages.

6. Site is deindexed from search engines High

   Web searches for 'rosenthalauto.com' and 'Rosenthal Automotive Group' return zero results. The site appears to have been completely deindexed, likely due to the Akamai firewall blocking all crawlers.

   What to change: Allow search engine crawlers through the WAF and submit the site for reindexing via Google Search Console.

7. LLM knowledge omits many brands and locations Medium

   LLM knowledge about Rosenthal Automotive Group is limited to a few brands and locations, missing 15+ brands and 10+ physical locations visible on the site. The LLM also incorrectly lists Mercedes-Benz as a brand sold.

   What to change: Publish structured data and content that clearly lists all brands and locations to correct LLM knowledge.

8. Vehicle inventory lacks structured data Medium

   The homepage lists hundreds of vehicle model names as plain H3 headings with no structured data markup, preventing AI crawlers from understanding inventory items.

   What to change: Add Product or Vehicle schema markup to inventory listings.

9. All internal pages return 403 High

   Key pages like /dealerships.htm, /new-inventory/index.htm, and /rosenthal-auto-careers.htm all return 403 errors, making the entire site inaccessible.

   What to change: Allow access to these pages for legitimate crawlers and users.

10. No external backlinks or citations found Low

    Web searches for the brand on review sites, Reddit, and BBB returned zero results, indicating a lack of external signals that could help AI models discover the site.

    What to change: Build citations on reputable directories and review sites to improve off-domain signals.

What's working

• Homepage has descriptive meta title and description — The Wayback snapshot shows the homepage includes a descriptive title and meta description, which helps search engines and AI models understand the page topic.
• Historical robots.txt allowed Googlebot and other major crawlers — A July 2024 snapshot of robots.txt allowed Googlebot and other major crawlers with selective disallows, indicating prior intent to be indexed.
• Wayback Machine has recent snapshots of the site — The Wayback Machine has snapshots from as recently as April 2025, showing the site was live and accessible, providing a fallback for historical content.
• LLM has moderate knowledge of company background — LLMs know Rosenthal Automotive Group is a privately held dealership chain founded in 1954, with a philanthropic foundation, providing some baseline brand awareness.