buyatbayird.com — AI Site Grade

Analysis

anthropic-ai Is the Only Crawler That Can See This Site

Every major AI crawler — GPTBot, Google-Extended, ClaudeBot, PerplexityBot, OAI-SearchBot, ChatGPT-User, Bytespider — receives a 403 Access Denied from the Akamai WAF on the homepage, robots.txt, and llms.txt. The sole exception is anthropic-ai, which gets a 200 with full HTML content (~390KB) served from an nginx backend. This creates a bizarre asymmetry: Claude's crawler can index the entire site, while OpenAI, Google, and Perplexity bots are locked out entirely.

Crawler Access

The robots.txt (only readable via anthropic-ai UA) explicitly blocks GPTBot, OAI-SearchBot, ChatGPT-User, Claude-User, and Claude-SearchBot from JS, CSS, JSON, and API paths — but does not block anthropic-ai at all. The Akamai WAF enforces the 403 at the network layer for all non-anthropic-ai user agents, including standard browsers. No llms.txt exists (returns 403 to all UAs). The sitemap.xml contains ~1,200+ URLs with daily/weekly update frequencies, but only anthropic-ai can read it.

Cold-Knowledge Gap

LLMs have zero prior knowledge of "buyatbayird.com" or "Bayird Auto Group." The model reports no awareness of the brand, its products, locations, or reputation. This is a complete knowledge vacuum despite the site being a multi-franchise dealer group with 10+ physical locations across Arkansas and Missouri (Paragould, Blytheville, Kennett, West Plains, Malden, Dexter, Jonesboro, West Memphis). The site has been on the web since at least 2013 (251 Wayback captures), yet no AI training corpus has indexed it meaningfully.

Content and Schema Posture

The homepage (via anthropic-ai) reveals a Dealer.com DDC platform running a multi-franchise operation: Ford, Chrysler, Dodge, Jeep, RAM, FIAT, plus RV and marine divisions. The title tag reads "New and Used Ford Chrysler Dodge Jeep and RAM Dealer Serving Arkansas and Missouri." The meta description on the contact page is a keyword-stuffed string of 200+ words with no coherent sentence structure. No JSON-LD schema of any kind was detected on any fetched page — no AutoDealer, Organization, LocalBusiness, or Product schema. The about page (/dealership/about.htm) exists and returns 200 to anthropic-ai but 403 to all others. The /about-us.htm and /locations.htm paths return 404.

External Signals

A web search for "Bayird Auto Group" across multiple queries returned zero results — no Google Business Profile listings, no Reddit threads, no news articles, no review sites, no press mentions. The domain's DNS points to Akamai (CDN) with nameservers at dealer.com. The Wayback Machine shows the site has been active since 2013, but the site has no detectable external citation footprint whatsoever. This total absence of off-domain signals means AI engines have no corroborating sources to validate or describe the brand.

Findings

1. Akamai WAF blocks all AI crawlers except anthropic-ai High

   The Akamai Web Application Firewall returns 403 Access Denied to GPTBot, Google-Extended, ClaudeBot, PerplexityBot, OAI-SearchBot, ChatGPT-User, and Bytespider. Only anthropic-ai receives a 200 response with full HTML content.

   What to change: Configure the Akamai WAF to allow access for all major AI crawler user agents, or implement a permissive robots.txt and remove the blanket 403 rule.

2. Robots.txt blocks GPTBot, OAI-SearchBot, and ChatGPT-User from key paths High

   The robots.txt file, only readable by anthropic-ai, explicitly disallows GPTBot, OAI-SearchBot, ChatGPT-User, Claude-User, and Claude-SearchBot from accessing JS, CSS, JSON, and API directories. This prevents these bots from rendering pages fully.

   What to change: Remove disallow rules for AI crawlers on JS, CSS, and JSON paths, or allow all bots to access these resources.

3. No llms.txt file available Medium

   The llms.txt file returns 403 to all user agents, meaning no AI crawler can retrieve a structured summary of the site's content.

   What to change: Create an llms.txt file that provides a concise overview of the site's inventory, locations, and services.

4. Zero external citations or search results for the brand High

   Web searches for 'Bayird Auto Group' and related queries returned no results. No Google Business Profile, reviews, news articles, or social media mentions were found. This complete absence of off-domain signals means AI engines have no corroborating sources.

   What to change: Build external citations by creating Google Business Profiles for each dealership, encouraging customer reviews, and publishing press releases or local news articles.

5. LLMs have no prior knowledge of the brand High

   The LLM knowledge base contains no information about buyatbayird.com or Bayird Auto Group. Despite the site existing since at least 2013, no AI training corpus has indexed the brand meaningfully.

   What to change: Improve AI visibility by allowing all crawlers, adding structured data, and building external citations to help AI models learn about the brand.

6. No JSON-LD schema detected on any page High

   No structured data markup (AutoDealer, Organization, LocalBusiness, Product) was found on the homepage, inventory pages, or contact page. This prevents AI crawlers from understanding the site's entities and relationships.

   What to change: Add JSON-LD structured data for AutoDealer, Organization, LocalBusiness, and Product (Vehicle) to all relevant pages.

7. Contact page meta description is keyword-stuffed and incoherent Medium

   The meta description on the contact page is a 200+ word string of keywords with no coherent sentence structure, which may harm search and AI readability.

   What to change: Rewrite the meta description as a clear, concise sentence summarizing the contact page content.

8. About-us and locations pages return 404 errors Medium

   The paths /about-us.htm and /locations.htm return 404 to anthropic-ai, while the correct about page is at /dealership/about.htm. This creates broken links and missing content.

   What to change: Redirect /about-us.htm and /locations.htm to the correct pages or create proper content at those paths.

9. Sitemap.xml is only accessible to anthropic-ai High

   The sitemap.xml (containing ~1,200+ URLs) returns 403 to all user agents except anthropic-ai, preventing other crawlers from discovering the site's pages.

   What to change: Allow all crawlers to access the sitemap.xml by removing the WAF restriction for that path.

10. Homepage returns 403 to standard browsers High

    The homepage returns 403 Access Denied to standard browser user agents, indicating the WAF blocks all traffic except anthropic-ai. This severely limits organic search and user access.

    What to change: Configure the WAF to allow standard browser traffic while maintaining security rules for malicious requests.

What's working

• Anthropic-ai crawler receives full HTML content — The anthropic-ai user agent is allowed through the WAF and receives complete HTML pages (~390KB) with inventory listings, contact info, and about content. This ensures Claude can index the site.
• Sitemap.xml contains over 1,200 URLs with update frequencies — The sitemap lists ~1,200+ URLs with daily and weekly update frequencies, providing a comprehensive map of the site's content for crawlers that can access it.
• Multi-franchise inventory is visible to anthropic-ai — The homepage and inventory pages list Ford, Chrysler, Dodge, Jeep, RAM, FIAT, RV, and marine vehicles, giving Claude a rich dataset of available products.
• About page exists with dealership information — The /dealership/about.htm page returns 200 to anthropic-ai and contains information about the dealership group, which helps Claude understand the business.
• Contact page is accessible to anthropic-ai — The contact page at /contact.htm returns 200 to anthropic-ai, providing phone numbers, address, and a contact form for Claude to index.
• Site has long Wayback Machine history since 2013 — The Wayback Machine has 251 captures of the site dating back to 2013, indicating a long-standing web presence that could be used for historical context.