condorcycles.com — AI Site Grade

Analysis

Condor Cycles — AI-Visibility Audit

The site's robots.txt and llms.txt are Shopify-generated, forward-leaning AI commerce documents, yet every sub-page beyond the homepage returns a Cloudflare JS challenge wall to all crawlers, making the entire product catalog, blog, and build-your-bike tool invisible to AI engines.

Crawler Access

The homepage at condorcycles.com (non-www) returns 200 with full content to GPTBot, ClaudeBot, PerplexityBot, Google-Extended, and all other AI crawlers — the Cloudflare challenge is bypassed on this single URL. However, every other page tested (/products/condor-fratello-disc-frameset, /pages/build-your-bike, /pages/the-condor-way, /pages/trustpilot-reviews, /agents.md) returns 403 with a JS challenge wall for every bot and browser alike. The www.condorcycles.com subdomain also 403s on the homepage. This means AI crawlers can index exactly one page: the homepage. The 250+ blog articles, 36 framesets, and all product pages are unreachable.

Cold-Knowledge Gap

The LLM prior knows Condor Cycles as a family-run London frame builder since 1948, famous for custom steel frames, the Gray's Inn Road shop, and supplying the British national team in the 1950s-60s. The actual site barely tells this story. The homepage mentions "Established 1948" and "Handmade in Italy, built for you in London" but the /pages/history-of-condor URL returns a 404. The brand's most compelling narrative — Monty Young, pop stars, Olympians, royalty — is referenced only in a text excerpt on the homepage, not on a dedicated page. The LLM knows more about Condor's heritage than the site itself publishes.

Schema Posture

The homepage carries Organization and WebSite JSON-LD with correct contact info (+442072696820), social links (Twitter, Facebook, Pinterest, Instagram, YouTube), and a SearchAction potential action. No Product schema appears on the homepage or collection page, despite 36 framesets being listed. No BreadcrumbList, Article, or FAQPage schema anywhere. The blog/journal has no BlogPosting markup. For a Shopify store, the schema is minimal — Shopify's default Product schema is absent from the pages that were fetchable.

External Signals

The site references Trustpilot prominently (footer link, product cards) but the /pages/trustpilot-reviews page is behind the Cloudflare wall. The footer links to support.condorcycles.com (a separate subdomain) for delivery, returns, and warranty — this knowledge base is entirely off the main domain and was not tested. Social profiles link to Twitter/X, Facebook, Pinterest, Instagram, and YouTube, providing off-domain signals that AI engines can use to triangulate brand reputation.

Surprising Findings

The robots.txt is a Shopify-generated AI-commerce document that references UCP/MCP endpoints, an agents.md file, and a shopping skill — yet the agents.md file itself is behind the Cloudflare wall, making it inaccessible to the very agents it was written for. The llms.txt (at /llms.txt) is actually a full agent instructions document (4314 bytes) with UCP discovery endpoints, product JSON paths, and policy URLs — a sophisticated AI-commerce setup that is functionally neutered because every endpoint it references (except the homepage) is blocked by Cloudflare's JS challenge. The site has a sitemap_agentic_discovery.xml sub-sitemap alongside standard product, page, collection, and blog sitemaps, plus German and US locale variants — a mature sitemap structure that crawlers cannot reach.

Findings

1. Cloudflare JS challenge blocks AI crawlers from all sub-pages High

   Every sub-page tested (product, build-your-bike, trustpilot-reviews, agents.md) returns 403 with a JS challenge wall to all AI crawlers. Only the non-www homepage is accessible. This renders the entire product catalog, blog, and tool pages invisible to AI engines.

   What to change: Configure Cloudflare to bypass JS challenge for known AI crawler user agents (GPTBot, ClaudeBot, etc.) on all sub-pages, or serve static HTML versions to those bots.

2. History page returns 404, missing key brand narrative Medium

   The URL /pages/history-of-condor returns a 404 error. The brand's rich heritage (founded 1948, custom frames, Olympic history) is only briefly mentioned on the homepage, leaving AI engines without a dedicated authoritative source for this compelling story.

   What to change: Restore or recreate the history page with detailed brand narrative, including key milestones and notable customers.

3. agents.md file is blocked by Cloudflare challenge High

   The agents.md file, referenced in robots.txt for AI agent discovery, returns 403 with a JS challenge wall, making it inaccessible to the very agents it was designed for.

   What to change: Ensure agents.md is publicly accessible without JS challenge, or serve it via a static endpoint.

4. llms.txt file is blocked by Cloudflare challenge High

   The llms.txt file, which contains agent instructions and UCP endpoints, returns 403 with a JS challenge wall, preventing AI agents from reading it.

   What to change: Ensure llms.txt is publicly accessible without JS challenge.

5. Sitemap XML files are blocked by Cloudflare challenge High

   The sitemap.xml and agentic discovery sitemap return 403 with a JS challenge wall, preventing crawlers from discovering the site's URL structure.

   What to change: Ensure sitemap XML files are publicly accessible without JS challenge.

6. No Product schema on homepage or collection pages Medium

   The homepage and collection page lack Product JSON-LD schema, despite listing 36 framesets. Shopify's default Product schema is absent from fetchable pages, reducing structured data signals for AI engines.

   What to change: Add Product schema markup to all product and collection pages, including price, availability, and description.

7. Blog posts lack BlogPosting schema Medium

   The journal/blog page has no BlogPosting or Article schema markup, reducing the discoverability of blog content in AI knowledge graphs.

   What to change: Add BlogPosting schema to each blog article page.

8. No BreadcrumbList schema on any page Low

   No BreadcrumbList schema was found on the homepage or collection page, which helps AI engines understand site hierarchy.

   What to change: Add BreadcrumbList schema to all navigable pages.

9. Trustpilot reviews page is blocked by Cloudflare challenge Medium

   The /pages/trustpilot-reviews page returns 403 with a JS challenge wall, preventing AI crawlers from accessing social proof and review content.

   What to change: Allow Trustpilot reviews page to be accessible to AI crawlers, or embed review snippets on a public page.

10. Product detail pages are blocked by Cloudflare challenge High

    Product pages like /products/condor-fratello-disc-frameset return 403 with a JS challenge wall, preventing AI crawlers from indexing product details, pricing, and descriptions.

    What to change: Allow product pages to be accessible to AI crawlers by bypassing JS challenge for known bot user agents.

11. Build-your-bike tool page is blocked by Cloudflare challenge Medium

    The /pages/build-your-bike page returns 403 with a JS challenge wall, preventing AI crawlers from accessing this interactive tool.

    What to change: Allow the build-your-bike page to be accessible to AI crawlers, or provide a static summary page.

12. www subdomain homepage is blocked by Cloudflare challenge Medium

    The www.condorcycles.com homepage returns 403 with a JS challenge wall, while the non-www version is accessible. This inconsistency may confuse crawlers and split signals.

    What to change: Redirect www to non-www or ensure both are accessible to crawlers consistently.

What's working

• Homepage is accessible to all AI crawlers with full content — The non-www homepage returns 200 with full HTML content to GPTBot, ClaudeBot, PerplexityBot, and all other tested AI crawlers, providing a baseline indexable page.
• Organization and WebSite schema present on homepage — The homepage includes Organization and WebSite JSON-LD with correct contact info, social links, and SearchAction, providing foundational structured data.
• robots.txt is a forward-leaning AI-commerce document — The robots.txt references UCP/MCP endpoints, agents.md, and a shopping skill, indicating awareness of AI agent integration.
• llms.txt contains comprehensive agent instructions — The llms.txt file (4314 bytes) includes UCP discovery endpoints, product JSON paths, and policy URLs, demonstrating a sophisticated AI-commerce setup.
• Agentic discovery sitemap and locale variants exist — The site has a sitemap_agentic_discovery.xml sub-sitemap alongside standard sitemaps, plus German and US locale variants, indicating mature sitemap structure.
• Social media profiles linked on homepage — The homepage links to Twitter/X, Facebook, Pinterest, Instagram, and YouTube, providing off-domain signals for brand reputation.
• Trustpilot reviews referenced on homepage and product cards — Trustpilot is prominently referenced in the footer and product cards, indicating social proof, though the dedicated page is blocked.
• Support subdomain exists for delivery, returns, warranty — The footer links to support.condorcycles.com for customer service content, providing a separate knowledge base.