mcri.edu.au — AI Site Grade

Analysis

Cloudflare JS-challenge wall blocks every AI crawler and browser from mcri.edu.au

The entire mcri.edu.au domain — homepage, every subpage, and the sitemap — returns HTTP 403 with a Cloudflare JavaScript challenge page (Just a moment...) to every User-Agent tested, including GPTBot, ClaudeBot, PerplexityBot, Google-Extended, OAI-SearchBot, Applebot-Extended, Bytespider, and a standard browser. No AI crawler can access a single byte of real content.

Crawler Access

compare_bot_access on the homepage returned 403 for all 11 agents including the browser baseline. The robots.txt (served at www.mcri.edu.au/robots.txt, accessible) contains only a generic User-agent: * rule with no AI-bot-specific directives — no mention of GPTBot, ClaudeBot, or any other crawler. The Sitemap directive points to https://mcri.edu.au/sitemap-xml, which itself returns 403. /llms.txt returns a 404. The site runs on Cloudflare (NS: alina.ns.cloudflare.com / kanye.ns.cloudflare.com) with a strict CSP that only permits Cloudflare challenge scripts. The underlying CMS is Joomla (visible in the robots.txt comments referencing Joomla folder conventions).

Cold-Knowledge Gap

The LLM knows MCRI as "Australia's largest child health research institute" with specific achievements: world-first gene therapy for SCID, contributions to the HPV vaccine, the ABCD adolescent brain study, and a 2023 data-breach incident. The site's actual content (visible only via Wayback Machine snapshots) describes MCRI as "ranked among the top three globally for research quality and impact" with 1,800+ researchers across 150+ diseases, five flagship research areas, and a founding story tied to Dame Elisabeth Murdoch and Professor David Danks in 1986. The gap is not in accuracy but in freshness — the LLM's knowledge is frozen at a pre-2025 snapshot, while the live site (which no AI can read) contains current news about 2026 events, a 40-year anniversary campaign, and recent grants. The site's own claims of global ranking and scale are richer than what the LLM recites.

Schema Posture

Every page examined (via Wayback) contains zero JSON-LD structured data. No Organization, MedicalOrganization, ResearchOrganization, WebSite, or Article schema is present. The homepage has no meta description in the live version (only the Cloudflare challenge page). The archived homepage has a meta description but no schema. This is a complete absence of the semantic markup that AI engines use for knowledge-graph extraction and rich answer generation.

External Signals

Wikipedia describes MCRI with 1,500 staff (2016 figure), a $136.7M budget (2017), and six research themes — slightly different from the site's current claim of 1,800+ staff and five themes. The Wikipedia official website link points to www.mcri.edu.au — a domain that returns 403 to all visitors. The Royal Children's Hospital site (rch.org.au) is fully accessible and links to MCRI research, but the MCRI domain itself is a black hole. No external reviews, Reddit threads, or press articles were discoverable via search — the domain has zero organic search footprint in the tested index.

Findings

1. Cloudflare JS challenge wall blocks all AI crawlers and browsers High

   The entire mcri.edu.au domain returns HTTP 403 with a Cloudflare JavaScript challenge page to every tested User-Agent, including GPTBot, ClaudeBot, PerplexityBot, Google-Extended, OAI-SearchBot, Applebot-Extended, Bytespider, and standard browsers. No AI crawler can access any real content.

   What to change: Remove the JS challenge for known AI crawler User-Agents by configuring Cloudflare WAF to allow GPTBot, ClaudeBot, and other listed bots, or serve a static HTML version of the site to those agents.

2. Sitemap returns 403, blocking crawler discovery High

   The sitemap at https://mcri.edu.au/sitemap-xml returns HTTP 403, preventing crawlers from discovering the site's URL structure. The robots.txt Sitemap directive points to this inaccessible URL.

   What to change: Ensure the sitemap is accessible to all crawlers by serving it without JS challenge, and verify the URL in robots.txt is correct.

3. No /llms.txt file for AI crawler guidance Medium

   The site does not provide an /llms.txt file, which is a standard way to guide AI crawlers to important content and provide context.

   What to change: Create an /llms.txt file that lists key pages and provides a brief summary of the site for AI crawlers.

4. Zero JSON-LD structured data on any page High

   Every page examined via Wayback Machine contains no JSON-LD structured data. No Organization, MedicalOrganization, ResearchOrganization, WebSite, or Article schema is present, which limits AI engines' ability to extract knowledge for rich answers.

   What to change: Add JSON-LD structured data for Organization, MedicalOrganization, ResearchOrganization, WebSite, and Article schema to all pages, including name, description, URL, logo, and research areas.

5. Live homepage has no meta description Medium

   The live homepage (Cloudflare challenge page) has no meta description tag. The archived version has one, but the live site served to crawlers lacks this basic SEO element.

   What to change: Ensure the meta description is present in the HTML served to all crawlers, even behind the JS challenge.

6. Zero organic search presence for the domain High

   Multiple web searches for 'mcri.edu.au' and related queries returned zero results, indicating the site is not indexed by search engines. This is likely due to the Cloudflare block.

   What to change: Remove the JS challenge for search engine bots to allow indexing, and submit the sitemap to Google Search Console.

7. LLM knowledge of MCRI is outdated and lacks current site content Medium

   The LLM knows MCRI as 'Australia's largest child health research institute' with historical achievements, but the site's current claims (top three globally, 1,800+ researchers, 2026 events) are not reflected in the LLM's knowledge because the site is inaccessible.

   What to change: Allow AI crawlers to access the site so that LLMs can ingest current content and keep knowledge fresh.

8. Robots.txt lacks AI-bot-specific directives Low

   The robots.txt file contains only a generic User-agent: * rule with no directives for GPTBot, ClaudeBot, or other AI crawlers. While not blocking them, it misses the opportunity to guide them to important content.

   What to change: Add specific directives for AI crawlers, such as allowing access to key pages and disallowing irrelevant sections.

9. Wikipedia official website link points to a blocked domain Medium

   The Wikipedia page for MCRI lists www.mcri.edu.au as the official website, but that domain returns 403 to all visitors, creating a dead link for users and crawlers.

   What to change: Ensure the domain is accessible to all visitors, or update the Wikipedia link to a working URL.

What's working

• Robots.txt is accessible and contains no AI-bot blocks — The robots.txt file at www.mcri.edu.au/robots.txt is served successfully and does not explicitly block any AI crawlers, which is a positive baseline.
• Wayback Machine has recent snapshots of the site — The Wayback Machine has a snapshot from 2026-05-11, preserving the site's content for historical reference and partial analysis.
• Wikipedia page provides authoritative background — The Wikipedia page for Murdoch Children's Research Institute contains detailed information about the institute's history, achievements, and structure, serving as a reliable external knowledge source.
• Affiliated Royal Children's Hospital site is fully accessible — The Royal Children's Hospital website (rch.org.au) is accessible and links to MCRI research, providing an alternative entry point for users and crawlers.