betterment.com — AI Site Grade

Analysis

Betterment's AI crawlers see everything — but the cold-knowledge gap reveals a lawsuit blind spot

Betterment's site is fully open to every major AI crawler with no blocks, no JS-rendering risk, and a rich FAQ schema on key pages — yet the cold LLM knowledge about the brand is dominated by a 2023 class-action lawsuit that the site itself never mentions, creating a significant reputational asymmetry.

Crawler Access

All 11 tested AI bots (GPTBot, ClaudeBot, PerplexityBot, Google-Extended, OAI-SearchBot, ChatGPT-User, Bytespider, Applebot-Extended, anthropic-ai, Perplexity-User) receive a 200 with identical byte payload (~426KB) as a browser baseline. No UA-based blocking, no Cloudflare challenge, no thin-JS-shell issue. The robots.txt uses a single User-agent: * rule disallowing only gated PDFs, thank-you pages, and promotional landing pages — no AI-specific directives exist. The llms.txt returns a 404 (HubSpot 404 page with full HTML/JS payload). The sitemap at /sitemap.xml contains 1,646 URLs across a flat structure, well-maintained.

Cold-Knowledge Gap

The frontier LLM queried cold describes Betterment as "one of the first robo-advisors" founded in 2008, listing automated tax-loss harvesting, Smart Beta, Cash Reserve, and SRI as core products. It then cites a 2023 class-action lawsuit alleging misleading marketing about Cash Reserve interest rates as a "recent reputational signal." The Betterment site itself contains zero mention of any lawsuit on any page examined — the homepage, /cash-reserve, /premium, /investing, /legal directory, and /performance all omit it. The site prominently advertises "up to 4.00% APY (variable)" with a "boost" for new customers, which is precisely the type of promotional rate language that attracted the litigation. The cold model also still references "Smart Beta" portfolios — a product line that does not appear prominently on the current site's navigation or product pages.

Schema Posture

The homepage carries a well-structured FAQPage schema (4 questions covering how Betterment works, human access, safety, and experts) and a complete Organization schema with address, legal name, phone, and social profiles. The /premium page also has FAQPage with 4 detailed Q&A entries. However, the /investing, /cash-reserve, /checking, /crypto, and /performance pages carry only the generic Organization schema — no product-specific FinancialProduct, InvestmentOrDeposit, or Service schema. The /cash-reserve page has a comparison table (Betterment vs Robinhood vs SoFi vs Chase) but no ComparisonTable or Product schema to make it machine-readable. No BreadcrumbList schema exists on any page examined.

External Signals

The site claims $70B+ in assets under management and 1M+ customers — figures that appear consistently across the homepage, /investing, and /premium. The DNS TXT records reveal verification tokens for OpenAI (openai-domain-verification), Anthropic (anthropic-domain-verification), and Apple (apple-domain-verification), confirming the brand has proactively registered with all three AI platforms for crawler identity. The site runs on HubSpot CMS behind Cloudflare (CDN/WAF), with Google Workspace for email. No external review aggregator pages (NerdWallet, Forbes, Reddit) were returned by search, suggesting limited indexed third-party coverage or a search-result gap.

Surprising Details

The /crypto page promotes "managed portfolios of Bitcoin and Ethereum ETFs" — a notable product pivot from the direct crypto investing Betterment previously offered, and one the cold LLM did not reference. The /self-directed-investing page reveals that buy orders only support dollar amounts, not share-based orders ("not currently available, but will be available in the future") — a meaningful limitation for a self-directed trading product that no AI model would surface without live retrieval. The robots.txt disallows /get-started/* — the entire pre-signup flow — meaning AI crawlers cannot index the onboarding experience that prospects would see.

Findings

1. Cold LLM knowledge dominated by unmentioned class-action lawsuit High

   A frontier LLM's cold knowledge of Betterment prominently cites a 2023 class-action lawsuit over Cash Reserve interest rate marketing, yet the site contains zero mention of any lawsuit on any examined page. This creates a reputational asymmetry where AI models surface negative signals the brand does not address.

   What to change: Add a page or section addressing the lawsuit and current interest rate practices, and consider including a structured FAQ or schema to provide balanced context for AI crawlers.

2. Missing FinancialProduct schema on core product pages Medium

   Pages for investing, cash reserve, checking, crypto, and performance carry only generic Organization schema, lacking product-specific structured data like FinancialProduct, InvestmentOrDeposit, or Service. This limits AI crawlers' ability to understand and surface product details.

   What to change: Add FinancialProduct, InvestmentOrDeposit, or Service schema markup to each product page with relevant properties (e.g., fees, APY, minimum investment).

3. Cash Reserve comparison table lacks structured data Medium

   The /cash-reserve page includes a comparison table (Betterment vs Robinhood vs SoFi vs Chase) but no ComparisonTable or Product schema, making the data invisible to AI crawlers.

   What to change: Add ComparisonTable schema or individual Product schema for each competitor row to make the comparison machine-readable.

4. No BreadcrumbList schema on any page Low

   None of the examined pages include BreadcrumbList structured data, which helps AI crawlers understand site hierarchy and context.

   What to change: Add BreadcrumbList schema to all pages, reflecting the site's navigation structure.

5. llms.txt file returns 404 Medium

   The llms.txt file at betterment.com/llms.txt returns a 404 (HubSpot error page), missing an opportunity to provide AI crawlers with a curated summary of the site's content.

   What to change: Create an llms.txt file with a brief site description and links to key pages (e.g., product pages, FAQ, legal).

6. Robots.txt blocks pre-signup flow from AI crawlers Low

   The robots.txt disallows /get-started/*, preventing AI crawlers from indexing the onboarding experience that prospects see before signing up.

   What to change: Consider allowing AI crawlers to access /get-started/ pages to surface the signup flow in AI-generated answers.

7. Cold LLM references discontinued Smart Beta product Medium

   The cold LLM still references 'Smart Beta' portfolios, a product line that does not appear prominently on the current site, indicating outdated AI knowledge that could mislead users.

   What to change: Ensure the site clearly indicates the current product lineup and consider updating external sources or adding schema to signal product changes.

8. Self-directed investing lacks share-based orders Low

   The /self-directed-investing page states that buy orders only support dollar amounts, not share-based orders, a limitation that no AI model would surface without live retrieval.

   What to change: Add structured data or a clear FAQ entry to make this limitation machine-readable for AI crawlers.

9. Limited indexed third-party review content Medium

   Web searches for Betterment reviews on NerdWallet, Forbes, and Reddit returned zero results, suggesting limited indexed third-party coverage or a search-result gap that reduces external signals.

   What to change: Encourage more third-party reviews and ensure the site's review pages are crawlable and indexed.

What's working

• All major AI crawlers receive full, unblocked access — All 11 tested AI bots receive a 200 response with identical content as a browser, with no UA-based blocking, Cloudflare challenges, or JS-rendering issues.
• FAQPage schema on homepage and premium page — The homepage and /premium page carry well-structured FAQPage schema with multiple Q&A entries, helping AI crawlers surface common questions.
• Complete Organization schema on all pages — Every examined page includes a complete Organization schema with address, legal name, phone, and social profiles, providing consistent brand identity to AI crawlers.
• Domain verification tokens for OpenAI, Anthropic, and Apple — DNS TXT records include verification tokens for OpenAI, Anthropic, and Apple, confirming proactive registration with major AI platforms for crawler identity.
• Large, well-maintained sitemap with 1,646 URLs — The sitemap contains 1,646 URLs in a flat structure, indicating good coverage of the site's content for crawlers.
• Consistent $70B+ AUM and 1M+ customer claims across pages — The site consistently advertises $70B+ in assets under management and 1M+ customers on multiple pages, providing strong social proof for AI crawlers.
• Robots.txt has no AI-specific blocking directives — The robots.txt uses a single User-agent: * rule and does not block any AI crawlers, ensuring full access to all allowed paths.