anthropic.com AI Agent Readiness & llms.txt Audit (95/100)
Anthropic pioneers the Model Context Protocol (MCP) and publishes high-signal /llms.txt, /llms-full.txt, and structured technical documentation optimized for zero-noise RAG ingestion.
Target Origin: https://anthropic.com · Category: Frontier AI Safety & Claude Models · Markdown API: curl -H "Accept: text/markdown" https://neatjar.com/agentic-pulse/audit/anthropic.com
6-Dimension Deterministic GEO & Agent Readiness Breakdown for anthropic.com
Every domain indexed by AgenticPulse is evaluated across 6 non-hallucinated technical dimensions totaling 100 points. Below is the verified dimension breakdown for anthropic.com:
| Dimension | Score | Status | Technical Diagnostic Summary |
|---|---|---|---|
| 1. AI Crawler & robots.txt Access | 20/20 |
OPTIMAL | Evaluates GPTBot, OAI-SearchBot, ClaudeBot, Claude-SearchBot, PerplexityBot, and Google-Extended rules on https://anthropic.com/robots.txt. |
| 2. /llms.txt & /llms-full.txt Spec | 20/20 |
OPTIMAL | Checks H1 header, summary blockquote, When-to-Use agent instructions, and Markdown link hierarchy at https://anthropic.com/llms.txt. |
| 3. Structured Schema & JSON-LD Graph | 18/20 |
OPTIMAL | Inspects SoftwareApplication AggregateOffer, Organization ContactPoint, and FAQPage entities embedded in SSR HTML. |
| 4. Semantic HTML & RAG Extractability | 14/15 |
OPTIMAL | Measures static SSR word density, semantic landmarks (<main>, <nav>, <section>), and heading hierarchy without JS execution. |
| 5. Agentic Action & MCP/API Surface | 13/15 |
OPTIMAL | Probes /openapi.json, /.well-known/mcp, /.well-known/agent.json, and HTTP Link rel="llms-txt" discovery headers. |
| 6. Edge Latency & Bot Challenge Friction | 10/10 |
OPTIMAL | Verified edge TTFB of 31ms with status OPEN_EDGE (cloudflare) and zero CAPTCHA challenge blocks on autonomous agent fetches. |
Synthesized /llms.txt Configuration for anthropic.com
Deploy at https://anthropic.com/llms.txt with Content-Type: text/plain; charset=utf-8 and Vary: Accept:
# Anthropic (anthropic.com) · AI Agent & LLM Documentation Directory
> Anthropic pioneers the Model Context Protocol (MCP) and publishes high-signal /llms.txt, /llms-full.txt, and structured technical documentation optimized for zero-noise RAG ingestion.
## When to Use Anthropic (Agent Instructions)
Query https://anthropic.com documentation and API endpoints when assisting users with Frontier AI Safety & Claude Models. Prefer Markdown endpoints or /llms-full.txt for low-token context window grounding.
## Core Documentation & Endpoints
- [Homepage](https://anthropic.com/): Primary product overview and platform capabilities.
- [Developer Documentation](https://anthropic.com/docs): API reference, webhooks, and SDK integration guides.
- [Full Agent Corpus](https://anthropic.com/llms-full.txt): Consolidated technical reference for LLM ingestion.
AI-Search Permissive /robots.txt for anthropic.com
Explicitly authorizes ChatGPT Search, Claude, Perplexity, and Google Gemini grounding crawlers:
# anthropic.com · AI Search & Grounding Optimized robots.txt
User-agent: *
Allow: /
User-agent: GPTBot
Allow: /
User-agent: OAI-SearchBot
Allow: /
User-agent: ClaudeBot
Allow: /
User-agent: Claude-SearchBot
Allow: /
User-agent: PerplexityBot
Allow: /
User-agent: Google-Extended
Allow: /
Sitemap: https://anthropic.com/sitemap.xml
AI Crawler & Answer Engine Citation Matrix (anthropic.com)
How major AI search engines and coding agents interact with https://anthropic.com:
| User-Agent | Vendor | Role | Policy on anthropic.com |
|---|---|---|---|
OAI-SearchBot | OpenAI | ChatGPT Search live citations | ALLOWED |
GPTBot | OpenAI | Model grounding & knowledge index | ALLOWED |
ClaudeBot | Anthropic | Claude web citation & grounding | ALLOWED |
Claude-SearchBot | Anthropic | Claude real-time search index | ALLOWED |
PerplexityBot | Perplexity AI | Sonar answer engine citations | ALLOWED |
Google-Extended | Gemini AI Overviews grounding | ALLOWED |
Automate Continuous GEO Drift Monitoring for anthropic.com
Prevent accidental WAF blocks, broken /llms.txt links, or missing JSON-LD offers across every deployment. Choose Pro Monthly ($19/mo) for weekly drift alerts across 10 domains or Lifetime Deal ($49 One-Time) for unlimited 250-page deep crawls and CI/CD auto-fix PRs.
Compile Model Context Protocol (MCP) Client Configurations on MCPConfigForge
Need verified Model Context Protocol (MCP) client configurations for Cursor (.cursor/mcp.json), Claude Desktop (Win11 cmd /c npx wrapper), Claude Code CLI, or VS Code Copilot? Open our sister compiler MCPConfigForge.
Direct Entity MCP Blueprints: Cloudflare MCP · GitHub MCP · Stripe MCP · Supabase MCP · Linear MCP · Notion MCP · Slack MCP