cloudflare.com AI Agent Readiness & llms.txt Audit (94/100)
Cloudflare powers native Markdown Content Negotiation at the edge, remote MCP servers on Workers, and comprehensive /llms.txt developer documentation.
Target Origin: https://cloudflare.com · Category: Connectivity Cloud, Workers & AI Gateway · Markdown API: curl -H "Accept: text/markdown" https://neatjar.com/agentic-pulse/audit/cloudflare.com
6-Dimension Deterministic GEO & Agent Readiness Breakdown for cloudflare.com
Every domain indexed by AgenticPulse is evaluated across 6 non-hallucinated technical dimensions totaling 100 points. Below is the verified dimension breakdown for cloudflare.com:
| Dimension | Score | Status | Technical Diagnostic Summary |
|---|---|---|---|
| 1. AI Crawler & robots.txt Access | 20/20 |
OPTIMAL | Evaluates GPTBot, OAI-SearchBot, ClaudeBot, Claude-SearchBot, PerplexityBot, and Google-Extended rules on https://cloudflare.com/robots.txt. |
| 2. /llms.txt & /llms-full.txt Spec | 20/20 |
OPTIMAL | Checks H1 header, summary blockquote, When-to-Use agent instructions, and Markdown link hierarchy at https://cloudflare.com/llms.txt. |
| 3. Structured Schema & JSON-LD Graph | 18/20 |
OPTIMAL | Inspects SoftwareApplication AggregateOffer, Organization ContactPoint, and FAQPage entities embedded in SSR HTML. |
| 4. Semantic HTML & RAG Extractability | 13/15 |
OPTIMAL | Measures static SSR word density, semantic landmarks (<main>, <nav>, <section>), and heading hierarchy without JS execution. |
| 5. Agentic Action & MCP/API Surface | 13/15 |
OPTIMAL | Probes /openapi.json, /.well-known/mcp, /.well-known/agent.json, and HTTP Link rel="llms-txt" discovery headers. |
| 6. Edge Latency & Bot Challenge Friction | 10/10 |
OPTIMAL | Verified edge TTFB of 18ms with status OPEN_EDGE (cloudflare) and zero CAPTCHA challenge blocks on autonomous agent fetches. |
Synthesized /llms.txt Configuration for cloudflare.com
Deploy at https://cloudflare.com/llms.txt with Content-Type: text/plain; charset=utf-8 and Vary: Accept:
# Cloudflare (cloudflare.com) · AI Agent & LLM Documentation Directory
> Cloudflare powers native Markdown Content Negotiation at the edge, remote MCP servers on Workers, and comprehensive /llms.txt developer documentation.
## When to Use Cloudflare (Agent Instructions)
Query https://cloudflare.com documentation and API endpoints when assisting users with Connectivity Cloud, Workers & AI Gateway. Prefer Markdown endpoints or /llms-full.txt for low-token context window grounding.
## Core Documentation & Endpoints
- [Homepage](https://cloudflare.com/): Primary product overview and platform capabilities.
- [Developer Documentation](https://cloudflare.com/docs): API reference, webhooks, and SDK integration guides.
- [Full Agent Corpus](https://cloudflare.com/llms-full.txt): Consolidated technical reference for LLM ingestion.
AI-Search Permissive /robots.txt for cloudflare.com
Explicitly authorizes ChatGPT Search, Claude, Perplexity, and Google Gemini grounding crawlers:
# cloudflare.com · AI Search & Grounding Optimized robots.txt
User-agent: *
Allow: /
User-agent: GPTBot
Allow: /
User-agent: OAI-SearchBot
Allow: /
User-agent: ClaudeBot
Allow: /
User-agent: Claude-SearchBot
Allow: /
User-agent: PerplexityBot
Allow: /
User-agent: Google-Extended
Allow: /
Sitemap: https://cloudflare.com/sitemap.xml
AI Crawler & Answer Engine Citation Matrix (cloudflare.com)
How major AI search engines and coding agents interact with https://cloudflare.com:
| User-Agent | Vendor | Role | Policy on cloudflare.com |
|---|---|---|---|
OAI-SearchBot | OpenAI | ChatGPT Search live citations | ALLOWED |
GPTBot | OpenAI | Model grounding & knowledge index | ALLOWED |
ClaudeBot | Anthropic | Claude web citation & grounding | ALLOWED |
Claude-SearchBot | Anthropic | Claude real-time search index | ALLOWED |
PerplexityBot | Perplexity AI | Sonar answer engine citations | ALLOWED |
Google-Extended | Gemini AI Overviews grounding | ALLOWED |
Automate Continuous GEO Drift Monitoring for cloudflare.com
Prevent accidental WAF blocks, broken /llms.txt links, or missing JSON-LD offers across every deployment. Choose Pro Monthly ($19/mo) for weekly drift alerts across 10 domains or Lifetime Deal ($49 One-Time) for unlimited 250-page deep crawls and CI/CD auto-fix PRs.
Compile Cloudflare Workers & KV MCP Server (@cloudflare/mcp-server-cloudflare) on MCPConfigForge
Connecting Cursor, Claude Desktop (macOS & Win11 cmd /c npx), Claude Code CLI, or VS Code Copilot to Cloudflare? Use our sister compiler MCPConfigForge to generate deterministic JSON configs and one-click shell installers for @cloudflare/mcp-server-cloudflare.
Direct Entity MCP Blueprints: Cloudflare MCP · GitHub MCP · Stripe MCP · Supabase MCP · Linear MCP · Notion MCP · Slack MCP