crunchbase.com

ADA 53/100 (D) ARS 27% Established Agent-Ready Host

Crunchbase | Private Company Data & Predictive Intelligence

AI Domain Authority: ADA 53/100 (Established Agent-Ready Host)
Raw HTML / Signal: ~33,571 tok (5.4% signal)
/llms.txt Manifest: Not deployed
Edge / TTFB: Cloudflare · 1217 ms
AI Domain Authority (ADA) Agent Readiness (ARS) Citation Authority Token Savings (/llms.txt) Network TTFB Provenance & TLS
53/100 (D) 27% 49/100 (2 citers) 0% (No /llms.txt) 1217 ms (Cloudflare) 92/100

AI Domain Authority (ADA 53/100) & Citation Graph

Open Formula & Spec →
1. Machine Citation Authority (58%) 49/100 · TrustRank over /llms.txt, mcp.json & JSON-LD graphs
2. Agent Ingestion / ARS (18%) 27% · Manifest validity, token efficiency, TTFB & bot access
3. Entity & DNS Provenance (14%) 92/100 · X.509 TLS, security headers, SPF/DMARC & TXT proofs
4. Crawler Pulse & Edge (10%) 66/100 · Edge & search-bot reachability
Observed Inbound Machine Citers stripe.com · loom.com
Outbound Cited Authorities (1) techcrunch.com
Compare crunchbase.com head-to-head:

Web-to-Token Efficiency & Agent Ingestion Cost

~4 bytes/token UTF-8 heuristic
Ingestion Source Payload Est. Tokens Cost / 1k Reads (Flash $0.35) Cost / 1k Reads (Pro $1.25)
Raw HTML DOM (GET /) 131.1 KB 33,571 $11.7499 $41.9638
Stripped Readable Text 7.1 KB 1,817 $0.6360 $2.2713
/llms.txt Manifest Not deployed — agents must parse 33,571 raw HTML tokens
HTML Signal-to-Noise Ratio: 5.4% readable text vs. 94.6% markup/script overhead. Token Optimization Guide →

/llms.txt Spec Linter & Agent Endpoint Probe

Status: Not Deployed · Spec Rules →
GET /llms.txt Missing — Generate spec-compliant /llms.txt for crunchbase.com →
GET /llms-full.txt Not deployed
GET /.well-known/mcp.json Not advertised
JSON-LD Schema Entities None detected in initial HTML

AI Crawler /robots.txt Access Matrix

Search Allowed · Training Restricted · Bot Directory →
User-Agent Token Purpose / Operator Effective Directive
OAI-SearchBot ChatGPT Search Citations Allow: /
PerplexityBot Perplexity Answer Citations Allow: /
ChatGPT-User Live User Agent Browsing Allow: /
Claude-SearchBot Anthropic Search Grounding Allow: /
GPTBot Foundation Model Training Disallow: /
ClaudeBot Foundation Model Training Disallow: /
Google-Extended Gemini Training Control Disallow: /
Applebot-Extended Apple Intelligence Training Disallow: /
Meta-ExternalAgent Llama Training & Indexing Disallow: /
CCBot Open Dataset Training Corpus Disallow: /

HTTP Response & Handshake Timing

GET https://www.crunchbase.com/
DNS Lookup 7 ms HTML Document 131.1 KB
TCP Connect 6 ms Script Tags 2
TLS Handshake 542 ms Stylesheets 0
Time to First Byte (TTFB) 1217 ms Images (with alt) 14 / 28
Total Transfer 1218 ms HTTP/3 (Alt-Svc) Not advertised

Edge Network & Application Stack

Header & DOM Signatures
Edge / Reverse Proxy Cloudflare
Application Framework Custom SSR / Static
Server Header cloudflare
Mail Provider (MX) Google Workspace
Telemetry Signatures GA4 / GTM
TXT Verifications Google Search Console, Atlassian, Microsoft Entra

TLS Certificate & HTTP Security Policy

Port 443 X.509
Certificate Issuer Let's Encrypt (53 days remaining)
Strict-Transport-Security Present
Content-Security-Policy Not set
X-Content-Type-Options Present
X-Frame-Options Present
Referrer-Policy Present
Permissions-Policy Not set
SPF / DMARC Policy SPF: Yes · DMARC: Yes

Authoritative DNS & Document Head

A / AAAA / NS / Canonical
A (IPv4) 104.18.9.208, 104.18.8.208
AAAA (IPv6) 2606:4700::6812:8d0, 2606:4700::6812:9d0
NS (Nameservers) jeff.ns.cloudflare.com, beth.ns.cloudflare.com
HTML Title (59c) Crunchbase | Private Company Data & Predictive Intelligence
/sitemap.xml Not found

Hosted /llms.txt Mirror & Status Badge

Platform Setup Guide →
1-Line <head> Tag (for Shopify, Webflow, Framer, Wix, Squarespace & WordPress):
Sitecube status for crunchbase.com
GitHub / Docs Markdown Badge:
HTML Badge:

Technical Synthesis & Agentic Ingestion Analysis: crunchbase.com

Automated Engineering Assessment

1. HTML-to-Token Efficiency & LLM Context Window Cost

An unauthenticated HTTPS GET request to https://www.crunchbase.com/ returns an initial HTML payload of 131.1 KB, corresponding to approximately 33,571 UTF-8 tokens when ingested raw by an AI coding agent, retrieval pipeline, or headless browser. After stripping inline <script>, <style>, <svg>, and DOM markup tags, the human-readable text footprint measures 1,817 tokens (7.1 KB)—yielding an HTML Signal-to-Noise Ratio of 5.4%. Because crunchbase.com does not currently serve a machine-readable /llms.txt manifest at its root path, autonomous agents must either parse the full 33,571-token HTML payload ($41.9638 per 1,000 frontier reads) or run a DOM-stripping pass before grounding.

2. AI Crawler Governance & /robots.txt Posture

Based on live inspection of https://crunchbase.com/robots.txt, crunchbase.com maintains a Search Allowed · Training Restricted posture. Specifically, AI search citation crawlers (OAI-SearchBot: Allowed, PerplexityBot: Allowed) and foundation model training crawlers (GPTBot: Disallowed, ClaudeBot: Disallowed, CCBot: Disallowed) are governed explicitly by the host’s root robots policy.

3. Edge Delivery, TLS Handshake & Security Header Assessment

Traffic for crunchbase.com resolves to 104.18.9.208 via Cloudflare running Custom SSR / Static, achieving a measured Time to First Byte (TTFB) of 1217 ms (DNS lookup: 7 ms, TCP connect: 6 ms, TLS handshake: 542 ms). The port 443 TLS certificate is issued by Let's Encrypt with 53 days remaining before expiration (valid through 2027-01-10). Outbound email authentication via SPF is present and DMARC (_dmarc.crunchbase.com) is enforced.

Comparable Hosts in Sitecube ADA & /llms.txt Registry

Full ADA Index (58 hosts) →
Host ADA (1–100) ARS /llms.txt HTML Tokens Signal % Crawler Posture TTFB
github.com ADA 91 74% 7,165 tok 131,240 0.9% Open to Search & Training 27 ms
cloudflare.com ADA 88 96% 4,294 tok 333,631 0.1% Open to Search & Training 264 ms
vercel.com ADA 85 80% 3,722 tok 149,590 0.8% Open to Search & Training 66 ms
render.com ADA 83 90% 13,304 tok 190,754 1.1% Open to Search & Training 306 ms
notion.com ADA 82 90% 1,701 tok 42,100 1.6% Selective Agent Access 131 ms
shopify.com ADA 82 80% 3,161 tok 172,976 0.3% Open to Search & Training 106 ms
trendyflash.com ADA 81 87% 3,416 tok 12,412 14.7% Open to Search & Training 78 ms
nextjs.org ADA 80 74% 3,648 tok 67,086 1.6% Open to Search & Training 61 ms
supabase.com ADA 80 88% 879 tok 337,794 0.6% Open to Search & Training 58 ms
webflow.com ADA 80 72% 3,324 tok 138,361 2.6% Open to Search & Training 1022 ms
atlassian.com ADA 80 74% 6,652 tok 540,503 17.5% Open to Search & Training 2119 ms
redis.io ADA 79 80% 11,721 tok 427,454 2.5% Open to Search & Training 86 ms