Home / Top Websites / techcrunch.com
AI Authority
1–100 Brand Trust
AI Readiness
Easy for AI to Read
techcrunch.com
Established Agent-Ready Hosttechcrunch.com is reachable by AI, with 2 straightforward fixes to boost your score.
TechCrunch | Startup and Technology News
✓ Open to ChatGPT & Perplexity
! Missing /llms.txt Summary
Speed: 46ms (Fast)
2 Action Steps Below
What’s Missing & Exact Steps to Take (2)
Ordered by biggest impact on your AI visibility
Step 1 · Biggest Quick Win · Takes 60 Seconds
+30% AI Readiness
Add an AI Summary File (/llms.txt) to your website
Right now, AI assistants have to dig through 106,933 tokens of messy website code just to find 2,793 tokens of real text on your homepage. A simple /llms.txt file gives ChatGPT, Claude, and Perplexity a clean summary of what you offer and your most important links.
Step 2 · Optional Power-Up
+10% AI Readiness
Optional: Add /.well-known/mcp.json for AI Agents
Your core setup is already strong! If you offer an API, product catalog, or documentation search, advertising an MCP file lets AI assistants query your site directly.
What techcrunch.com Is Already Doing Right (6 Passed)
Verified Live ✓
✓
Open to ChatGPT, Perplexity & Claude Search
AI answer engines are allowed to read your pages and send clickable referral visitors.
✓
Fast Website Response Speed (46ms)
Responds well within the 350ms budget needed for live AI search citations.
✓
Structured Brand & Content Labels Found
Detected Schema types: CollectionPage, BreadcrumbList, ListItem, WebSite, SearchAction.
✓
XML Sitemap (/sitemap.xml) Active
Helps Google, Bing, and AI search bots discover all your public pages.
✓
Verified Domain Email Security (SPF & DMARC)
Confirms authentic domain ownership and protects brand trust.
✓
Secure HTTPS Connection Active
Valid SSL certificate (83 days remaining).
How Your 58/100 AI Authority Score Is Built
How Scoring Works →
Brand & AI Citations (58% weight)
48 / 100
How often trusted websites and AI summary files link to your domain.
AI Setup Readiness (18% weight)
44 / 100
Whether AI bots are allowed in, plus /llms.txt, speed, and page clarity.
Domain & Email Trust (14% weight)
95 / 100
HTTPS security, anti-spoofing email records (SPF/DMARC), and verified ownership.
Website Speed & Bot Reach (10% weight)
86 / 100
Fast global CDN delivery and live AI crawler accessibility.
Websites Referencing techcrunch.com:
Compare techcrunch.com against a competitor:
Which AI Assistants Are Allowed to Read Your Site?
Edit Bot Rules →| AI Assistant / Bot | What It Does | Status |
|---|---|---|
|
ChatGPT Search
OAI-SearchBot
|
Shows your website links inside ChatGPT answers | Allowed ✓ |
|
Perplexity AI
PerplexityBot
|
Cites and links to your pages in Perplexity answers | Allowed ✓ |
|
ChatGPT Live Browsing
ChatGPT-User
|
Reads pages when a ChatGPT user pastes or clicks a topic | Allowed ✓ |
|
Claude Search
Claude-SearchBot
|
Finds and cites your website inside Anthropic Claude | Allowed ✓ |
|
OpenAI Model Training
GPTBot
|
Collects content to train future OpenAI models (optional) | Training Opt-Out |
|
Claude Model Training
ClaudeBot
|
Collects content to train future Anthropic models (optional) | Training Opt-Out |
|
Google Gemini Training
Google-Extended
|
Controls AI training only — does NOT affect Google Search | Allowed ✓ |
|
Apple Intelligence Training
Applebot-Extended
|
Controls Apple AI model training (optional) | Training Opt-Out |
|
Meta AI Training
Meta-ExternalAgent
|
Collects content for Meta Llama AI models (optional) | Allowed ✓ |
|
Common Crawl Dataset
CCBot
|
Public web archive used by many AI labs (optional) | Training Opt-Out |
How Cleanly AI Reads Your Homepage
Build /llms.txt →When an AI assistant opens techcrunch.com, your homepage downloads 417.7 KB of webpage code (~106,933 AI tokens), of which 2,793 tokens (2.6%) are actual human-readable words and the rest is behind-the-scenes website code.
Quick Fix: Add a 1-Line AI Summary Tag (15 Seconds)
Using Shopify, WordPress, Wix, Webflow, or Squarespace? Paste this 1-line tag into your site’s
<head> settings to give AI a clean auto-updated summary immediately:
Website Speed, Trust & Shareable Badge
Cloudflare| Server Response Speed | 46 ms (Great — under 350ms target) |
| Platform & Network | WordPress via Cloudflare |
| HTTPS Security | Secure SSL (83 days left) |
| Email & Domain Trust | SPF: Verified ✓ · DMARC: Verified ✓ |
| Verified Brand Ownership | Google Search Console, Anthropic Verified, Atlassian, Microsoft Entra, OpenAI Domain Verified |
Display Your AI Authority Badge (Free):
Click to copy HTML for your website footer (or Markdown for GitHub):
Advanced Developer & Server Details (Token Costs, DNS, Security Headers & Raw Files) Click to expand ↓
AI Token Reading Cost (Per 1,000 Page Reads)
| Source | Size | Tokens | Flash ($0.35/M) | Pro ($1.25/M) |
|---|---|---|---|---|
| Raw HTML Page | 417.7 KB | 106,933 | $37.4266 | $133.6663 |
| Clean Visible Text | 10.9 KB | 2,793 | $0.9776 | $3.4913 |
| /llms.txt Summary | Not installed yet | |||
Security Headers & Authoritative DNS
| IPv4 / Nameservers | 104.18.17.5, 104.18.16.5 · elly.ns.cloudflare.com, gordon.ns.cloudflare.com |
| Strict-Transport-Security | Enabled ✓ |
| Content-Security-Policy | Enabled ✓ |
| X-Content-Type-Options | Enabled ✓ |
| X-Frame-Options | Enabled ✓ |
| Referrer-Policy | Enabled ✓ |
| Permissions-Policy | Enabled ✓ |
Detailed Summary for techcrunch.com
techcrunch.com holds a Sitecube AI Domain Authority (ADA) of 58/100 and an AI Setup Readiness (ARS) of 44%. Over HTTPS, its homepage transfers 417.7 KB (~106,933 tokens) with a response speed (TTFB) of 46ms on Cloudflare.
How Other Popular Websites Score
See All 69 Websites →| Website | AI Authority | AI Readiness | AI Summary (/llms.txt) | ChatGPT & Perplexity | Speed |
|---|---|---|---|---|---|
| github.com | 91 / 100 | 74% | Installed ✓ | Allowed ✓ | 27 ms |
| cloudflare.com | 87 / 100 | 96% | Installed ✓ | Allowed ✓ | 264 ms |
| vercel.com | 84 / 100 | 80% | Installed ✓ | Allowed ✓ | 66 ms |
| notion.com | 82 / 100 | 90% | Installed ✓ | Allowed ✓ | 131 ms |
| shopify.com | 82 / 100 | 80% | Installed ✓ | Allowed ✓ | 106 ms |
| atlassian.com | 82 / 100 | 74% | Installed ✓ | Allowed ✓ | 2119 ms |
| render.com | 81 / 100 | 90% | Installed ✓ | Allowed ✓ | 306 ms |
| trendyflash.com | 80 / 100 | 87% | Installed ✓ | Allowed ✓ | 78 ms |
| nextjs.org | 80 / 100 | 74% | Installed ✓ | Allowed ✓ | 61 ms |
| supabase.com | 80 / 100 | 88% | Installed ✓ | Allowed ✓ | 58 ms |