twitter.com
ADA 51/100 (D) ARS 9% Established Agent-Ready HostX. It’s what’s happening / X
| AI Domain Authority (ADA) | Agent Readiness (ARS) | Citation Authority | Token Savings (/llms.txt) | Network TTFB | Provenance & TLS |
|---|---|---|---|---|---|
| 51/100 (D) | 9% | 67/100 (5 citers) | 0% (No /llms.txt) | 565 ms (Cloudflare) | 93/100 |
AI Domain Authority (ADA 51/100) & Citation Graph
Open Formula & Spec →
| 1. Machine Citation Authority (58%) | 67/100 · TrustRank over /llms.txt, mcp.json & JSON-LD graphs |
| 2. Agent Ingestion / ARS (18%) | 9% · Manifest validity, token efficiency, TTFB & bot access |
| 3. Entity & DNS Provenance (14%) | 93/100 · X.509 TLS, security headers, SPF/DMARC & TXT proofs |
| 4. Crawler Pulse & Edge (10%) | 62/100 · Edge & search-bot reachability |
| Observed Inbound Machine Citers | stripe.com · supabase.com · webflow.com · gitlab.com · loom.com |
| Outbound Cited Authorities (1) | grok.com |
Web-to-Token Efficiency & Agent Ingestion Cost
~4 bytes/token UTF-8 heuristic| Ingestion Source | Payload | Est. Tokens | Cost / 1k Reads (Flash $0.35) | Cost / 1k Reads (Pro $1.25) |
|---|---|---|---|---|
Raw HTML DOM (GET /) |
44.5 KB | 11,386 | $3.9851 | $14.2325 |
| Stripped Readable Text | 0.4 KB | 105 | $0.0368 | $0.1313 |
/llms.txt Manifest |
Not deployed — agents must parse 11,386 raw HTML tokens | |||
/llms.txt Spec Linter & Agent Endpoint Probe
Status: Not Deployed · Spec Rules →
| GET /llms.txt | Missing — Generate spec-compliant /llms.txt for twitter.com → |
| GET /llms-full.txt | Not deployed |
| GET /.well-known/mcp.json | Not advertised |
| JSON-LD Schema Entities | None detected in initial HTML |
AI Crawler /robots.txt Access Matrix
Selective Agent Access · Bot Directory →
| User-Agent Token | Purpose / Operator | Effective Directive |
|---|---|---|
| OAI-SearchBot | ChatGPT Search Citations | Disallow: / |
| PerplexityBot | Perplexity Answer Citations | Disallow: / |
| ChatGPT-User | Live User Agent Browsing | Disallow: / |
| Claude-SearchBot | Anthropic Search Grounding | Disallow: / |
| GPTBot | Foundation Model Training | Disallow: / |
| ClaudeBot | Foundation Model Training | Disallow: / |
| Google-Extended | Gemini Training Control | Allow: / |
| Applebot-Extended | Apple Intelligence Training | Disallow: / |
| Meta-ExternalAgent | Llama Training & Indexing | Allow: / |
| CCBot | Open Dataset Training Corpus | Disallow: / |
HTTP Response & Handshake Timing
GET https://x.com/| DNS Lookup | 6 ms | HTML Document | 44.5 KB |
| TCP Connect | 2 ms | Script Tags | 8 |
| TLS Handshake | 251 ms | Stylesheets | 1 |
| Time to First Byte (TTFB) | 565 ms | Images (with alt) | 0 / 0 |
| Total Transfer | 566 ms | HTTP/3 (Alt-Svc) | Yes (h3) |
Edge Network & Application Stack
Header & DOM Signatures| Edge / Reverse Proxy | Cloudflare |
| Application Framework | Custom SSR / Static |
| Server Header | cloudflare envoy |
| Mail Provider (MX) | Google Workspace |
| Telemetry Signatures | Zero Client Trackers |
| TXT Verifications | Stripe Verified, Atlassian, Google Search Console, Microsoft Entra, Slack |
TLS Certificate & HTTP Security Policy
Port 443 X.509| Certificate Issuer | Let's Encrypt (85 days remaining) |
| Strict-Transport-Security | Present |
| Content-Security-Policy | Present |
| X-Content-Type-Options | Present |
| X-Frame-Options | Present |
| Referrer-Policy | Present |
| Permissions-Policy | Not set |
| SPF / DMARC Policy | SPF: Yes · DMARC: Yes |
Authoritative DNS & Document Head
A / AAAA / NS / Canonical| A (IPv4) | 172.66.0.227 |
| AAAA (IPv6) | None |
| NS (Nameservers) | d.u06.twtrdns.net, c.u06.twtrdns.net, c.r06.twtrdns.net, a.u06.twtrdns.net, b.r06.twtrdns.net, d.r06.twtrdns.net |
| HTML Title (28c) | X. It’s what’s happening / X |
| /sitemap.xml | Not found |
Hosted /llms.txt Mirror & Status Badge
Platform Setup Guide →
<head> Tag (for Shopify, Webflow, Framer, Wix, Squarespace & WordPress):
Technical Synthesis & Agentic Ingestion Analysis: twitter.com
Automated Engineering Assessment1. HTML-to-Token Efficiency & LLM Context Window Cost
An unauthenticated HTTPS GET request to https://x.com/ returns an initial HTML payload of 44.5 KB, corresponding to approximately 11,386 UTF-8 tokens when ingested raw by an AI coding agent, retrieval pipeline, or headless browser. After stripping inline <script>, <style>, <svg>, and DOM markup tags, the human-readable text footprint measures 105 tokens (0.4 KB)—yielding an HTML Signal-to-Noise Ratio of 0.9%.
Because twitter.com does not currently serve a machine-readable /llms.txt manifest at its root path, autonomous agents must either parse the full 11,386-token HTML payload ($14.2325 per 1,000 frontier reads) or run a DOM-stripping pass before grounding.
2. AI Crawler Governance & /robots.txt Posture
Based on live inspection of https://twitter.com/robots.txt, twitter.com maintains a Selective Agent Access posture. Specifically, AI search citation crawlers (OAI-SearchBot: Disallowed, PerplexityBot: Disallowed) and foundation model training crawlers (GPTBot: Disallowed, ClaudeBot: Disallowed, CCBot: Disallowed) are governed explicitly by the host’s root robots policy.
3. Edge Delivery, TLS Handshake & Security Header Assessment
Traffic for twitter.com resolves to 172.66.0.227 via Cloudflare running Custom SSR / Static, achieving a measured Time to First Byte (TTFB) of 565 ms (DNS lookup: 6 ms, TCP connect: 2 ms, TLS handshake: 251 ms). The port 443 TLS certificate is issued by Let's Encrypt with 85 days remaining before expiration (valid through 2027-02-11). Outbound email authentication via SPF is present and DMARC (_dmarc.twitter.com) is enforced.
Comparable Hosts in Sitecube ADA & /llms.txt Registry
Full ADA Index (40 hosts) →| Host | ADA (1–100) | ARS | /llms.txt | HTML Tokens | Signal % | Crawler Posture | TTFB |
|---|---|---|---|---|---|---|---|
| github.com | ADA 91 | 74% | 7,165 tok | 131,240 | 0.9% | Open to Search & Training | 27 ms |
| cloudflare.com | ADA 88 | 96% | 4,294 tok | 333,631 | 0.1% | Open to Search & Training | 264 ms |
| vercel.com | ADA 85 | 80% | 3,722 tok | 149,590 | 0.8% | Open to Search & Training | 66 ms |
| render.com | ADA 83 | 90% | 13,304 tok | 190,754 | 1.1% | Open to Search & Training | 306 ms |
| shopify.com | ADA 82 | 80% | 3,161 tok | 172,976 | 0.3% | Open to Search & Training | 106 ms |
| trendyflash.com | ADA 81 | 87% | 3,416 tok | 12,412 | 14.7% | Open to Search & Training | 24 ms |
| nextjs.org | ADA 80 | 74% | 3,648 tok | 67,086 | 1.6% | Open to Search & Training | 61 ms |
| supabase.com | ADA 80 | 88% | 879 tok | 337,794 | 0.6% | Open to Search & Training | 58 ms |
| webflow.com | ADA 80 | 72% | 3,324 tok | 138,361 | 2.6% | Open to Search & Training | 1022 ms |
| atlassian.com | ADA 80 | 74% | 6,652 tok | 540,503 | 17.5% | Open to Search & Training | 2119 ms |
| redis.io | ADA 79 | 80% | 11,721 tok | 427,454 | 2.5% | Open to Search & Training | 86 ms |
| neon.tech | ADA 79 | 86% | 7,418 tok | 110,759 | 1.4% | Open to Search & Training | 236 ms |