twitter.com

ADA 51/100 (D) ARS 9% Established Agent-Ready Host

X. It’s what’s happening / X

AI Domain Authority: ADA 51/100 (Established Agent-Ready Host)
Raw HTML / Signal: ~11,386 tok (0.9% signal)
/llms.txt Manifest: Not deployed
Edge / TTFB: Cloudflare · 565 ms
AI Domain Authority (ADA) Agent Readiness (ARS) Citation Authority Token Savings (/llms.txt) Network TTFB Provenance & TLS
51/100 (D) 9% 67/100 (5 citers) 0% (No /llms.txt) 565 ms (Cloudflare) 93/100

AI Domain Authority (ADA 51/100) & Citation Graph

Open Formula & Spec →
1. Machine Citation Authority (58%) 67/100 · TrustRank over /llms.txt, mcp.json & JSON-LD graphs
2. Agent Ingestion / ARS (18%) 9% · Manifest validity, token efficiency, TTFB & bot access
3. Entity & DNS Provenance (14%) 93/100 · X.509 TLS, security headers, SPF/DMARC & TXT proofs
4. Crawler Pulse & Edge (10%) 62/100 · Edge & search-bot reachability
Observed Inbound Machine Citers stripe.com · supabase.com · webflow.com · gitlab.com · loom.com
Outbound Cited Authorities (1) grok.com
Compare twitter.com head-to-head:

Web-to-Token Efficiency & Agent Ingestion Cost

~4 bytes/token UTF-8 heuristic
Ingestion Source Payload Est. Tokens Cost / 1k Reads (Flash $0.35) Cost / 1k Reads (Pro $1.25)
Raw HTML DOM (GET /) 44.5 KB 11,386 $3.9851 $14.2325
Stripped Readable Text 0.4 KB 105 $0.0368 $0.1313
/llms.txt Manifest Not deployed — agents must parse 11,386 raw HTML tokens
HTML Signal-to-Noise Ratio: 0.9% readable text vs. 99.1% markup/script overhead. Token Optimization Guide →

/llms.txt Spec Linter & Agent Endpoint Probe

Status: Not Deployed · Spec Rules →
GET /llms.txt Missing — Generate spec-compliant /llms.txt for twitter.com →
GET /llms-full.txt Not deployed
GET /.well-known/mcp.json Not advertised
JSON-LD Schema Entities None detected in initial HTML

AI Crawler /robots.txt Access Matrix

Selective Agent Access · Bot Directory →
User-Agent Token Purpose / Operator Effective Directive
OAI-SearchBot ChatGPT Search Citations Disallow: /
PerplexityBot Perplexity Answer Citations Disallow: /
ChatGPT-User Live User Agent Browsing Disallow: /
Claude-SearchBot Anthropic Search Grounding Disallow: /
GPTBot Foundation Model Training Disallow: /
ClaudeBot Foundation Model Training Disallow: /
Google-Extended Gemini Training Control Allow: /
Applebot-Extended Apple Intelligence Training Disallow: /
Meta-ExternalAgent Llama Training & Indexing Allow: /
CCBot Open Dataset Training Corpus Disallow: /

HTTP Response & Handshake Timing

GET https://x.com/
DNS Lookup 6 ms HTML Document 44.5 KB
TCP Connect 2 ms Script Tags 8
TLS Handshake 251 ms Stylesheets 1
Time to First Byte (TTFB) 565 ms Images (with alt) 0 / 0
Total Transfer 566 ms HTTP/3 (Alt-Svc) Yes (h3)

Edge Network & Application Stack

Header & DOM Signatures
Edge / Reverse Proxy Cloudflare
Application Framework Custom SSR / Static
Server Header cloudflare envoy
Mail Provider (MX) Google Workspace
Telemetry Signatures Zero Client Trackers
TXT Verifications Stripe Verified, Atlassian, Google Search Console, Microsoft Entra, Slack

TLS Certificate & HTTP Security Policy

Port 443 X.509
Certificate Issuer Let's Encrypt (85 days remaining)
Strict-Transport-Security Present
Content-Security-Policy Present
X-Content-Type-Options Present
X-Frame-Options Present
Referrer-Policy Present
Permissions-Policy Not set
SPF / DMARC Policy SPF: Yes · DMARC: Yes

Authoritative DNS & Document Head

A / AAAA / NS / Canonical
A (IPv4) 172.66.0.227
AAAA (IPv6) None
NS (Nameservers) d.u06.twtrdns.net, c.u06.twtrdns.net, c.r06.twtrdns.net, a.u06.twtrdns.net, b.r06.twtrdns.net, d.r06.twtrdns.net
HTML Title (28c) X. It’s what’s happening / X
/sitemap.xml Not found

Hosted /llms.txt Mirror & Status Badge

Platform Setup Guide →
1-Line <head> Tag (for Shopify, Webflow, Framer, Wix, Squarespace & WordPress):
Sitecube status for twitter.com
GitHub / Docs Markdown Badge:
HTML Badge:

Technical Synthesis & Agentic Ingestion Analysis: twitter.com

Automated Engineering Assessment

1. HTML-to-Token Efficiency & LLM Context Window Cost

An unauthenticated HTTPS GET request to https://x.com/ returns an initial HTML payload of 44.5 KB, corresponding to approximately 11,386 UTF-8 tokens when ingested raw by an AI coding agent, retrieval pipeline, or headless browser. After stripping inline <script>, <style>, <svg>, and DOM markup tags, the human-readable text footprint measures 105 tokens (0.4 KB)—yielding an HTML Signal-to-Noise Ratio of 0.9%. Because twitter.com does not currently serve a machine-readable /llms.txt manifest at its root path, autonomous agents must either parse the full 11,386-token HTML payload ($14.2325 per 1,000 frontier reads) or run a DOM-stripping pass before grounding.

2. AI Crawler Governance & /robots.txt Posture

Based on live inspection of https://twitter.com/robots.txt, twitter.com maintains a Selective Agent Access posture. Specifically, AI search citation crawlers (OAI-SearchBot: Disallowed, PerplexityBot: Disallowed) and foundation model training crawlers (GPTBot: Disallowed, ClaudeBot: Disallowed, CCBot: Disallowed) are governed explicitly by the host’s root robots policy.

3. Edge Delivery, TLS Handshake & Security Header Assessment

Traffic for twitter.com resolves to 172.66.0.227 via Cloudflare running Custom SSR / Static, achieving a measured Time to First Byte (TTFB) of 565 ms (DNS lookup: 6 ms, TCP connect: 2 ms, TLS handshake: 251 ms). The port 443 TLS certificate is issued by Let's Encrypt with 85 days remaining before expiration (valid through 2027-02-11). Outbound email authentication via SPF is present and DMARC (_dmarc.twitter.com) is enforced.

Comparable Hosts in Sitecube ADA & /llms.txt Registry

Full ADA Index (40 hosts) →
Host ADA (1–100) ARS /llms.txt HTML Tokens Signal % Crawler Posture TTFB
github.com ADA 91 74% 7,165 tok 131,240 0.9% Open to Search & Training 27 ms
cloudflare.com ADA 88 96% 4,294 tok 333,631 0.1% Open to Search & Training 264 ms
vercel.com ADA 85 80% 3,722 tok 149,590 0.8% Open to Search & Training 66 ms
render.com ADA 83 90% 13,304 tok 190,754 1.1% Open to Search & Training 306 ms
shopify.com ADA 82 80% 3,161 tok 172,976 0.3% Open to Search & Training 106 ms
trendyflash.com ADA 81 87% 3,416 tok 12,412 14.7% Open to Search & Training 24 ms
nextjs.org ADA 80 74% 3,648 tok 67,086 1.6% Open to Search & Training 61 ms
supabase.com ADA 80 88% 879 tok 337,794 0.6% Open to Search & Training 58 ms
webflow.com ADA 80 72% 3,324 tok 138,361 2.6% Open to Search & Training 1022 ms
atlassian.com ADA 80 74% 6,652 tok 540,503 17.5% Open to Search & Training 2119 ms
redis.io ADA 79 80% 11,721 tok 427,454 2.5% Open to Search & Training 86 ms
neon.tech ADA 79 86% 7,418 tok 110,759 1.4% Open to Search & Training 236 ms