wikipedia.org

ADA 70/100 (B) ARS 27% High-Authority AI Source

Wikipedia

AI Domain Authority: ADA 70/100 (High-Authority AI Source)
Raw HTML / Signal: ~30,627 tok (8.7% signal)
/llms.txt Manifest: Not deployed
Edge / TTFB: Direct Origin · 702 ms
AI Domain Authority (ADA) Agent Readiness (ARS) Citation Authority Token Savings (/llms.txt) Network TTFB Provenance & TLS
70/100 (B) 27% 88/100 (5 citers) 0% (No /llms.txt) 702 ms (Direct Origin) 72/100

AI Domain Authority (ADA 70/100) & Citation Graph

Open Formula & Spec →
1. Machine Citation Authority (58%) 88/100 · TrustRank over /llms.txt, mcp.json & JSON-LD graphs
2. Agent Ingestion / ARS (18%) 27% · Manifest validity, token efficiency, TTFB & bot access
3. Entity & DNS Provenance (14%) 72/100 · X.509 TLS, security headers, SPF/DMARC & TXT proofs
4. Crawler Pulse & Edge (10%) 44/100 · Edge & search-bot reachability
Observed Inbound Machine Citers vercel.com · nextjs.org · stripe.com · webflow.com · gitlab.com
Outbound Cited Authorities (5) google.com · apple.com · wikimedia.org · wikimediafoundation.org · creativecommons.org
Compare wikipedia.org head-to-head:

Web-to-Token Efficiency & Agent Ingestion Cost

~4 bytes/token UTF-8 heuristic
Ingestion Source Payload Est. Tokens Cost / 1k Reads (Flash $0.35) Cost / 1k Reads (Pro $1.25)
Raw HTML DOM (GET /) 119.6 KB 30,627 $10.7195 $38.2838
Stripped Readable Text 10.4 KB 2,660 $0.9310 $3.3250
/llms.txt Manifest Not deployed — agents must parse 30,627 raw HTML tokens
HTML Signal-to-Noise Ratio: 8.7% readable text vs. 91.3% markup/script overhead. Token Optimization Guide →

/llms.txt Spec Linter & Agent Endpoint Probe

Status: Not Deployed · Spec Rules →
GET /llms.txt Missing — Generate spec-compliant /llms.txt for wikipedia.org →
GET /llms-full.txt Not deployed
GET /.well-known/mcp.json Not advertised
JSON-LD Schema Entities None detected in initial HTML

AI Crawler /robots.txt Access Matrix

Open to Search & Training · Bot Directory →
User-Agent Token Purpose / Operator Effective Directive
OAI-SearchBot ChatGPT Search Citations Allow: /
PerplexityBot Perplexity Answer Citations Allow: /
ChatGPT-User Live User Agent Browsing Allow: /
Claude-SearchBot Anthropic Search Grounding Allow: /
GPTBot Foundation Model Training Allow: /
ClaudeBot Foundation Model Training Allow: /
Google-Extended Gemini Training Control Allow: /
Applebot-Extended Apple Intelligence Training Allow: /
Meta-ExternalAgent Llama Training & Indexing Allow: /
CCBot Open Dataset Training Corpus Allow: /

HTTP Response & Handshake Timing

GET https://www.wikipedia.org/
DNS Lookup 348 ms HTML Document 119.6 KB
TCP Connect 109 ms Script Tags 4
TLS Handshake 110 ms Stylesheets 0
Time to First Byte (TTFB) 702 ms Images (with alt) 0 / 7
Total Transfer 756 ms HTTP/3 (Alt-Svc) Not advertised

Edge Network & Application Stack

Header & DOM Signatures
Edge / Reverse Proxy Direct Origin
Application Framework Custom SSR / Static
Server Header ATS/9.2.16
Mail Provider (MX) Custom MX
Telemetry Signatures Zero Client Trackers
TXT Verifications Google Search Console

TLS Certificate & HTTP Security Policy

Port 443 X.509
Certificate Issuer Let's Encrypt (46 days remaining)
Strict-Transport-Security Present
Content-Security-Policy Not set
X-Content-Type-Options Not set
X-Frame-Options Not set
Referrer-Policy Not set
Permissions-Policy Not set
SPF / DMARC Policy SPF: Yes · DMARC: Yes

Authoritative DNS & Document Head

A / AAAA / NS / Canonical
A (IPv4) 103.102.166.224
AAAA (IPv6) 2001:df2:e500:ed1a::1
NS (Nameservers) ns0.wikimedia.org, ns2.wikimedia.org, ns1.wikimedia.org
HTML Title (9c) Wikipedia
/sitemap.xml Not found

Hosted /llms.txt Mirror & Status Badge

Platform Setup Guide →
1-Line <head> Tag (for Shopify, Webflow, Framer, Wix, Squarespace & WordPress):
Sitecube status for wikipedia.org
GitHub / Docs Markdown Badge:
HTML Badge:

Technical Synthesis & Agentic Ingestion Analysis: wikipedia.org

Automated Engineering Assessment

1. HTML-to-Token Efficiency & LLM Context Window Cost

An unauthenticated HTTPS GET request to https://www.wikipedia.org/ returns an initial HTML payload of 119.6 KB, corresponding to approximately 30,627 UTF-8 tokens when ingested raw by an AI coding agent, retrieval pipeline, or headless browser. After stripping inline <script>, <style>, <svg>, and DOM markup tags, the human-readable text footprint measures 2,660 tokens (10.4 KB)—yielding an HTML Signal-to-Noise Ratio of 8.7%. Because wikipedia.org does not currently serve a machine-readable /llms.txt manifest at its root path, autonomous agents must either parse the full 30,627-token HTML payload ($38.2838 per 1,000 frontier reads) or run a DOM-stripping pass before grounding.

2. AI Crawler Governance & /robots.txt Posture

Based on live inspection of https://wikipedia.org/robots.txt, wikipedia.org maintains a Open to Search & Training posture. Specifically, AI search citation crawlers (OAI-SearchBot: Allowed, PerplexityBot: Allowed) and foundation model training crawlers (GPTBot: Allowed, ClaudeBot: Allowed, CCBot: Allowed) are governed explicitly by the host’s root robots policy.

3. Edge Delivery, TLS Handshake & Security Header Assessment

Traffic for wikipedia.org resolves to 103.102.166.224 via Direct Origin running Custom SSR / Static, achieving a measured Time to First Byte (TTFB) of 702 ms (DNS lookup: 348 ms, TCP connect: 109 ms, TLS handshake: 110 ms). The port 443 TLS certificate is issued by Let's Encrypt with 46 days remaining before expiration (valid through 2027-01-02). Outbound email authentication via SPF is present and DMARC (_dmarc.wikipedia.org) is enforced.

Comparable Hosts in Sitecube ADA & /llms.txt Registry

Full ADA Index (46 hosts) →
Host ADA (1–100) ARS /llms.txt HTML Tokens Signal % Crawler Posture TTFB
github.com ADA 91 74% 7,165 tok 131,240 0.9% Open to Search & Training 27 ms
cloudflare.com ADA 88 96% 4,294 tok 333,631 0.1% Open to Search & Training 264 ms
vercel.com ADA 85 80% 3,722 tok 149,590 0.8% Open to Search & Training 66 ms
render.com ADA 83 90% 13,304 tok 190,754 1.1% Open to Search & Training 306 ms
notion.com ADA 82 90% 1,701 tok 42,100 1.6% Selective Agent Access 131 ms
shopify.com ADA 82 80% 3,161 tok 172,976 0.3% Open to Search & Training 106 ms
trendyflash.com ADA 81 87% 3,416 tok 12,412 14.7% Open to Search & Training 24 ms
nextjs.org ADA 80 74% 3,648 tok 67,086 1.6% Open to Search & Training 61 ms
supabase.com ADA 80 88% 879 tok 337,794 0.6% Open to Search & Training 58 ms
webflow.com ADA 80 72% 3,324 tok 138,361 2.6% Open to Search & Training 1022 ms
atlassian.com ADA 80 74% 6,652 tok 540,503 17.5% Open to Search & Training 2119 ms
redis.io ADA 79 80% 11,721 tok 427,454 2.5% Open to Search & Training 86 ms