instagram.com

ADA 51/100 (D) ARS 6% Established Agent-Ready Host

Instagram

AI Domain Authority: ADA 51/100 (Established Agent-Ready Host)
Raw HTML / Signal: ~98,233 tok (0% signal)
/llms.txt Manifest: Not deployed
Edge / TTFB: Direct Origin · 2089 ms
AI Domain Authority (ADA) Agent Readiness (ARS) Citation Authority Token Savings (/llms.txt) Network TTFB Provenance & TLS
51/100 (D) 6% 72/100 (5 citers) 0% (No /llms.txt) 2089 ms (Direct Origin) 91/100

AI Domain Authority (ADA 51/100) & Citation Graph

Open Formula & Spec →
1. Machine Citation Authority (58%) 72/100 · TrustRank over /llms.txt, mcp.json & JSON-LD graphs
2. Agent Ingestion / ARS (18%) 6% · Manifest validity, token efficiency, TTFB & bot access
3. Entity & DNS Provenance (14%) 91/100 · X.509 TLS, security headers, SPF/DMARC & TXT proofs
4. Crawler Pulse & Edge (10%) 40/100 · Edge & search-bot reachability
Observed Inbound Machine Citers stripe.com · supabase.com · webflow.com · figma.com · gitlab.com
Outbound Cited Authorities (0) No external manifest links extracted
Compare instagram.com head-to-head:

Web-to-Token Efficiency & Agent Ingestion Cost

~4 bytes/token UTF-8 heuristic
Ingestion Source Payload Est. Tokens Cost / 1k Reads (Flash $0.35) Cost / 1k Reads (Pro $1.25)
Raw HTML DOM (GET /) 383.7 KB 98,233 $34.3816 $122.7913
Stripped Readable Text 0.0 KB 3 $0.0011 $0.0038
/llms.txt Manifest Not deployed — agents must parse 98,233 raw HTML tokens
HTML Signal-to-Noise Ratio: 0% readable text vs. 100% markup/script overhead. Token Optimization Guide →

/llms.txt Spec Linter & Agent Endpoint Probe

Status: Not Deployed · Spec Rules →
GET /llms.txt Missing — Generate spec-compliant /llms.txt for instagram.com →
GET /llms-full.txt Not deployed
GET /.well-known/mcp.json Not advertised
JSON-LD Schema Entities None detected in initial HTML

AI Crawler /robots.txt Access Matrix

Strict AI Blockade · Bot Directory →
User-Agent Token Purpose / Operator Effective Directive
OAI-SearchBot ChatGPT Search Citations Disallow: /
PerplexityBot Perplexity Answer Citations Disallow: /
ChatGPT-User Live User Agent Browsing Disallow: /
Claude-SearchBot Anthropic Search Grounding Disallow: /
GPTBot Foundation Model Training Disallow: /
ClaudeBot Foundation Model Training Disallow: /
Google-Extended Gemini Training Control Disallow: /
Applebot-Extended Apple Intelligence Training Disallow: /
Meta-ExternalAgent Llama Training & Indexing Disallow: /
CCBot Open Dataset Training Corpus Disallow: /

HTTP Response & Handshake Timing

GET https://www.instagram.com/
DNS Lookup 1516 ms HTML Document 383.7 KB
TCP Connect 33 ms Script Tags 87
TLS Handshake 243 ms Stylesheets 1
Time to First Byte (TTFB) 2089 ms Images (with alt) 0 / 2
Total Transfer 2281 ms HTTP/3 (Alt-Svc) Yes (h3)

Edge Network & Application Stack

Header & DOM Signatures
Edge / Reverse Proxy Direct Origin
Application Framework Custom SSR / Static
Server Header Protected Edge
Mail Provider (MX) Proofpoint
Telemetry Signatures Zero Client Trackers
TXT Verifications Slack, Google Search Console, Microsoft Entra

TLS Certificate & HTTP Security Policy

Port 443 X.509
Certificate Issuer DigiCert Inc (7 days remaining)
Strict-Transport-Security Present
Content-Security-Policy Present
X-Content-Type-Options Present
X-Frame-Options Present
Referrer-Policy Not set
Permissions-Policy Present
SPF / DMARC Policy SPF: Yes · DMARC: Yes

Authoritative DNS & Document Head

A / AAAA / NS / Canonical
A (IPv4) 57.144.124.34
AAAA (IPv6) 2a03:2880:f334:22:face:b00c::4420
NS (Nameservers) d.ns.instagram.com, b.ns.instagram.com, c.ns.instagram.com, a.ns.instagram.com
HTML Title (9c) Instagram
/sitemap.xml Not found

Hosted /llms.txt Mirror & Status Badge

Platform Setup Guide →
1-Line <head> Tag (for Shopify, Webflow, Framer, Wix, Squarespace & WordPress):
Sitecube status for instagram.com
GitHub / Docs Markdown Badge:
HTML Badge:

Technical Synthesis & Agentic Ingestion Analysis: instagram.com

Automated Engineering Assessment

1. HTML-to-Token Efficiency & LLM Context Window Cost

An unauthenticated HTTPS GET request to https://www.instagram.com/ returns an initial HTML payload of 383.7 KB, corresponding to approximately 98,233 UTF-8 tokens when ingested raw by an AI coding agent, retrieval pipeline, or headless browser. After stripping inline <script>, <style>, <svg>, and DOM markup tags, the human-readable text footprint measures 3 tokens (0.0 KB)—yielding an HTML Signal-to-Noise Ratio of 0%. Because instagram.com does not currently serve a machine-readable /llms.txt manifest at its root path, autonomous agents must either parse the full 98,233-token HTML payload ($122.7913 per 1,000 frontier reads) or run a DOM-stripping pass before grounding.

2. AI Crawler Governance & /robots.txt Posture

Based on live inspection of https://instagram.com/robots.txt, instagram.com maintains a Strict AI Blockade posture. Specifically, AI search citation crawlers (OAI-SearchBot: Disallowed, PerplexityBot: Disallowed) and foundation model training crawlers (GPTBot: Disallowed, ClaudeBot: Disallowed, CCBot: Disallowed) are governed explicitly by the host’s root robots policy.

3. Edge Delivery, TLS Handshake & Security Header Assessment

Traffic for instagram.com resolves to 57.144.124.34 via Direct Origin running Custom SSR / Static, achieving a measured Time to First Byte (TTFB) of 2089 ms (DNS lookup: 1516 ms, TCP connect: 33 ms, TLS handshake: 243 ms). The port 443 TLS certificate is issued by DigiCert Inc with 7 days remaining before expiration (valid through 2026-11-24). Outbound email authentication via SPF is present and DMARC (_dmarc.instagram.com) is enforced.

Comparable Hosts in Sitecube ADA & /llms.txt Registry

Full ADA Index (43 hosts) →
Host ADA (1–100) ARS /llms.txt HTML Tokens Signal % Crawler Posture TTFB
github.com ADA 91 74% 7,165 tok 131,240 0.9% Open to Search & Training 27 ms
cloudflare.com ADA 88 96% 4,294 tok 333,631 0.1% Open to Search & Training 264 ms
vercel.com ADA 85 80% 3,722 tok 149,590 0.8% Open to Search & Training 66 ms
render.com ADA 83 90% 13,304 tok 190,754 1.1% Open to Search & Training 306 ms
shopify.com ADA 82 80% 3,161 tok 172,976 0.3% Open to Search & Training 106 ms
trendyflash.com ADA 81 87% 3,416 tok 12,412 14.7% Open to Search & Training 24 ms
nextjs.org ADA 80 74% 3,648 tok 67,086 1.6% Open to Search & Training 61 ms
supabase.com ADA 80 88% 879 tok 337,794 0.6% Open to Search & Training 58 ms
webflow.com ADA 80 72% 3,324 tok 138,361 2.6% Open to Search & Training 1022 ms
atlassian.com ADA 80 74% 6,652 tok 540,503 17.5% Open to Search & Training 2119 ms
redis.io ADA 79 80% 11,721 tok 427,454 2.5% Open to Search & Training 86 ms
neon.tech ADA 79 86% 7,418 tok 110,759 1.4% Open to Search & Training 236 ms