netlify.com
B+ (81/100) Open to Search & TrainingPush your ideas to the web | Netlify
| AI & /llms.txt Readiness | Signal-to-Noise Ratio | Token Savings via /llms.txt | Network TTFB | TLS & HTTP Security | DNS & Edge Stack |
|---|---|---|---|---|---|
| 82/100 | 2% (2,059 / 102,713 tok) | -99.3% fewer tokens | 906 ms (62/100) | 70/100 | Netlify Edge (Astro) |
Web-to-Token Efficiency & Agent Ingestion Cost
~4 bytes/token UTF-8 heuristic| Ingestion Source | Payload | Est. Tokens | Cost / 1k Reads (Flash $0.35) | Cost / 1k Reads (Pro $1.25) |
|---|---|---|---|---|
Raw HTML DOM (GET /) |
401.2 KB | 102,713 | $35.9496 | $128.3913 |
| Stripped Readable Text | 8.0 KB | 2,059 | $0.7207 | $2.5738 |
/llms.txt Manifest |
2.9 KB | 744 | $0.2604 | $0.9300 |
/llms.txt Spec Linter & Agent Endpoint Probe
Status: Spec Compliant · Spec Rules →
| GET /llms.txt | HTTP 200 · 2,973 bytes (~744 tokens · 46 lines) |
| Spec Check: # H1 Title | Pass ("Netlify") |
| Spec Check: > Summary | Pass ("Netlify is the composable web platform for building, deploying, and scaling modern web projects — and the agents that build them. Every page below is also available as Markdown by ") |
| ## H2 Sections & Links | 5 sections · 28 canonical markdown links |
| GET /llms-full.txt | Not deployed |
| GET /.well-known/mcp.json | Not advertised |
| JSON-LD Schema Entities | Organization, ImageObject, Person, PostalAddress, ContactPoint, WebSite, WebPage, SpeakableSpecification, BreadcrumbList, ListItem, SoftwareApplication, Offer, ItemList, Service |
# Netlify > Netlify is the composable web platform for building, deploying, and scaling modern web projects — and the agents that build them. Every page below is also available as Markdown by appending `.md` (or sending `Accept: text/markdown`). ## Platform - [Platform overview](https://www.netlify.com/platform.md): The Netlify composable web platform. - [Build](https://www.netlify.com/platform/core/build.md): Continuous deployment and build infrastructure. - [Edge](https://www.netlify.com/pl
AI Crawler /robots.txt Access Matrix
Open to Search & Training · Bot Directory →
| User-Agent Token | Purpose / Operator | Effective Directive |
|---|---|---|
| OAI-SearchBot | ChatGPT Search Citations | Allow: / |
| PerplexityBot | Perplexity Answer Citations | Allow: / |
| ChatGPT-User | Live User Agent Browsing | Allow: / |
| Claude-SearchBot | Anthropic Search Grounding | Allow: / |
| GPTBot | Foundation Model Training | Allow: / |
| ClaudeBot | Foundation Model Training | Allow: / |
| Google-Extended | Gemini Training Control | Allow: / |
| Applebot-Extended | Apple Intelligence Training | Allow: / |
| Meta-ExternalAgent | Llama Training & Indexing | Allow: / |
| CCBot | Open Dataset Training Corpus | Allow: / |
HTTP Response & Handshake Timing
GET https://www.netlify.com/| DNS Lookup | 64 ms | HTML Document | 401.2 KB |
| TCP Connect | 12 ms | Script Tags | 29 |
| TLS Handshake | 374 ms | Stylesheets | 7 |
| Time to First Byte (TTFB) | 906 ms | Images (with alt) | 23 / 23 |
| Total Transfer | 916 ms | HTTP/3 (Alt-Svc) | Not advertised |
Edge Network & Application Stack
Header & DOM Signatures| Edge / Reverse Proxy | Netlify Edge |
| Application Framework | Astro |
| Server Header | Netlify |
| Mail Provider (MX) | Google Workspace |
| Telemetry Signatures | GA4 / GTM |
| TXT Verifications | Google Search Console, OpenAI Domain Verified, Microsoft Entra, Stripe Verified, Anthropic Verified |
TLS Certificate & HTTP Security Policy
Port 443 X.509| Certificate Issuer | DigiCert Inc (80 days remaining) |
| Strict-Transport-Security | Present |
| Content-Security-Policy | Not set |
| X-Content-Type-Options | Not set |
| X-Frame-Options | Not set |
| Referrer-Policy | Not set |
| Permissions-Policy | Present |
| SPF / DMARC Policy | SPF: Yes · DMARC: Yes |
Authoritative DNS & Document Head
A / AAAA / NS / Canonical| A (IPv4) | 3.33.186.135, 15.197.167.90 |
| AAAA (IPv6) | 2406:da1a:103:e602::1f5 |
| NS (Nameservers) | dns3.p04.nsone.net, dns2.p04.nsone.net, ns01.netlifydns.com, dns1.p04.nsone.net, ns03.netlifydns.com, dns4.p04.nsone.net |
| HTML Title (36c) | Push your ideas to the web | Netlify |
| /sitemap.xml | Not found |
Hosted /llms.txt Mirror & Status Badge
Platform Setup Guide →
<head> Tag (for Shopify, Webflow, Framer, Wix, Squarespace & WordPress):
Technical Synthesis & Agentic Ingestion Analysis: netlify.com
Automated Engineering Assessment1. HTML-to-Token Efficiency & LLM Context Window Cost
An unauthenticated HTTPS GET request to https://www.netlify.com/ returns an initial HTML payload of 401.2 KB, corresponding to approximately 102,713 UTF-8 tokens when ingested raw by an AI coding agent, retrieval pipeline, or headless browser. After stripping inline <script>, <style>, <svg>, and DOM markup tags, the human-readable text footprint measures 2,059 tokens (8.0 KB)—yielding an HTML Signal-to-Noise Ratio of 2%.
Because netlify.com publishes a valid /llms.txt manifest (measuring 744 tokens across 46 lines), AI retrieval agents that read /llms.txt instead of scraping the raw DOM reduce token consumption by 99.3%—cutting 1,000-read inference input costs from $128.3913 to $0.9300 at frontier model rates ($1.25/1M tokens), or $0.2604 on Gemini 4 Hydrogen ($0.35/1M).
2. Indexed Structure Inside netlify.com/llms.txt
Sitecube’s specification linter verified 5 H2 section headings and 28 Markdown links inside https://netlify.com/llms.txt under the primary heading "Netlify".
Documented sections include: Platform</code>, <code>Solutions</code>, <code>Company</code>, <code>Resources</code>, <code>Optional.
Key canonical endpoints referenced in the manifest include
Platform overview (https://www.netlify.com/platform.md), Build (https://www.netlify.com/platform/core/build.md), Edge (https://www.netlify.com/platform/core/edge.md), Agent Runners (https://www.netlify.com/platform/agent-runners.md), AI Gateway (https://www.netlify.com/platform/ai-gateway.md).
3. Edge Delivery, TLS Handshake & Security Header Assessment
Traffic for netlify.com resolves to 3.33.186.135 via Netlify Edge running Astro, achieving a measured Time to First Byte (TTFB) of 906 ms (DNS lookup: 64 ms, TCP connect: 12 ms, TLS handshake: 374 ms). The port 443 TLS certificate is issued by DigiCert Inc with 80 days remaining before expiration (valid through 2027-02-05). Outbound email authentication via SPF is present and DMARC (_dmarc.netlify.com) is enforced.
Comparable Hosts in Web-to-Token & /llms.txt Registry
Full Index (33 hosts) →| Host | Rating | /llms.txt | HTML Tokens | Text Tokens | Signal % | Crawler Posture | TTFB |
|---|---|---|---|---|---|---|---|
| sitecube.com | A+ 98 | 2,099 tok | 16,563 | 1,347 | 8.1% | Open to Search & Training | 96 ms |
| cloudflare.com | A+ 96 | 4,294 tok | 333,631 | 471 | 0.1% | Open to Search & Training | 294 ms |
| trendyflash.com | A+ 95 | 3,256 tok | 12,230 | 1,739 | 14.2% | Open to Search & Training | 85 ms |
| multifactor.com | A+ 94 | 656 tok | 98,275 | 673 | 0.7% | Open to Search & Training | 109 ms |
| tierones.io | A+ 93 | 481 tok | 3,744 | 693 | 18.5% | Open to Search & Training | 56 ms |
| aiimpacted.org | A+ 93 | 1,355 tok | 17,701 | 3,599 | 20.3% | Open to Search & Training | 119 ms |
| github.com | A+ 92 | 7,165 tok | 131,479 | 1,185 | 0.9% | Open to Search & Training | 26 ms |
| vercel.com | A+ 92 | 1,385 tok | 149,553 | 1,193 | 0.8% | Open to Search & Training | 66 ms |
| render.com | A+ 92 | 13,304 tok | 190,754 | 2,018 | 1.1% | Open to Search & Training | 306 ms |
| cloq.com | A 91 | 1,169 tok | 2,109 | 690 | 32.7% | Open to Search & Training | 46 ms |
| postman.com | A 91 | 5,375 tok | 118,892 | 11,040 | 9.3% | Open to Search & Training | 769 ms |
| redis.io | A 90 | 11,721 tok | 427,454 | 10,605 | 2.5% | Open to Search & Training | 86 ms |