SITECUBE /llms.txt Validator · AI Crawler Registry · Web-to-Token Observatory

neon.tech

A (89/100) Open to Search & Training

Neon — Postgres backends for apps and agents

Raw HTML Tokens: ~110,734 tok
Clean Text Tokens: ~1,629 tok (1.5% signal)
/llms.txt Manifest: 7,418 tok (Spec Compliant)
Edge / TTFB: Cloudflare · 165 ms
AI & /llms.txt Readiness Signal-to-Noise Ratio Token Savings via /llms.txt Network TTFB TLS & HTTP Security DNS & Edge Stack
90/100 1.5% (1,629 / 110,734 tok) -93.3% fewer tokens 165 ms (92/100) 63/100 Cloudflare (Next.js)

Web-to-Token Efficiency & Agent Ingestion Cost

~4 bytes/token UTF-8 heuristic
Ingestion Source Payload Est. Tokens Cost / 1k Reads (Flash $0.35) Cost / 1k Reads (Pro $1.25)
Raw HTML DOM (GET /) 432.6 KB 110,734 $38.7569 $138.4175
Stripped Readable Text 6.4 KB 1,629 $0.5702 $2.0363
/llms.txt Manifest 29.0 KB 7,418 $2.5963 $9.2725
HTML Signal-to-Noise Ratio: 1.5% readable text vs. 98.5% markup/script overhead.

/llms.txt Spec Linter & Agent Endpoint Probe

Status: Spec Compliant
GET /llms.txt HTTP 200 · 29,670 bytes (~7,418 tokens · 351 lines)
Spec Check: # H1 Title Pass ("Neon Postgres")
Spec Check: > Summary Pass ("Neon is a complete set of cloud backend primitives built around Lakebase Postgres, for developers, startups, and agent platforms, from Databricks. Services include Lakebase Postgre")
## H2 Sections & Links 27 sections · 193 canonical markdown links
GET /llms-full.txt HTTP 200 · 7,640,785 bytes (~1,910,197 tokens)
GET /.well-known/mcp.json Not advertised
JSON-LD Schema Entities Organization, ContactPoint
Live Payload from https://neon.tech/llms.txt
# Neon Postgres

> Neon is a complete set of cloud backend primitives built around Lakebase Postgres, for developers, startups, and agent platforms, from Databricks. Services include Lakebase Postgres, Managed Better Auth, Realtime, Data API, Functions, Object Storage, AI Gateway. Lakebase Postgres on Neon includes autoscaling, instant restore, and scale-to-zero, with native branching, realtime and a fully reactive DX and works with any language, framework, or ORM that supports Postgres.

**Get 

AI Crawler /robots.txt Access Matrix

Open to Search & Training
User-Agent Token Purpose / Operator Effective Directive
OAI-SearchBot ChatGPT Search Citations Allow: /
PerplexityBot Perplexity Answer Citations Allow: /
ChatGPT-User Live User Agent Browsing Allow: /
Claude-SearchBot Anthropic Search Grounding Allow: /
GPTBot Foundation Model Training Allow: /
ClaudeBot Foundation Model Training Allow: /
Google-Extended Gemini Training Control Allow: /
Applebot-Extended Apple Intelligence Training Allow: /
Meta-ExternalAgent Llama Training & Indexing Allow: /
CCBot Open Dataset Training Corpus Allow: /

HTTP Response & Handshake Timing

GET https://neon.com/
DNS Lookup 73 ms HTML Document 432.6 KB
TCP Connect 6 ms Script Tags 72
TLS Handshake 39 ms Stylesheets 2
Time to First Byte (TTFB) 165 ms Images (with alt) 3 / 94
Total Transfer 170 ms HTTP/3 (Alt-Svc) Not advertised

Edge Network & Application Stack

Header & DOM Signatures
Edge / Reverse Proxy Cloudflare
Application Framework Next.js
Server Header Vercel
Mail Provider (MX) Google Workspace
Telemetry Signatures Zero Client Trackers
TXT Verifications Microsoft Entra, Google Search Console

TLS Certificate & HTTP Security Policy

Port 443 X.509
Certificate Issuer Google Trust Services (45 days remaining)
Strict-Transport-Security Present
Content-Security-Policy Not set
X-Content-Type-Options Not set
X-Frame-Options Not set
Referrer-Policy Not set
Permissions-Policy Not set
SPF / DMARC Policy SPF: Yes · DMARC: Yes

Authoritative DNS & Document Head

A / AAAA / NS / Canonical
A (IPv4) 104.18.23.51, 104.18.22.51
AAAA (IPv6) 2606:4700::6812:1633, 2606:4700::6812:1733
NS (Nameservers) novalee.ns.cloudflare.com, kobe.ns.cloudflare.com
HTML Title (44c) Neon — Postgres backends for apps and agents
/sitemap.xml Valid XML Sitemap

Hosted /llms.txt Mirror & Status Badge

Platform Setup Guide →
1-Line <head> Tag (for Shopify, Webflow, Framer, Wix, Squarespace & WordPress):
Sitecube status for neon.tech
GitHub / Docs Markdown Badge:
HTML Badge:

Technical Synthesis & Agentic Ingestion Analysis: neon.tech

Automated Engineering Assessment

1. HTML-to-Token Efficiency & LLM Context Window Cost

An unauthenticated HTTPS GET request to https://neon.com/ returns an initial HTML payload of 432.6 KB, corresponding to approximately 110,734 UTF-8 tokens when ingested raw by an AI coding agent, retrieval pipeline, or headless browser. After stripping inline <script>, <style>, <svg>, and DOM markup tags, the human-readable text footprint measures 1,629 tokens (6.4 KB)—yielding an HTML Signal-to-Noise Ratio of 1.5%. Because neon.tech publishes a valid /llms.txt manifest (measuring 7,418 tokens across 351 lines), AI retrieval agents that read /llms.txt instead of scraping the raw DOM reduce token consumption by 93.3%—cutting 1,000-read inference input costs from $138.4175 to $9.2725 at frontier model rates ($1.25/1M tokens), or $2.5963 on Gemini 4 Hydrogen ($0.35/1M).

2. Indexed Structure Inside neon.tech/llms.txt

Sitecube’s specification linter verified 27 H2 section headings and 193 Markdown links inside https://neon.tech/llms.txt under the primary heading "Neon Postgres". Documented sections include: Common tasks</code>, <code>Introduction</code>, <code>Get Started</code>, <code>Connect</code>, <code>Neon CLI</code>, <code>AI & Agents</code>, <code>Auth</code>, <code>Neon Functions. Key canonical endpoints referenced in the manifest include Claimable Neon (https://neon.com/auth.md), Need a Neon account and the user is not around: provision one now; they claim it later (https://neon.com/auth.md), Pricing and plans (https://neon.com/pricing.md), Customer case studies by use case, with results quoted from each story (https://neon.com/case-studies.md), Declare a whole backend in one file (https://neon.com/docs/reference/neon-ts.md).

3. Edge Delivery, TLS Handshake & Security Header Assessment

Traffic for neon.tech resolves to 104.18.23.51 via Cloudflare running Next.js, achieving a measured Time to First Byte (TTFB) of 165 ms (DNS lookup: 73 ms, TCP connect: 6 ms, TLS handshake: 39 ms). The port 443 TLS certificate is issued by Google Trust Services with 45 days remaining before expiration (valid through 2026-12-31). Outbound email authentication via SPF is present and DMARC (_dmarc.neon.tech) is enforced.

Comparable Hosts in Web-to-Token & /llms.txt Registry

Full Index (29 hosts) →
Host Rating /llms.txt HTML Tokens Text Tokens Signal % Crawler Posture TTFB
sitecube.com A+ 98 1,744 tok 12,387 1,227 9.9% Open to Search & Training 66 ms
cloudflare.com A+ 96 4,294 tok 333,631 471 0.1% Open to Search & Training 290 ms
trendyflash.com A+ 95 3,120 tok 12,197 1,705 14% Open to Search & Training 90 ms
multifactor.com A+ 94 656 tok 98,275 673 0.7% Open to Search & Training 109 ms
tierones.io A+ 93 481 tok 3,744 693 18.5% Open to Search & Training 30 ms
dosefacts.org A+ 93 10,613 tok 29,181 7,309 25% Open to Search & Training 107 ms
aiimpacted.org A+ 93 1,355 tok 17,701 3,599 20.3% Open to Search & Training 119 ms
github.com A+ 92 7,165 tok 131,391 1,159 0.9% Open to Search & Training 43 ms
vercel.com A+ 92 1,385 tok 149,553 1,193 0.8% Open to Search & Training 57 ms
cloq.com A 91 1,169 tok 2,109 690 32.7% Open to Search & Training 34 ms
supabase.com A 89 879 tok 337,513 1,905 0.6% Open to Search & Training 55 ms
shopify.com A 89 3,161 tok 172,951 513 0.3% Open to Search & Training 104 ms