redis.io
A (88/100) Open to Search & TrainingRedis - Real-time data for agents & apps
| AI & /llms.txt Readiness | Signal-to-Noise Ratio | Token Savings via /llms.txt | Network TTFB | TLS & HTTP Security | DNS & Edge Stack |
|---|---|---|---|---|---|
| 82/100 | 2.8% (11,796 / 427,364 tok) | -97.3% fewer tokens | 130 ms (92/100) | 79/100 | Cloudflare (Next.js) |
Web-to-Token Efficiency & Agent Ingestion Cost
~4 bytes/token UTF-8 heuristic| Ingestion Source | Payload | Est. Tokens | Cost / 1k Reads (Flash $0.35) | Cost / 1k Reads (Pro $1.25) |
|---|---|---|---|---|
Raw HTML DOM (GET /) |
1,669.4 KB | 427,364 | $149.5774 | $534.2050 |
| Stripped Readable Text | 46.1 KB | 11,796 | $4.1286 | $14.7450 |
/llms.txt Manifest |
45.8 KB | 11,721 | $4.1024 | $14.6513 |
/llms.txt Spec Linter & Agent Endpoint Probe
Status: Spec Compliant
| GET /llms.txt | HTTP 200 · 46,882 bytes (~11,721 tokens · 248 lines) |
| Spec Check: # H1 Title | Pass ("Redis Documentation") |
| Spec Check: > Summary | Pass ("Redis: in-memory data platform for caching, real-time apps, search, vectors, streams, pub/sub, and enterprise deployments (Redis Cloud, Redis Software, open source).") |
| ## H2 Sections & Links | 11 sections · 199 canonical markdown links |
| GET /llms-full.txt | Not deployed |
| GET /.well-known/mcp.json | Not advertised |
| JSON-LD Schema Entities | WebPage, Person, ImageObject, Organization, BreadcrumbList, ListItem |
# Redis Documentation > Redis: in-memory data platform for caching, real-time apps, search, vectors, streams, pub/sub, and enterprise deployments (Redis Cloud, Redis Software, open source). ## Core Docs - [Docs homepage](https://redis.io/docs/latest/): Entry point for Redis documentation—install, develop, operate, APIs, and feature references for developers and operators. - [APIs](https://redis.io/docs/latest/apis/index.html.md): Redis API surfaces and integration entry points for programmati
AI Crawler /robots.txt Access Matrix
Open to Search & Training
| User-Agent Token | Purpose / Operator | Effective Directive |
|---|---|---|
| OAI-SearchBot | ChatGPT Search Citations | Allow: / |
| PerplexityBot | Perplexity Answer Citations | Allow: / |
| ChatGPT-User | Live User Agent Browsing | Allow: / |
| Claude-SearchBot | Anthropic Search Grounding | Allow: / |
| GPTBot | Foundation Model Training | Allow: / |
| ClaudeBot | Foundation Model Training | Allow: / |
| Google-Extended | Gemini Training Control | Allow: / |
| Applebot-Extended | Apple Intelligence Training | Allow: / |
| Meta-ExternalAgent | Llama Training & Indexing | Allow: / |
| CCBot | Open Dataset Training Corpus | Allow: / |
HTTP Response & Handshake Timing
GET https://redis.io/| DNS Lookup | 1 ms | HTML Document | 1669.4 KB |
| TCP Connect | 1 ms | Script Tags | 39 |
| TLS Handshake | 58 ms | Stylesheets | 7 |
| Time to First Byte (TTFB) | 130 ms | Images (with alt) | 45 / 45 |
| Total Transfer | 140 ms | HTTP/3 (Alt-Svc) | Not advertised |
Edge Network & Application Stack
Header & DOM Signatures| Edge / Reverse Proxy | Cloudflare |
| Application Framework | Next.js |
| Server Header | cloudflare |
| Mail Provider (MX) | Mimecast |
| Telemetry Signatures | GA4 / GTM |
| TXT Verifications | Google Search Console |
TLS Certificate & HTTP Security Policy
Port 443 X.509| Certificate Issuer | Google Trust Services (76 days remaining) |
| Strict-Transport-Security | Present |
| Content-Security-Policy | Present |
| X-Content-Type-Options | Not set |
| X-Frame-Options | Present |
| Referrer-Policy | Not set |
| Permissions-Policy | Not set |
| SPF / DMARC Policy | SPF: Yes · DMARC: Yes |
Authoritative DNS & Document Head
A / AAAA / NS / Canonical| A (IPv4) | 104.18.25.196 |
| AAAA (IPv6) | None |
| NS (Nameservers) | ns-1731.awsdns-24.co.uk, ns-247.awsdns-30.com, ns-791.awsdns-34.net, ns-1248.awsdns-28.org |
| HTML Title (40c) | Redis - Real-time data for agents & apps |
| /sitemap.xml | Valid XML Sitemap |
Hosted /llms.txt Mirror & Status Badge
Platform Setup Guide →
<head> Tag (for Shopify, Webflow, Framer, Wix, Squarespace & WordPress):
Technical Synthesis & Agentic Ingestion Analysis: redis.io
Automated Engineering Assessment1. HTML-to-Token Efficiency & LLM Context Window Cost
An unauthenticated HTTPS GET request to https://redis.io/ returns an initial HTML payload of 1,669.4 KB, corresponding to approximately 427,364 UTF-8 tokens when ingested raw by an AI coding agent, retrieval pipeline, or headless browser. After stripping inline <script>, <style>, <svg>, and DOM markup tags, the human-readable text footprint measures 11,796 tokens (46.1 KB)—yielding an HTML Signal-to-Noise Ratio of 2.8%.
Because redis.io publishes a valid /llms.txt manifest (measuring 11,721 tokens across 248 lines), AI retrieval agents that read /llms.txt instead of scraping the raw DOM reduce token consumption by 97.3%—cutting 1,000-read inference input costs from $534.2050 to $14.6513 at frontier model rates ($1.25/1M tokens), or $4.1024 on Gemini 4 Hydrogen ($0.35/1M).
2. Indexed Structure Inside redis.io/llms.txt
Sitecube’s specification linter verified 11 H2 section headings and 199 Markdown links inside https://redis.io/llms.txt under the primary heading "Redis Documentation".
Documented sections include: Core Docs</code>, <code>Commands Reference</code>, <code>Development</code>, <code>Client Libraries</code>, <code>Integrations</code>, <code>Operations</code>, <code>Products</code>, <code>AI.
Key canonical endpoints referenced in the manifest include
Docs homepage (https://redis.io/docs/latest/), APIs (https://redis.io/docs/latest/apis/index.html.md), Quick starts (https://redis.io/docs/latest/develop/get-started/index.html.md), Commands index (https://redis.io/docs/latest/commands/), AUTH (https://redis.io/docs/latest/commands/auth/index.html.md).
3. Edge Delivery, TLS Handshake & Security Header Assessment
Traffic for redis.io resolves to 104.18.25.196 via Cloudflare running Next.js, achieving a measured Time to First Byte (TTFB) of 130 ms (DNS lookup: 1 ms, TCP connect: 1 ms, TLS handshake: 58 ms). The port 443 TLS certificate is issued by Google Trust Services with 76 days remaining before expiration (valid through 2027-01-31). Outbound email authentication via SPF is present and DMARC (_dmarc.redis.io) is enforced.
Comparable Hosts in Web-to-Token & /llms.txt Registry
Full Index (28 hosts) →| Host | Rating | /llms.txt | HTML Tokens | Text Tokens | Signal % | Crawler Posture | TTFB |
|---|---|---|---|---|---|---|---|
| sitecube.com | A+ 98 | 1,744 tok | 12,387 | 1,227 | 9.9% | Open to Search & Training | 66 ms |
| cloudflare.com | A+ 96 | 4,294 tok | 333,631 | 471 | 0.1% | Open to Search & Training | 251 ms |
| trendyflash.com | A+ 95 | 3,120 tok | 12,197 | 1,705 | 14% | Open to Search & Training | 36 ms |
| tierones.io | A+ 93 | 481 tok | 3,744 | 693 | 18.5% | Open to Search & Training | 30 ms |
| dosefacts.org | A+ 93 | 10,613 tok | 29,181 | 7,309 | 25% | Open to Search & Training | 107 ms |
| github.com | A+ 92 | 7,165 tok | 131,355 | 1,163 | 0.9% | Open to Search & Training | 27 ms |
| vercel.com | A+ 92 | 1,385 tok | 149,553 | 1,193 | 0.8% | Open to Search & Training | 57 ms |
| aiimpacted.org | A+ 92 | 1,355 tok | 17,717 | 3,605 | 20.3% | Open to Search & Training | 173 ms |
| cloq.com | A 91 | 1,169 tok | 2,109 | 690 | 32.7% | Open to Search & Training | 34 ms |
| multifactor.com | A 91 | 656 tok | 98,275 | 673 | 0.7% | Open to Search & Training | 329 ms |
| supabase.com | A 89 | 879 tok | 337,513 | 1,905 | 0.6% | Open to Search & Training | 55 ms |
| shopify.com | A 89 | 3,161 tok | 172,960 | 513 | 0.3% | Open to Search & Training | 95 ms |