SITECUBE /llms.txt Validator · AI Crawler Registry · Web-to-Token Observatory

datadoghq.com

B+ (81/100) Open to Search & Training

Cloud Monitoring as a Service | Datadog

Raw HTML Tokens: ~70,990 tok
Clean Text Tokens: ~3,506 tok (4.9% signal)
/llms.txt Manifest: 150,542 tok (Spec Compliant)
Edge / TTFB: AWS CloudFront · 481 ms
AI & /llms.txt Readiness Signal-to-Noise Ratio Token Savings via /llms.txt Network TTFB TLS & HTTP Security DNS & Edge Stack
76/100 4.9% (3,506 / 70,990 tok) Expanded Index (150,542 tok) 481 ms (74/100) 91/100 AWS CloudFront (Custom SSR / Static)

Web-to-Token Efficiency & Agent Ingestion Cost

~4 bytes/token UTF-8 heuristic
Ingestion Source Payload Est. Tokens Cost / 1k Reads (Flash $0.35) Cost / 1k Reads (Pro $1.25)
Raw HTML DOM (GET /) 277.3 KB 70,990 $24.8465 $88.7375
Stripped Readable Text 13.7 KB 3,506 $1.2271 $4.3825
/llms.txt Manifest 588.1 KB 150,542 $52.6897 $188.1775
HTML Signal-to-Noise Ratio: 4.9% readable text vs. 95.1% markup/script overhead.

/llms.txt Spec Linter & Agent Endpoint Probe

Status: Spec Compliant
GET /llms.txt HTTP 200 · 602,165 bytes (~150,542 tokens · 591 lines)
Spec Check: # H1 Title Pass ("Datadog")
Spec Check: > Summary Pass ("AI-Powered Observability and Security. See inside any stack, any app, at any scale, anywhere.")
## H2 Sections & Links 12 sections · 558 canonical markdown links
GET /llms-full.txt Not deployed
GET /.well-known/mcp.json Not advertised
JSON-LD Schema Entities None detected in initial HTML
Live Payload from https://datadoghq.com/llms.txt
# Datadog

> AI-Powered Observability and Security. See inside any stack, any app, at any scale, anywhere.

Datadog is the leading cloud-based monitoring and analytics platform for applications, infrastructure, logs, and user experience. We help organizations optimize application performance, troubleshoot issues, and enhance digital experiences at scale.

## Company Information

- [About Datadog](https://www.datadoghq.com/about/)
- [Contact Us](https://www.datadoghq.com/about/contact/)
- [Career

AI Crawler /robots.txt Access Matrix

Open to Search & Training
User-Agent Token Purpose / Operator Effective Directive
OAI-SearchBot ChatGPT Search Citations Allow: /
PerplexityBot Perplexity Answer Citations Allow: /
ChatGPT-User Live User Agent Browsing Allow: /
Claude-SearchBot Anthropic Search Grounding Allow: /
GPTBot Foundation Model Training Allow: /
ClaudeBot Foundation Model Training Allow: /
Google-Extended Gemini Training Control Allow: /
Applebot-Extended Apple Intelligence Training Allow: /
Meta-ExternalAgent Llama Training & Indexing Allow: /
CCBot Open Dataset Training Corpus Allow: /

HTTP Response & Handshake Timing

GET https://www.datadoghq.com/
DNS Lookup 10 ms HTML Document 277.3 KB
TCP Connect 24 ms Script Tags 18
TLS Handshake 201 ms Stylesheets 0
Time to First Byte (TTFB) 481 ms Images (with alt) 21 / 31
Total Transfer 487 ms HTTP/3 (Alt-Svc) Not advertised

Edge Network & Application Stack

Header & DOM Signatures
Edge / Reverse Proxy AWS CloudFront
Application Framework Custom SSR / Static
Server Header AmazonS3
Mail Provider (MX) Google Workspace
Telemetry Signatures GA4 / GTM
TXT Verifications Stripe Verified, Google Search Console, Atlassian, OpenAI Domain Verified, Microsoft Entra, Anthropic Verified

TLS Certificate & HTTP Security Policy

Port 443 X.509
Certificate Issuer DigiCert Inc (130 days remaining)
Strict-Transport-Security Present
Content-Security-Policy Present
X-Content-Type-Options Present
X-Frame-Options Present
Referrer-Policy Present
Permissions-Policy Not set
SPF / DMARC Policy SPF: Yes · DMARC: Yes

Authoritative DNS & Document Head

A / AAAA / NS / Canonical
A (IPv4) 108.159.46.102, 108.159.46.81, 108.159.46.12, 108.159.46.19
AAAA (IPv6) None
NS (Nameservers) ns-1602.awsdns-08.co.uk, ns-889.awsdns-47.net, ns-1169.awsdns-18.org, ns-442.awsdns-55.com
HTML Title (39c) Cloud Monitoring as a Service | Datadog
/sitemap.xml Valid XML Sitemap

Hosted /llms.txt Mirror & Status Badge

Platform Setup Guide →
1-Line <head> Tag (for Shopify, Webflow, Framer, Wix, Squarespace & WordPress):
Sitecube status for datadoghq.com
GitHub / Docs Markdown Badge:
HTML Badge:

Technical Synthesis & Agentic Ingestion Analysis: datadoghq.com

Automated Engineering Assessment

1. HTML-to-Token Efficiency & LLM Context Window Cost

An unauthenticated HTTPS GET request to https://www.datadoghq.com/ returns an initial HTML payload of 277.3 KB, corresponding to approximately 70,990 UTF-8 tokens when ingested raw by an AI coding agent, retrieval pipeline, or headless browser. After stripping inline <script>, <style>, <svg>, and DOM markup tags, the human-readable text footprint measures 3,506 tokens (13.7 KB)—yielding an HTML Signal-to-Noise Ratio of 4.9%. In addition to its ultra-lean 70,990-token homepage HTML, datadoghq.com publishes an expanded /llms.txt documentation manifest (150,542 tokens across 591 lines, costing $52.6897 per 1,000 reads on Gemini 4 Hydrogen), giving AI agents multi-page architectural context in a single deterministic fetch.

2. Indexed Structure Inside datadoghq.com/llms.txt

Sitecube’s specification linter verified 12 H2 section headings and 558 Markdown links inside https://datadoghq.com/llms.txt under the primary heading "Datadog". Documented sections include: Company Information</code>, <code>Free Trial</code>, <code>Datadog for Startups</code>, <code>Core Products</code>, <code>Solutions</code>, <code>Case Studies</code>, <code>Resources and Architecture</code>, <code>Support Resources. Key canonical endpoints referenced in the manifest include About Datadog (https://www.datadoghq.com/about/), Contact Us (https://www.datadoghq.com/about/contact/), Careers (https://careers.datadoghq.com/), Leadership Team (https://www.datadoghq.com/about/leadership/), Free 14 Day Trial (https://www.datadoghq.com/free-datadog-trial/).

3. Edge Delivery, TLS Handshake & Security Header Assessment

Traffic for datadoghq.com resolves to 108.159.46.102 via AWS CloudFront running Custom SSR / Static, achieving a measured Time to First Byte (TTFB) of 481 ms (DNS lookup: 10 ms, TCP connect: 24 ms, TLS handshake: 201 ms). The port 443 TLS certificate is issued by DigiCert Inc with 130 days remaining before expiration (valid through 2027-03-25). Outbound email authentication via SPF is present and DMARC (_dmarc.datadoghq.com) is enforced.

Comparable Hosts in Web-to-Token & /llms.txt Registry

Full Index (28 hosts) →
Host Rating /llms.txt HTML Tokens Text Tokens Signal % Crawler Posture TTFB
sitecube.com A+ 98 1,744 tok 12,387 1,227 9.9% Open to Search & Training 66 ms
cloudflare.com A+ 96 4,294 tok 333,631 471 0.1% Open to Search & Training 251 ms
trendyflash.com A+ 95 3,120 tok 12,197 1,705 14% Open to Search & Training 36 ms
tierones.io A+ 93 481 tok 3,744 693 18.5% Open to Search & Training 30 ms
dosefacts.org A+ 93 10,613 tok 29,181 7,309 25% Open to Search & Training 107 ms
github.com A+ 92 7,165 tok 131,355 1,163 0.9% Open to Search & Training 27 ms
vercel.com A+ 92 1,385 tok 149,553 1,193 0.8% Open to Search & Training 57 ms
aiimpacted.org A+ 92 1,355 tok 17,717 3,605 20.3% Open to Search & Training 173 ms
cloq.com A 91 1,169 tok 2,109 690 32.7% Open to Search & Training 34 ms
multifactor.com A 91 656 tok 98,275 673 0.7% Open to Search & Training 329 ms
supabase.com A 89 879 tok 337,513 1,905 0.6% Open to Search & Training 55 ms
shopify.com A 89 3,161 tok 172,960 513 0.3% Open to Search & Training 95 ms