techcrunch.com
TechCrunch | Startup and Technology News
Category Scores
All 17 Checks
robots.txt blocks 7 AI crawlers: GPTBot, ChatGPT-User, anthropic-ai, Claude-Web, CCBot, Google-Extended, Bytespider
Page is open to indexing by AI agents
Server-rendered HTML contains ~1589 words of text content
Headings: 0 H1, 14 H2, 83 H3. Semantic elements: main, nav, header, footer
Found structured data: JSON-LD, RDFa
Text-to-HTML ratio: 2.9% (12KB text / 399KB total)
No FAQ schema or FAQ content detected
No llms.txt file found at site root
~1472 extractable words, <main> element found
Entity signals found: page title, meta description, Schema.org data, entity context (about/contact)
No MCP server manifest found (optional — for sites that expose tools to AI agents)
E-E-A-T signals found: byline, expertise signals
Page loaded in 115ms
2 blocking scripts, 0 stylesheets in <head>
OG tags — Title: yes, Description: yes, Image: yes, Type: yes
Meta description: 107 chars (good)
Freshness signals: <time> elements